seaweedFS

Files

Chris Lu d1a631123f fix(s3api): allow bucket recreation when orphaned collection exists (#8605 )

* fix(s3api): allow bucket recreation when orphaned collection exists (#8601)

When a bucket is deleted, its filer directory is removed but the
underlying collection/volumes may not be fully cleaned up yet. If the
bucket is immediately recreated, PutBucketHandler was returning
ErrBucketAlreadyExists due to the orphaned collection, blocking bucket
recreation and causing subsequent uploads to fail with InternalError.

Allow bucket creation to proceed when a collection exists without a
corresponding bucket directory, since this is a transient orphaned state
from a previous deletion.

* fix(s3api): handle concurrent bucket creation race in mkdir

On mkdir failure, re-check whether the bucket directory now exists
and return BucketAlreadyExists instead of InternalError when another
request created the bucket concurrently.

2026-03-11 13:42:43 -07:00

cors

go fmt

2026-01-28 14:34:07 -08:00

iceberg

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

policy

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

policy_engine

Worker set its working directory (#8461 )

2026-02-27 12:22:21 -08:00

s3_constants

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3_objectlock

mount: make metadata cache rebuilds snapshot-consistent (#8531 )

2026-03-07 09:19:40 -08:00

s3bucket

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3err

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

s3tables

Worker set its working directory (#8461 )

2026-02-27 12:22:21 -08:00

AmazonS3.xsd

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

auth_credentials_subscribe_test.go

go fmt

2026-02-20 18:40:47 -08:00

auth_credentials_subscribe.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

auth_credentials_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

auth_credentials_trust.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

auth_credentials.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

auth_proxy_integration_test.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

auth_security_test.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

auth_signature_v2_test.go

fix(s3api): fix AWS Signature V2 format and validation (#7488 )

2025-11-26 12:24:02 -08:00

auth_signature_v2.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

auth_signature_v4_sts_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_signature_v4_test.go

fix(s3api): correctly extract host header port in extractHostHeader (#8464 )

2026-02-27 13:41:45 -08:00

auth_signature_v4.go

fix(s3api): correctly extract host header port in extractHostHeader (#8464 )

2026-02-27 13:41:45 -08:00

auth_sts_identity_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

auth_sts_v4_test.go

Fix AWS SDK Signature V4 with STS credentials (issue #7941 ) (#7944 )

2026-01-03 10:09:59 -08:00

auto_signature_v4_test.go

Fix S3 signature verification behind reverse proxies (#8444 )

2026-02-26 14:20:42 -08:00

bucket_metadata_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

bucket_metadata.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

bucket_paths.go

feat: drop table location mapping support (#8458 )

2026-02-26 16:36:24 -08:00

bucket_size_metrics.go

Make lock_manager.RenewInterval configurable in LiveLock (#7830 )

2025-12-20 15:25:47 -08:00

chunked_bug_reproduction_test.go

S3 API: unsigned streaming (no cred) but chunks contain signatures (#7118 )

2025-08-11 10:31:01 -07:00

chunked_reader_v4_test.go

IAM: Add Service Account Support (#7744 ) (#7901 )

2025-12-29 20:17:23 -08:00

chunked_reader_v4.go

s3: support STREAMING-AWS4-HMAC-SHA256-PAYLOAD-TRAILER for signed chunked uploads with checksums (#7623 )

2025-12-04 14:51:37 -08:00

copy_source_decode_test.go

s3: use url.PathUnescape for X-Amz-Copy-Source header (#8545 )

2026-03-07 11:10:02 -08:00

custom_types.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

filer_multipart_test.go

s3api: fix multipart Complete ETag matching and lower empty-upload log noise (#8264 )

2026-02-09 11:45:57 -08:00

filer_multipart.go

s3api: fix multipart Complete ETag matching and lower empty-upload log noise (#8264 )

2026-02-09 11:45:57 -08:00

filer_util_tags.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

filer_util.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

iam_defaults_test.go

Fix IAM defaults and S3Tables IAM regression (#8374 )

2026-02-18 18:20:03 -08:00

iam_optional_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

identity_reflection_test.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

object_lock_utils.go

Fix SeaweedFS S3 bucket extended attributes handling (#7854 )

2025-12-22 23:19:50 -08:00

README.txt

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3_action_resolver_test.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3_action_resolver.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3_bucket_encryption.go

fix: CORS wildcard subdomain matching cache race condition (#7736 )

2025-12-13 14:33:46 -08:00

s3_content_encoding_test.go

S3: Fix Content-Encoding header not preserved (#7894 ) (#7895 )

2025-12-27 12:25:33 -08:00

s3_end_to_end_test.go

Add AssumeRole and AssumeRoleWithLDAPIdentity STS actions (#8003 )

2026-01-12 10:45:24 -08:00

s3_error_utils.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3_existing_object_tag_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3_granular_action_security_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_iam_middleware.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_iam_role_selection_test.go

S3 API: Advanced IAM System (#7160 )

2025-08-30 11:15:48 -07:00

s3_iam_simple_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_jwt_auth_test.go

feat(s3api): Implement S3 Policy Variables (#8039 )

2026-01-16 11:12:28 -08:00

s3_list_parts_action_test.go

S3: add context aware action resolution (#7479 )

2025-11-13 16:10:46 -08:00

s3_metadata_util.go

s3: do not persist multi part "Response-Content-Disposition" in request header (#7887 )

2025-12-26 13:21:15 -08:00

s3_multipart_iam_test.go

Allow multipart upload operations when s3:PutObject is authorized (#8445 )

2026-02-25 12:31:04 -08:00

s3_multipart_iam.go

Allow multipart upload operations when s3:PutObject is authorized (#8445 )

2026-02-25 12:31:04 -08:00

s3_policy_templates_test.go

S3: Enforce bucket policy (#7471 )

2025-11-12 22:14:50 -08:00

s3_policy_templates.go

S3: Enforce bucket policy (#7471 )

2025-11-12 22:14:50 -08:00

s3_presigned_url_iam_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_presigned_url_iam.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3_sse_bucket_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_c_range_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_c_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_c.go

fix: honor SSE-C chunk offsets in decryption for large chunked uploads (#8216 )

2026-02-04 22:57:41 -08:00

s3_sse_copy_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_ctr_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_error_test.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3_sse_http_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_kms_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_kms_utils.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3_sse_kms.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3_sse_metadata.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_multipart_test.go

fix: honor SSE-C chunk offsets in decryption for large chunked uploads (#8216 )

2026-02-04 22:57:41 -08:00

s3_sse_s3_integration_test.go

go fmt

2025-10-27 23:04:55 -07:00

s3_sse_s3_multipart_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_sse_s3_test.go

fix: copy to bucket with default SSE-S3 encryption fails (#7562 ) (#7568 )

2025-11-28 13:28:17 -08:00

s3_sse_s3.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3_sse_test_utils_test.go

S3 API: Fix SSE-S3 decryption on object download (#7366 )

2025-10-23 20:10:12 -07:00

s3_sse_utils.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3_token_differentiation_test.go

fix: comprehensive go vet error fixes and add CI enforcement (#7861 )

2025-12-23 14:48:50 -08:00

s3_validation_utils.go

go fmt

2025-10-27 23:04:55 -07:00

s3api_acl_helper_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_acl_helper.go

Add Kafka Gateway (#7231 )

2025-10-13 18:05:17 -07:00

s3api_acp.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_auth.go

Fix critical authentication bypass vulnerability (#7912 ) (#7915 )

2025-12-30 12:40:59 -08:00

s3api_bucket_config.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_cors_handlers.go

S3: add fallback for CORS (#7404 )

2025-10-29 13:43:27 -07:00

s3api_bucket_handlers_lifecycle_test.go

fix(s3): lifecycle TTL rules inherit replication and volumeGrowthCount from filer config (#8321 )

2026-02-12 16:46:05 -08:00

s3api_bucket_handlers_object_lock_config.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_handlers_test.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3api_bucket_handlers.go

fix(s3api): allow bucket recreation when orphaned collection exists (#8605 )

2026-03-11 13:42:43 -07:00

s3api_bucket_metadata_test.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_bucket_policy_arn_test.go

s3api: fix AccessDenied by correctly propagating principal ARN in vended tokens (#8330 )

2026-02-12 23:11:41 -08:00

s3api_bucket_policy_engine.go

Implement IAM propagation to S3 servers (#8130 )

2026-01-26 22:59:43 -08:00

s3api_bucket_policy_handlers.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_bucket_tagging_handlers.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_circuit_breaker_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_circuit_breaker.go

s3api: fix static IAM policy enforcement after reload (#8532 )

2026-03-06 12:35:08 -08:00

s3api_conditional_headers_test.go

Refactor: Replace removeDuplicateSlashes with NormalizeObjectKey (#7873 )

2025-12-24 19:07:08 -08:00

s3api_copy_size_calculation.go

S3 API: Add SSE-S3 (#7151 )

2025-08-22 01:15:42 -07:00

s3api_copy_validation.go

S3 API: Add SSE-KMS (#7144 )

2025-08-21 08:28:07 -07:00

s3api_domain_test.go

fix: Use a mixed of virtual and path styles within a single subdomain (#7357 )

2025-10-24 01:45:22 -07:00

s3api_embedded_iam_test.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

s3api_embedded_iam.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

s3api_encrypted_volume_copy_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_etag_quoting_test.go

fix: multipart upload ETag calculation (#8238 )

2026-02-06 21:54:43 -08:00

s3api_governance_permissions_test.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

s3api_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_implicit_directory_test.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_key_rotation.go

s3: enforce authentication and JSON error format for Iceberg REST Catalog (#8192 )

2026-02-03 11:55:12 -08:00

s3api_list_normalization_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_nextmarker_test.go

fix: S3 listing NextMarker missing intermediate directory component (#8089 )

2026-01-22 16:56:35 -08:00

s3api_object_handlers_acl.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers_attributes.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3api_object_handlers_copy_test.go

fix: copy to bucket with default SSE-S3 encryption fails (#7562 ) (#7568 )

2025-11-28 13:28:17 -08:00

s3api_object_handlers_copy_unified.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_object_handlers_copy.go

s3: use url.PathUnescape for X-Amz-Copy-Source header (#8545 )

2026-03-07 11:10:02 -08:00

s3api_object_handlers_delete.go

Switch empty-folder cleanup to bucket policy (#8292 )

2026-02-10 18:38:38 -08:00

s3api_object_handlers_legal_hold.go

adjust logs

2026-01-17 18:40:48 -08:00

s3api_object_handlers_list_directory_test.go

fix: directory incorrectly listed as object in S3 ListObjects (#7939 )

2026-01-02 15:52:37 -08:00

s3api_object_handlers_list_test.go

fix(s3api): ListObjects with trailing-slash prefix matches sibling directories (#8599 )

2026-03-11 02:28:34 -07:00

s3api_object_handlers_list_versioned_test.go

fix: ListObjectVersions interleave Version and DeleteMarker in sort order (#8567 )

2026-03-09 12:37:59 -07:00

s3api_object_handlers_list.go

fix(s3api): ListObjects with trailing-slash prefix matches sibling directories (#8599 )

2026-03-11 02:28:34 -07:00

s3api_object_handlers_multipart.go

Add md5 checksum validation support on PutObject and UploadPart (#8367 )

2026-02-18 15:40:08 -08:00

s3api_object_handlers_postpolicy_test.go

Refactor: Replace removeDuplicateSlashes with NormalizeObjectKey (#7873 )

2025-12-24 19:07:08 -08:00

s3api_object_handlers_postpolicy.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers_put_test.go

check errors

2025-11-21 14:48:41 -08:00

s3api_object_handlers_put.go

s3api: add GetObjectAttributes API support (#8504 )

2026-03-04 12:52:09 -08:00

s3api_object_handlers_retention.go

refactor (#6999 )

2025-07-19 00:49:56 -07:00

s3api_object_handlers_tagging.go

Add Iceberg admin UI (#8246 )

2026-02-08 20:06:32 -08:00

s3api_object_handlers_test.go

fix: multipart upload ETag calculation (#8238 )

2026-02-06 21:54:43 -08:00

s3api_object_handlers.go

fix: cancel volume server requests on client disconnect during S3 downloads (#8373 )

2026-02-18 17:14:54 -08:00

s3api_object_lock_fix_test.go

Fix get object lock configuration handler (#6996 )

2025-07-18 02:19:50 -07:00

s3api_object_lock_headers_test.go

Test object lock and retention (#6997 )

2025-07-18 22:25:58 -07:00

s3api_object_ownership_test.go

s3: implement Bucket Owner Enforced for object ownership (#7913 )

2025-12-29 23:54:00 -08:00

s3api_object_retention_test.go

S3: S3 Object Retention API to include XML namespace support (#7517 )

2025-11-20 11:42:22 -08:00

s3api_object_retention.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_object_versioning.go

fix: ListObjectVersions interleave Version and DeleteMarker in sort order (#8567 )

2026-03-09 12:37:59 -07:00

s3api_policy.go

[s3] Put bucket lifecycle configuration (#5510 )

2024-04-27 07:39:22 -07:00

s3api_put_handlers.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_put_object_helper_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_put_object_helper.go

s3api: remove redundant auth verification in getRequestDataReader (#7685 )

2025-12-09 10:24:35 -08:00

s3api_remote_storage_test.go

fix: S3 remote storage cold-cache read fails with 'size reported but no content available' (#7817 )

2025-12-18 21:19:44 -08:00

s3api_server_grpc.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

s3api_server_routing_test.go

S3: Implement IAM defaults and STS signing key fallback (#8348 )

2026-02-16 13:59:13 -08:00

s3api_server.go

iam: add IAM group management (#8560 )

2026-03-09 11:54:32 -07:00

s3api_sosapi_test.go

s3: Add SOSAPI support for Veeam integration (#7899 )

2025-12-28 14:07:58 -08:00

s3api_sosapi.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_sse_chunk_metadata_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_sse_decrypt_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_sse_s3_upload_test.go

S3: Directly read write volume servers (#7481 )

2025-11-18 23:18:35 -08:00

s3api_status_handlers.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_streaming_copy.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_sts_assume_role_test.go

Embed role policies in AssumeRole STS tokens (#8421 )

2026-02-23 22:59:53 -08:00

s3api_sts.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

s3api_tables_rest_validation_test.go

s3api: return 400 for invalid namespace query in REST table routes (#8296 )

2026-02-10 17:57:08 -08:00

s3api_tables.go

Enforce IAM for S3 Tables bucket creation (#8388 )

2026-02-19 22:52:05 -08:00

s3api_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id_test.go

chore: execute goimports to format the code (#7983 )

2026-01-07 13:06:08 -08:00

s3api_version_id.go

Add table operations test (#8241 )

2026-02-07 13:27:47 -08:00

s3api_xsd_generated_helper.go

add s3test for sql (#5718 )

2024-07-04 11:00:41 -07:00

s3api_xsd_generated.go

fix ListAllMyBucketsResult xmlns

2025-08-14 20:38:03 -07:00

stats.go

Populate bucket_traffic_received_bytes_total metric (#7249 )

2025-09-17 19:04:51 -07:00

sts_params_test.go

s3/iam: reuse one request id per request (#8538 )

2026-03-06 15:22:39 -08:00

tags_test.go

tag parsing decode url encoded

2025-07-28 02:49:43 -07:00

tags.go

Add s3tables shell and admin UI (#8172 )

2026-01-30 22:57:05 -08:00

README.txt

see https://blog.aqwari.net/xml-schema-go/

1. go get aqwari.net/xml/cmd/xsdgen
2. Add EncodingType element for ListBucketResult in AmazonS3.xsd
3. xsdgen -o s3api_xsd_generated.go -pkg s3api AmazonS3.xsd
4. Remove empty Grantee struct in s3api_xsd_generated.go
5. Remove xmlns: sed s'/http:\/\/s3.amazonaws.com\/doc\/2006-03-01\/\ //' s3api_xsd_generated.go