gsh-digital-services/seaweedFS
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
d970c15d71be190e994f22bda5da461c5327131d
seaweedFS/weed/filer
History
Chris Lu 1b13324fb7 fix: skip log files with deleted volumes in filer backup (#7692) 
fix: skip log files with deleted volumes in filer backup (#3720)

When filer.backup or filer.meta.backup resumes after being stopped, it may
encounter persisted log files stored on volumes that have since been deleted
(via volume.deleteEmpty -force). Previously, this caused the backup to get
stuck in an infinite retry loop with 'volume X not found' errors.

This fix catches 'volume not found' errors when reading log files and skips
the problematic file instead of failing. The backup will now:
- Log a warning about the missing volume
- Skip the problematic log file
- Continue with the next log file, allowing progress

The VolumeNotFoundPattern regex was already defined but never used - this
change puts it to use.

Fixes #3720
2025-12-09 19:03:15 -08:00
..
abstract_sql
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
arangodb
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
cassandra
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
cassandra2
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
elastic/v7
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
empty_folder_cleanup
fmt
2025-12-04 10:40:01 -08:00
etcd
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
foundationdb
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
hbase
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
leveldb
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
leveldb2
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
leveldb3
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
mongodb
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
mysql
convert error fromating to %w everywhere (#6995)
2025-07-16 23:39:27 -07:00
mysql2
print only adapted url
2024-03-25 12:50:43 -07:00
postgres
Filer Store: postgres backend support pgbouncer (#7077)
2025-08-03 11:56:04 -07:00
postgres2
Filer Store: postgres backend support pgbouncer (#7077)
2025-08-03 11:56:04 -07:00
redis
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
redis2
filer: add username and keyPrefix support for Redis stores (#7591)
2025-12-01 13:31:35 -08:00
redis3
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
redis_lua
filer: add username and keyPrefix support for Redis stores (#7591)
2025-12-01 13:31:35 -08:00
rocksdb
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
sqlite
serialize sqlite operations
2022-10-12 00:03:27 -07:00
store_test
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
tarantool
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
tikv
fix(tikv): improve context propagation and refactor batch delete logic (#7558)
2025-11-26 15:54:26 -08:00
ydb
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
configuration.go
add notes for full version
2023-01-04 09:52:25 -08:00
entry_codec.go
also migrate jsonpb
2022-08-17 12:42:03 -07:00
entry.go
do delete expired entries on s3 list request (#7426)
2025-11-05 22:05:54 -08:00
filechunk_group_test.go
Context cancellation during reading range reading large files (#7093)
2025-08-06 10:09:26 -07:00
filechunk_group.go
mount: improve read throughput with parallel chunk fetching (#7569)
2025-11-29 10:06:11 -08:00
filechunk_manifest_test.go
move to https://github.com/seaweedfs/seaweedfs
2022-07-29 00:17:28 -07:00
filechunk_manifest.go
Clients to volume server requires JWT tokens for all read operations (#7376)
2025-10-24 17:09:58 -07:00
filechunk_section_test.go
merge chunks during upload (#4130)
2023-01-12 23:07:36 -08:00
filechunk_section.go
mount: improve read throughput with parallel chunk fetching (#7569)
2025-11-29 10:06:11 -08:00
filechunks2_test.go
Add context with request (#6824)
2025-05-28 11:34:02 -07:00
filechunks_read_test.go
more solid weed mount (#4089)
2023-01-02 23:20:45 -08:00
filechunks_read.go
"golang.org/x/exp/slices" => "slices" and go fmt
2024-12-19 19:25:06 -08:00
filechunks_test.go
S3 API: Advanced IAM System (#7160)
2025-08-30 11:15:48 -07:00
filechunks.go
Filer: fix filer range read (#7078)
2025-08-03 14:26:15 -07:00
filer_buckets.go
filer: remove replication, collection, disk_type info from entry metadata
2022-06-06 00:39:35 -07:00
filer_conf_test.go
move to https://github.com/seaweedfs/seaweedfs
2022-07-29 00:17:28 -07:00
filer_conf.go
Support multiple filers for S3 and IAM servers with automatic failover (#7550)
2025-11-26 11:29:55 -08:00
filer_delete_entry.go
convert error fromating to %w everywhere (#6995)
2025-07-16 23:39:27 -07:00
filer_deletion_test.go
Filer: Add retry mechanism for failed file deletions (#7402)
2025-10-29 18:31:23 -07:00
filer_deletion.go
Filer: Add retry mechanism for failed file deletions (#7402)
2025-10-29 18:31:23 -07:00
filer_hardlink.go
move to https://github.com/seaweedfs/seaweedfs
2022-07-29 00:17:28 -07:00
filer_notify_append.go
convert error fromating to %w everywhere (#6995)
2025-07-16 23:39:27 -07:00
filer_notify_read.go
fix: skip log files with deleted volumes in filer backup (#7692)
2025-12-09 19:03:15 -08:00
filer_notify_test.go
refactor filer_pb.Entry and filer.Entry to use GetChunks()
2022-11-15 06:33:36 -08:00
filer_notify.go
fix: skip log files with deleted volumes in filer backup (#7692)
2025-12-09 19:03:15 -08:00
filer_on_meta_event.go
filer: async empty folder cleanup via metadata events (#7614)
2025-12-03 21:12:19 -08:00
filer_rename.go
Fix: http rename move dir to subdir (#4432)
2023-04-26 20:54:36 -07:00
filer_search.go
filer: async empty folder cleanup via metadata events (#7614)
2025-12-03 21:12:19 -08:00
filer.go
filer: async empty folder cleanup via metadata events (#7614)
2025-12-03 21:12:19 -08:00
filerstore_hardlink.go
Changes logging function (#6919)
2025-06-24 08:44:06 -07:00
filerstore_translate_path.go
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
filerstore_wrapper.go
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
filerstore.go
Add error list each entry func (#7485)
2025-11-25 19:35:19 -08:00
interval_list_test.go
more solid weed mount (#4089)
2023-01-02 23:20:45 -08:00
interval_list.go
Mount concurrent read (#4400)
2023-04-13 22:32:45 -07:00
meta_aggregator.go
S3: Directly read write volume servers (#7481)
2025-11-18 23:18:35 -08:00
meta_replay.go
"golang.org/x/exp/slices" => "slices" and go fmt
2024-12-19 19:25:06 -08:00
read_remote.go
refactor filer_pb.Entry and filer.Entry to use GetChunks()
2022-11-15 06:33:36 -08:00
read_write.go
added context to filer_client method calls (#6808)
2025-05-22 09:46:49 -07:00
reader_at_test.go
Context cancellation during reading range reading large files (#7093)
2025-08-06 10:09:26 -07:00
reader_at.go
mount: improve read throughput with parallel chunk fetching (#7627)
2025-12-04 23:40:56 -08:00
reader_cache_test.go
mount: improve read throughput with parallel chunk fetching (#7627)
2025-12-04 23:40:56 -08:00
reader_cache.go
mount: improve read throughput with parallel chunk fetching (#7627)
2025-12-04 23:40:56 -08:00
reader_pattern.go
Fix a few data races when reading files in mount (#3527)
2022-08-26 16:41:37 -07:00
remote_mapping.go
convert error fromating to %w everywhere (#6995)
2025-07-16 23:39:27 -07:00
remote_storage_test.go
move to https://github.com/seaweedfs/seaweedfs
2022-07-29 00:17:28 -07:00
remote_storage.go
chore(deps): bump github.com/viant/ptrie from 0.3.1 to 1.0.1 (#5552)
2024-04-29 18:42:31 -07:00
s3iam_conf_test.go
s3: fix configuring IAM for the same user
2022-08-30 09:37:52 -07:00
s3iam_conf.go
convert error fromating to %w everywhere (#6995)
2025-07-16 23:39:27 -07:00
stream.go
fix: skip log files with deleted volumes in filer backup (#7692)
2025-12-09 19:03:15 -08:00
topics.go
merge current message queue code changes (#6201)
2024-11-04 12:08:25 -08:00