Commit Graph

  • b2ba7d7408 Resolve replica placement for EC volumes from master server defaults. (#6303) Lisandro Pin 2024-12-02 17:44:07 +01:00
  • 9a741a61b1 Display details upon failures to re-balance EC shards racks. (#6299) Lisandro Pin 2024-11-28 17:42:41 +01:00
  • 559a1fd0f4 Improve EC shards rebalancing logic across nodes (#6297) Lisandro Pin 2024-11-27 20:51:57 +01:00
  • 88fa64a01a change comment for expect header (#6289) steve.wei 2024-11-27 00:35:41 +08:00
  • e2e97db917 [master] avoid timeout when assigning for main request with filter by DC or rack (#6291) Konstantin Lebedev 2024-11-26 21:33:31 +05:00
  • fec88e64eb [master] update LastLeaderChangeTime for hashicorp raft (#6292) Konstantin Lebedev 2024-11-26 21:02:45 +05:00
  • d43fa07f06 use readable bytes size string in shell output (#6288) Trim21 2024-11-26 09:25:17 +08:00
  • f965af51b7 chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.3 to 1.69.0 (#6287) dependabot[bot] 2024-11-25 14:35:21 -08:00
  • 11042ddb71 chore(deps): bump docker/metadata-action from 5.5.1 to 5.6.1 (#6281) dependabot[bot] 2024-11-25 14:27:46 -08:00
  • e4abb6cbea chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.6.1 to 2.7.1 (#6283) dependabot[bot] 2024-11-25 14:26:51 -08:00
  • 19d01c02c6 chore(deps): bump github.com/stretchr/testify from 1.9.0 to 1.10.0 (#6284) dependabot[bot] 2024-11-25 14:26:44 -08:00
  • d54fbca481 chore(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.17.45 to 1.17.46 (#6285) dependabot[bot] 2024-11-25 14:26:37 -08:00
  • 29aaf3e68e chore(deps): bump google.golang.org/protobuf from 1.35.1 to 1.35.2 (#6286) dependabot[bot] 2024-11-25 14:26:29 -08:00
  • 8836fa19b6 use ShouldGrowVolumesByDcAndRack (#6280) Konstantin Lebedev 2024-11-25 22:30:37 +05:00
  • 167b50be88 fix missing register master metric MasterPickForWriteErrorCounter (#6277) Konstantin Lebedev 2024-11-25 21:59:11 +05:00
  • fd6c787c02 fix EcVolumes sorting in volume UI (#6275) Trim21 2024-11-24 14:43:08 +08:00
  • ccf1795e6f wait a bit before getting the next volume id if the leader is recently elected chrislu 2024-11-23 19:58:45 -08:00
  • 04081128a9 use math rand v2 chrislu 2024-11-21 08:54:03 -08:00
  • 54204bc89b format error chrislu 2024-11-21 08:52:37 -08:00
  • ca499de1cb Improve EC shards rebalancing logic across racks (#6270) Lisandro Pin 2024-11-21 17:46:24 +01:00
  • e56327e3b0 ExclusiveLocker only create one renew goroutine (#6269) Numblgw 2024-11-22 00:27:12 +08:00
  • aebf3952b7 filer sync: source path and exclude path support dir suffix (#6268) Numblgw 2024-11-22 00:25:12 +08:00
  • 7fa4e5c2a1 [master] Revert back automatic volume grow in case of compensate for crowded volumes (#6267) Konstantin Lebedev 2024-11-21 21:19:19 +05:00
  • a143c888e5 [shell] don't require lock when there are no changes for volume.fix.replication (#6266) Konstantin Lebedev 2024-11-21 21:17:25 +05:00
  • a49d9e020c [master] avoid crowded more writable for auto grow (#6214) Konstantin Lebedev 2024-11-21 13:57:42 +05:00
  • 75f5afa571 fix compilation chrislu 2024-11-21 00:41:22 -08:00
  • 1c143cfcea display actual offset value chrislu 2024-11-21 00:38:03 -08:00
  • c9f3448692 ReadAt may return io.EOF t end of file chrislu 2024-11-21 00:37:38 -08:00
  • be09d08eb6 adjust error message chrislu 2024-11-20 23:49:01 -08:00
  • 6b2612690b consistent error message if auth is not setup chrislu 2024-11-20 23:11:16 -08:00
  • 254ed8897e [shell] add noLock param for volume.move (#6261) Konstantin Lebedev 2024-11-20 21:35:24 +05:00
  • 96f1a2e01a adjust error message chrislu 2024-11-19 14:16:00 -08:00
  • bb37886f6a chore(deps): bump github.com/rclone/rclone from 1.68.1 to 1.68.2 (#6260) dependabot[bot] 2024-11-19 13:44:32 -08:00
  • e28f55eb08 typo chrislu 2024-11-19 08:32:31 -08:00
  • 98f03862aa rename chrislu 2024-11-19 08:31:54 -08:00
  • 07cf8cf22d minor chrislu 2024-11-19 08:31:33 -08:00
  • 0d5393641e Unify usage of shell.EcNode.dc as DataCenterId. (#6258) Lisandro Pin 2024-11-19 15:33:18 +01:00
  • 2caa0e3741 java 3.80 chrislu 2024-11-18 22:41:59 -08:00
  • bc7650bd61 adds more info on skipped volumes chrislu 2024-11-18 18:25:38 -08:00
  • f2db746690 Introduce logic to resolve volume replica placement within EC rebalancing. (#6254) Lisandro Pin 2024-11-19 03:05:06 +01:00
  • 7b3c0e937f 3.80 chrislu 2024-11-18 09:48:33 -08:00
  • 180f267867 chore(deps): bump github.com/linxGnu/grocksdb from 1.9.5 to 1.9.7 (#6249) dependabot[bot] 2024-11-18 09:37:06 -08:00
  • b21f599cde chore(deps): bump modernc.org/sqlite from 1.33.1 to 1.34.1 (#6251) dependabot[bot] 2024-11-18 09:36:52 -08:00
  • 3fba0adc9d chore(deps): bump github.com/aws/aws-sdk-go-v2/config from 1.28.0 to 1.28.4 (#6252) dependabot[bot] 2024-11-18 09:36:43 -08:00
  • f8f162aa72 chore(deps): bump go.etcd.io/etcd/client/v3 from 3.5.16 to 3.5.17 (#6253) dependabot[bot] 2024-11-18 09:36:31 -08:00
  • 6d3e38f439 Adjust threshold config (#6246) zemul 2024-11-18 12:51:26 +08:00
  • 4a0dc883cf Fix/parse upload filename (#6241) Kevin Bulteel 2024-11-15 20:25:18 +01:00
  • 8ebbf37e8e Add a loop to wait for master and filer services in post-install-bucket-hook (#6240) Omar Hamadeh 2024-11-15 22:15:33 +03:00
  • 008ac38ebc fix java.lang.IllegalArgumentException: Comparison method violates its general contract! (#6239) fo40225 2024-11-15 09:26:50 +08:00
  • a5fe6e21bc feat(filer.backup): add ignore errors option (#6235) Max Denushev 2024-11-14 19:40:55 +03:00
  • 3003c9e17e added backward compatible CRC check and extra explanatory comments (#6233) Eugeniy E. Mikhailov 2024-11-12 16:56:14 -05:00
  • 31d8907e77 chore(deps): bump github.com/golang-jwt/jwt/v4 from 4.5.0 to 4.5.1 (#6231) dependabot[bot] 2024-11-11 11:54:07 -08:00
  • 7b0a37312d chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.66.2 to 1.66.3 (#6225) dependabot[bot] 2024-11-11 11:15:24 -08:00
  • 623fc3a4fc chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.32.3 to 1.32.4 (#6227) dependabot[bot] 2024-11-11 11:15:09 -08:00
  • aa31c5422b chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.89.2 to 3.91.0 (#6228) dependabot[bot] 2024-11-11 11:15:00 -08:00
  • 6232041c64 chore(deps): bump golang.org/x/tools from 0.26.0 to 0.27.0 (#6229) dependabot[bot] 2024-11-11 11:14:48 -08:00
  • 72b14a451e delete aborted ec shards from both source and target servers (#6221) Chris Lu 2024-11-09 11:32:08 -08:00
  • 3400962877 [helm] fix s3 servicemonitor label matching (#6218) Nathan Dorsey 2024-11-08 15:04:40 -05:00
  • 113c9ce6a8 remove the direct_io flag, as it is not well-supported on macOS chrislu 2024-11-07 14:18:59 -08:00
  • 88a1eee31c adjust logs chrislu 2024-11-07 13:00:12 -08:00
  • 62c4980754 add debug info chrislu 2024-11-06 11:59:00 -08:00
  • 9a5d3e7b31 [shell] add admin noLock for balance (#6209) Konstantin Lebedev 2024-11-06 08:09:22 +05:00
  • 15fc58bfd9 remove dup code for section.reader access (#6169) Bruce 2024-11-06 11:08:59 +08:00
  • 706d1a8e22 fix tests chrislu 2024-11-05 08:52:07 -08:00
  • 90acfd9394 remove case when read request is out side of the file size chrislu 2024-11-05 08:42:44 -08:00
  • 6161d0b05d a bit optimization chrislu 2024-11-05 08:41:14 -08:00
  • 98b519b113 fix FUSE mount on mac chrislu 2024-11-05 08:28:50 -08:00
  • efdebf712e Refactor ec.balance logic into a weeed/shell/command_ec_common.go… (#6195) Lisandro Pin 2024-11-05 02:56:20 +01:00
  • dc784bf217 merge current message queue code changes (#6201) Chris Lu 2024-11-04 12:08:25 -08:00
  • ffe908371d chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.61.2 to 1.66.2 (#6197) dependabot[bot] 2024-11-04 09:34:36 -08:00
  • 92366134e3 chore(deps): bump github.com/gocql/gocql from 1.6.0 to 1.7.0 (#6196) dependabot[bot] 2024-11-04 09:26:52 -08:00
  • e2d30cc3bc chore(deps): bump gocloud.dev/pubsub/natspubsub from 0.39.0 to 0.40.0 (#6198) dependabot[bot] 2024-11-04 09:26:27 -08:00
  • d185e6beea chore(deps): bump golang.org/x/tools from 0.25.0 to 0.26.0 (#6199) dependabot[bot] 2024-11-04 09:26:17 -08:00
  • f67b5b20ca chore(deps): bump cloud.google.com/go/pubsub from 1.43.0 to 1.45.1 (#6200) dependabot[bot] 2024-11-04 09:25:59 -08:00
  • a7973ed7d1 fix deadlock hang when broadcast to clients (#6184) wyang 2024-11-04 15:20:48 +08:00
  • 0f2c3648dc fix mount: cannot locate OSXFUSE chrislu 2024-11-03 13:08:17 -08:00
  • 5bddf0c085 [shell] volume.balance collect volume servers by dc rack node (#6191) Konstantin Lebedev 2024-11-04 00:08:45 +05:00
  • 65fb8fad99 Update filer_multipart.go (#6188) han 2024-11-01 15:38:35 +08:00
  • 0060a2cf9c Fix 6181/6182 (#6183) Bruce 2024-10-31 23:40:05 +08:00
  • c29c912bdc fix format (#6185) wyang 2024-10-31 23:30:35 +08:00
  • ad6240f066 fix parameter chrislu 2024-10-30 20:30:51 -07:00
  • 8802843511 pass in bytes buffer to avoid possible race condition chrislu 2024-10-30 09:31:22 -07:00
  • 3feb66d0a1 adding more debug message chrislu 2024-10-30 09:16:40 -07:00
  • 228946369c 3.79 chrislu 2024-10-28 19:44:39 -07:00
  • 9873b033d1 backward compatible vif loading chrislu 2024-10-28 19:44:30 -07:00
  • f17048d32a chore(deps): bump github.com/redis/go-redis/v9 from 9.6.2 to 9.7.0 (#6174) dependabot[bot] 2024-10-28 11:30:13 -07:00
  • cd789d869d chore(deps): bump modernc.org/sqlite from 1.33.0 to 1.33.1 (#6173) dependabot[bot] 2024-10-28 11:30:00 -07:00
  • 1f9f6fae6b chore(deps): bump cloud.google.com/go/storage from 1.43.0 to 1.45.0 (#6172) dependabot[bot] 2024-10-28 11:29:50 -07:00
  • c74dca10cb chore(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.77.1 to 3.89.2 (#6171) dependabot[bot] 2024-10-28 11:29:42 -07:00
  • 0f55dd452d chore(deps): bump google.golang.org/grpc from 1.67.0 to 1.67.1 (#6170) dependabot[bot] 2024-10-28 11:29:31 -07:00
  • 9105c6bdd1 fix format chrislu 2024-10-28 11:28:40 -07:00
  • ebbb35d533 3.78 chrislu 2024-10-27 17:44:22 -07:00
  • 089d4316ef ensure 2 volume space since actual need 1.4x volume size empty space chrislu 2024-10-24 22:44:53 -07:00
  • 6e388e29c9 correcting free volume count, factor it during ec encoding to ensure enough disk space available chrislu 2024-10-24 22:42:38 -07:00
  • 8d6189bcc5 adjust output format chrislu 2024-10-24 21:41:39 -07:00
  • 2f3d820f52 rename proto field chrislu 2024-10-24 21:36:56 -07:00
  • ae5bd0667a rename proto field from DestroyTime to expire_at_sec chrislu 2024-10-24 21:35:11 -07:00
  • 1c2b10303a remove X-Forwarded-For chrislu 2024-10-23 17:52:40 -07:00
  • a3b97bfe03 [helm] Allow setting notification.toml config (#6159) Davide Calabrese 2024-10-23 22:27:38 +02:00
  • 73921ce4f6 adjust help message chrislu 2024-10-22 08:50:42 -07:00