Commit Graph

  • a297247137 wait for each publish clients chrislu 2024-01-28 14:27:32 -08:00
  • b6c5e57c30 read will block if no items chrislu 2024-01-28 13:10:34 -08:00
  • 0bf5424a2e adjust visibility chrislu 2024-01-28 13:09:30 -08:00
  • dedfd31dfb refactor chrislu 2024-01-28 12:30:08 -08:00
  • cbf750a31f refactor chrislu 2024-01-28 12:23:20 -08:00
  • b51dfe2bff wait for publishing clients chrislu 2024-01-28 12:06:58 -08:00
  • f8c55f101e clean up chrislu 2024-01-28 12:06:30 -08:00
  • d40225ecd2 return the lookup results chrislu 2024-01-28 12:05:44 -08:00
  • 841fafd0a8 publish to input buffer chrislu 2024-01-27 23:43:22 -08:00
  • 5dc1362bdc close the input chrislu 2024-01-27 16:12:49 -08:00
  • fa835c9319 Update buffered_queue_test.go chrislu 2024-01-27 14:46:12 -08:00
  • b6de35cdb2 moved. there are some deadlock. WIP Chris Lu 2024-01-27 13:51:19 -08:00
  • 91af1f3069 schedule jobs chrislu 2024-01-26 14:09:57 -08:00
  • f6e39139d8 weed/storage: Fix volume info file permissions (#5246) Benoît Knecht 2024-01-26 17:31:27 +01:00
  • 08c5fba825 adds a buffered queue chrislu 2024-01-25 20:22:41 -08:00
  • cb50b720fd Revert "Fix weed fix" chrislu 2024-01-25 08:09:36 -08:00
  • 1f08010ef0 weed/shell: Cleanup volume balance logic (#5241) Benoît Knecht 2024-01-25 15:19:58 +01:00
  • 0f8e76bbd6 fix: clean metric MasterReplicaPlacementMismatch for unregister volume (#5239) Konstantin Lebedev 2024-01-25 13:23:24 +05:00
  • a6aee847b9 weed/shell: Fix volume.balance logic (#5238) Benoît Knecht 2024-01-25 09:17:32 +01:00
  • 0b71fae2e3 fix: s3tests test_get_object_ifnonematch_good (#5237) Konstantin Lebedev 2024-01-25 00:05:55 +05:00
  • 95787ea89d Enable multiple disks per volume server. Also streamline the use of /logs & /idx (#5236) spastorclovr 2024-01-24 18:25:17 +01:00
  • 025f8eb37b return dir assign counter chrislu 2024-01-23 19:47:31 -08:00
  • d4e66cc140 return dir assign counter chrislu 2024-01-23 19:47:31 -08:00
  • a8ddbf9ed2 Merge branch 'master' into mq-subscribe chrislu 2024-01-23 19:41:16 -08:00
  • 49fcb48e04 same logic as grpc assign chrislu 2024-01-23 19:39:59 -08:00
  • 7c1ad109ef Merge branch 'master' into mq-subscribe chrislu 2024-01-22 13:23:12 -08:00
  • 439377b7a0 adjust exception text chrislu 2024-01-22 12:53:44 -08:00
  • 2158e163f7 Update the solution when a file cannot be located. (#5223) Chen Honghai 2024-01-23 04:49:09 +08:00
  • d268fbe18a when configure, cancel existing assignments chrislu 2024-01-22 11:57:17 -08:00
  • 3ff6b31d94 sub broker wait for partition chrislu 2024-01-22 11:56:55 -08:00
  • 2beaa2d0b3 pub/sub brokers check filer for assigned partitions chrislu 2024-01-22 11:44:21 -08:00
  • c3f8530f97 refactor chrislu 2024-01-22 11:06:53 -08:00
  • 5f35857cd0 no need to assign partitions explicitly chrislu 2024-01-22 11:04:47 -08:00
  • 428fea45f3 updated and added assignments chrislu 2024-01-22 11:04:24 -08:00
  • e8b05ecc91 add/remove assigned partitions chrislu 2024-01-22 10:47:39 -08:00
  • 861ad732ca refactor chrislu 2024-01-22 09:00:22 -08:00
  • 47924afa1c refactor chrislu 2024-01-22 08:52:44 -08:00
  • 32977a053c Bump google.golang.org/api from 0.151.0 to 0.157.0 (#5225) dependabot[bot] 2024-01-22 08:23:31 -08:00
  • 91a7ee3be9 Bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.47.5 to 1.48.0 (#5226) dependabot[bot] 2024-01-22 08:23:14 -08:00
  • 54a5c878e9 Bump github.com/aws/aws-sdk-go-v2/credentials from 1.16.14 to 1.16.16 (#5227) dependabot[bot] 2024-01-22 07:51:07 -08:00
  • 835c797731 Bump golang.org/x/net from 0.19.0 to 0.20.0 (#5228) dependabot[bot] 2024-01-22 07:50:42 -08:00
  • 104601392b Bump actions/dependency-review-action from 3.1.5 to 4.0.0 (#5224) dependabot[bot] 2024-01-22 07:27:12 -08:00
  • 581cf6644c lookup reads from filer instead of local memory chrislu 2024-01-22 00:52:55 -08:00
  • 7121ae9617 separate out read topic conf and ensure topic active assignments chrislu 2024-01-22 00:51:31 -08:00
  • c77d35313e pub/sub broker only check local assigned partitions chrislu 2024-01-22 00:49:57 -08:00
  • b0a2e9aea3 fix assignments if brokers changed chrislu 2024-01-21 01:27:22 -08:00
  • 9ce7c482b3 refactor chrislu 2024-01-21 01:24:12 -08:00
  • a5b906c0dd refactor chrislu 2024-01-21 01:23:43 -08:00
  • 34839237ab refactor chrislu 2024-01-20 12:16:40 -08:00
  • 2828ccbb30 refactor chrislu 2024-01-20 11:41:11 -08:00
  • 541140f735 rename chrislu 2024-01-19 11:43:40 -08:00
  • 207974cfdd Merge branch 'master' into mq-subscribe chrislu 2024-01-18 09:25:05 -08:00
  • bb867694d8 skip updating multipart .upload files chrislu 2024-01-18 09:24:26 -08:00
  • 4ca6b1be3c skip updating the .upload multipart files chrislu 2024-01-18 09:23:24 -08:00
  • d848efed1b skip updating multipart .upload files chrislu 2024-01-18 09:24:26 -08:00
  • aca3c33bab skip updating the .upload multipart files chrislu 2024-01-18 09:23:24 -08:00
  • 314e25aad6 Merge branch 'master' into mq-subscribe chrislu 2024-01-18 09:17:16 -08:00
  • 5c90b27b0a go fmt chrislu 2024-01-18 09:17:08 -08:00
  • 263f1f3d04 Merge branch 'master' into mq-subscribe chrislu 2024-01-18 09:16:46 -08:00
  • 83e4b02517 fix chrislu 2024-01-18 09:16:20 -08:00
  • 2fa519bcb5 Merge branch 'pr/5216' chrislu 2024-01-18 09:14:01 -08:00
  • 15b66a6633 refactor chrislu 2024-01-18 09:13:14 -08:00
  • 3002087541 http assign logic should be the same as grpc assign chrislu 2024-01-18 08:58:53 -08:00
  • be166b434f fix: skip s3 .uploads XIAOYQ 2024-01-18 22:13:46 +08:00
  • c8090b1f99 send assignments to newly connected subscribers chrislu 2024-01-17 22:44:39 -08:00
  • c616081ab9 refactor chrislu 2024-01-17 22:29:59 -08:00
  • 4e9ea1e628 chore: filer healthz handler check filer store (#5208) Konstantin Lebedev 2024-01-17 20:46:37 +05:00
  • f9cf13fada [filer] avoid return http ok for not allowed methods (#5209) Konstantin Lebedev 2024-01-17 20:17:07 +05:00
  • 2eb82778bc chore: fix typos in scaffold help output (#5211) Andrew Azores 2024-01-17 10:10:17 -05:00
  • bc8d2a01cc create local topic partition from config on filer chrislu 2024-01-17 00:15:52 -08:00
  • fdf0ea8e11 passing partition info chrislu 2024-01-16 09:30:57 -08:00
  • be0c426dc7 simplify to LookupTopicPartitions(topic) chrislu 2024-01-16 09:30:46 -08:00
  • db3670a3a5 simplify api chrislu 2024-01-16 08:55:47 -08:00
  • 34a78ffad0 remove isForPublish from LookupTopicBrokers chrislu 2024-01-16 08:52:42 -08:00
  • 3795d8dca8 release local topic partition if no publisher and subscribers chrislu 2024-01-16 08:43:07 -08:00
  • f782165638 rename chrislu 2024-01-16 08:40:45 -08:00
  • dd1ec70e62 rename chrislu 2024-01-16 08:40:23 -08:00
  • 53be97d5be Fix(k8s-chart-helm): helm upgrade statefulset error (#5207) Sébastien 2024-01-16 16:40:21 +01:00
  • 1877ce5126 rename chrislu 2024-01-15 21:31:21 -08:00
  • ba73199174 reuse local partition chrislu 2024-01-15 21:22:41 -08:00
  • 33d5343ea1 Merge branch 'master' into mq-subscribe chrislu 2024-01-15 20:56:21 -08:00
  • 59b8af99b0 3.62 chrislu 2024-01-15 20:44:00 -08:00
  • 6d45bb3038 Merge branch 'master' into mq-subscribe chrislu 2024-01-15 20:43:03 -08:00
  • 7e6497cc1c adjust publisher subscriber chrislu 2024-01-15 20:42:46 -08:00
  • 316ae45795 can vacuum volume when size mismatch (#5200) skycope 2024-01-16 08:16:46 +08:00
  • c82236b41b Bump github.com/linxGnu/grocksdb from 1.8.10 to 1.8.11 (#5202) dependabot[bot] 2024-01-15 15:38:45 -08:00
  • 25a8775006 Bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.54.2 to 3.54.3 (#5203) dependabot[bot] 2024-01-15 15:38:37 -08:00
  • 4ce95ad662 Bump modernc.org/sqlite from 1.27.0 to 1.28.0 (#5204) dependabot[bot] 2024-01-15 15:38:30 -08:00
  • 41458a5788 Bump gocloud.dev/pubsub/natspubsub from 0.35.0 to 0.36.0 (#5205) dependabot[bot] 2024-01-15 15:38:20 -08:00
  • 026c54a9bb fix publisher chrislu 2024-01-15 00:20:21 -08:00
  • fa59a5d67e read from disk if not in memory chrislu 2024-01-15 00:20:12 -08:00
  • 49f7de9daa Merge branch 'master' into mq-subscribe chrislu 2024-01-13 17:52:18 -08:00
  • d6ba97219b refactoring chrislu 2024-01-13 17:51:53 -08:00
  • 8d23e36c45 fix: doDeleteFiles deletes files (#5198) Konstantin Lebedev 2024-01-13 00:04:29 +05:00
  • 1169f94310 Fix filer sync set offset (#5197) Konstantin Lebedev 2024-01-12 23:57:18 +05:00
  • 3aa3991f0f adjust client side logs chrislu 2024-01-11 23:08:53 -08:00
  • 7afaad31a4 wait on local topic partition creation chrislu 2024-01-11 23:08:02 -08:00
  • 61dbdd0ff6 log ctrl messages chrislu 2024-01-11 23:07:32 -08:00
  • f750a5e03b passing timestamp chrislu 2024-01-11 23:03:55 -08:00
  • 45994641e9 lint chrislu 2024-01-11 23:03:35 -08:00