gsh-digital-services/seaweedFS
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • f88a8bda7b ec deletion works Chris Lu 2019-06-21 01:14:10 -07:00
  • 613a2e8060 delete garbage only when successful Chris Lu 2019-06-20 23:46:00 -07:00
  • 11be0b5e91 more logging Chris Lu 2019-06-20 23:45:30 -07:00
  • 4b0f084b5d delete chunks only when file writing is successful Chris Lu 2019-06-20 21:58:35 -07:00
  • eebc44cce3 refactoring Chris Lu 2019-06-20 21:57:17 -07:00
  • 3106065b58 fix startup problem with metrics Chris Lu 2019-06-20 09:56:49 -07:00
  • c74dc2b306 go fmt Chris Lu 2019-06-20 00:55:52 -07:00
  • e63317fb08 ec deletion code complete, not tested yet Chris Lu 2019-06-20 00:55:30 -07:00
  • 4cea8aefd0 add grpc VolumeEcBlobDelete Chris Lu 2019-06-20 00:17:11 -07:00
  • 856da7aae2 ec volume support deletes Chris Lu 2019-06-19 22:57:14 -07:00
  • 115558e5f5 adjust counters Chris Lu 2019-06-17 21:02:50 -07:00
  • d8ed73926d volume servers get metrics address and interval from the master Chris Lu 2019-06-17 14:51:47 -07:00
  • 68d1bef236 instance format Chris Lu 2019-06-16 21:57:32 -07:00
  • 935639b908 metrics: disk size for <collection, normal/EC> Chris Lu 2019-06-16 21:56:41 -07:00
  • 0fdb1e705d collect volume disk usage metrics Chris Lu 2019-06-16 02:44:20 -07:00
  • 289fd7eb39 count number of volumes and ec shards Chris Lu 2019-06-16 02:24:15 -07:00
  • ff6a6dd11e refactoring Chris Lu 2019-06-15 21:46:55 -07:00
  • 8b43679ae3 refactoring Chris Lu 2019-06-15 12:21:44 -07:00
  • 5336008dcd refactoring Chris Lu 2019-06-14 13:06:01 -07:00
  • d67189921f go fmt Chris Lu 2019-06-14 00:55:12 -07:00
  • 5f6c9825f8 volume server: adds basic metrics Chris Lu 2019-06-14 00:54:56 -07:00
  • a11525fe4e filer: adds basic metrics pushing to Prometheus gateway Chris Lu 2019-06-13 02:01:51 -07:00
  • c542714448 Update README.md Chris Lu 2019-06-11 10:11:00 -07:00
  • fe78cc0bc9 Update README.md Chris Lu 2019-06-10 21:55:57 -07:00
  • be3f1f84a2 1.35 Chris Lu 2019-06-10 21:34:06 -07:00
  • 57092d69ac go fmt Chris Lu 2019-06-10 21:33:32 -07:00
  • f9d8bd51ad ec shard balancing Chris Lu 2019-06-10 21:32:56 -07:00
  • 9d9162ca35 ec.balance: collect dc rack info Chris Lu 2019-06-07 00:25:01 -07:00
  • 7912a812f1 Update README.md Chris Lu 2019-06-06 09:15:40 -07:00
  • eeb9860829 Update README.md Chris Lu 2019-06-06 01:34:04 -07:00
  • e66bddd84c customizable sleep intervals Chris Lu 2019-06-06 00:39:08 -07:00
  • 50aa769554 jwt for read access control Chris Lu 2019-06-06 00:29:02 -07:00
  • d344e0a035 fix ec related bugs Chris Lu 2019-06-05 23:20:26 -07:00
  • 450f4733ce report empty volume or ec shards Chris Lu 2019-06-05 13:32:33 -07:00
  • 7f6fb9ffd0 every 17 minutes instead of seconds Chris Lu 2019-06-05 13:32:08 -07:00
  • 6b08db65b0 fix shard count reporting Chris Lu 2019-06-05 01:58:37 -07:00
  • 784141c5e6 adjust script parameter Chris Lu 2019-06-05 01:48:03 -07:00
  • ede876cfdb periodic scripts exeuction from leader master Chris Lu 2019-06-05 01:30:24 -07:00
  • b9e138713c ec.encode: add -fullPercent option Chris Lu 2019-06-05 00:13:13 -07:00
  • 0e49add2bc adjust help message Chris Lu 2019-06-05 00:11:37 -07:00
  • eaa76f11b7 free volume slots factor in ec shard counts Chris Lu 2019-06-04 23:41:56 -07:00
  • ca8a2bb534 go fmt Chris Lu 2019-06-04 22:04:10 -07:00
  • 2215e81be7 ui add ec shard statuses Chris Lu 2019-06-04 21:52:37 -07:00
  • 0e52862586 avoid the test that depends on ordering in a different folder Chris Lu 2019-06-04 02:22:32 -07:00
  • 2f7710a75d debug sporadic test error on travis Chris Lu 2019-06-04 02:09:06 -07:00
  • 06133ae98f correct count for free ec slots, avoid removing generated shards Chris Lu 2019-06-04 01:49:51 -07:00
  • 6cea23d091 purge duplicated ec shards Chris Lu 2019-06-04 01:32:36 -07:00
  • b05456fe07 able to purge extra ec shard copies Chris Lu 2019-06-03 20:25:02 -07:00
  • 11cffb3168 fix ec.rebuild bugs Chris Lu 2019-06-03 11:50:54 -07:00
  • d85b41b904 fix ec.encode not finding the local ec shards Chris Lu 2019-06-03 10:38:21 -07:00
  • 7e80b2b882 fix multiple bugs Chris Lu 2019-06-03 02:26:31 -07:00
  • 55be09996d fix volume balance bug Chris Lu 2019-06-03 00:13:31 -07:00
  • 9ce6b949bf adjust help message Chris Lu 2019-06-01 10:37:08 -07:00
  • d6e2c877fa ec.balance: use specific collection names Chris Lu 2019-06-01 02:00:18 -07:00
  • 133b772fb5 destroy ec volume if it is empty Chris Lu 2019-06-01 01:51:28 -07:00
  • ba18314aab ec shard delete also check ec volumes, in addition to volumes Chris Lu 2019-06-01 01:41:22 -07:00
  • f919d0235c ec encode volumes quiet for a period of time Chris Lu 2019-05-31 23:41:17 -07:00
  • a72cef3c42 encode by collection Chris Lu 2019-05-31 15:48:40 -07:00
  • de1a35acdd conditionally fresh the shard locations Chris Lu 2019-05-31 02:22:12 -07:00
  • 47f1901843 ask for the ec volume version Chris Lu 2019-05-31 00:58:51 -07:00
  • 689930f092 forget shards that are broken Chris Lu 2019-05-31 00:19:13 -07:00
  • aaab2c25f5 resolve concurrent modification problem Chris Lu 2019-05-30 13:59:07 -07:00
  • f53024d79d delete ec collection Chris Lu 2019-05-30 10:40:22 -07:00
  • 40ca2f2903 add collection.delete Chris Lu 2019-05-30 09:47:54 -07:00
  • 1d111d6ce8 collection list normal and ec volumes Chris Lu 2019-05-30 09:27:23 -07:00
  • e941d0c2f4 list ec collections also Chris Lu 2019-05-30 09:17:58 -07:00
  • 866197eee3 print out the ec balancing plan Chris Lu 2019-05-30 01:38:59 -07:00
  • 5c6c757619 clean up test files Chris Lu 2019-05-29 00:34:30 -07:00
  • 5dd67f9acf reading by recover from other shards Chris Lu 2019-05-28 23:48:39 -07:00
  • 3f9ecee40f working with reading remote intervals Chris Lu 2019-05-28 21:29:07 -07:00
  • 302d9fbc6d adjust error message for file not found Chris Lu 2019-05-28 14:27:21 -07:00
  • 4f76342cbc WIP Chris Lu 2019-05-28 00:51:01 -07:00
  • 2858a954b3 read ec volume shards locations from master Chris Lu 2019-05-28 00:13:13 -07:00
  • 713596e781 caching ec shard locations Chris Lu 2019-05-27 22:54:58 -07:00
  • 3a8c1055a2 refactoring ecx to ecVolume Chris Lu 2019-05-27 22:00:36 -07:00
  • 217cde0a3b refactoring Chris Lu 2019-05-27 21:40:51 -07:00
  • 03b9291e5d volum server passes grpc option and master location to store Chris Lu 2019-05-27 21:22:23 -07:00
  • ac1ba3b667 remove comments Chris Lu 2019-05-27 21:21:52 -07:00
  • b4b407e403 add grpc ec shard read Chris Lu 2019-05-27 11:59:03 -07:00
  • a4f3d82c57 convert needle id to ec intervals to read from Chris Lu 2019-05-27 01:29:46 -07:00
  • a463759edf adjust error message Chris Lu 2019-05-26 01:14:42 -07:00
  • 92f9c7b1aa adjust ec shard status on disconnect Chris Lu 2019-05-26 01:05:08 -07:00
  • ac14cd5ad0 wdclient need to have ec shard info on initial dump Chris Lu 2019-05-26 01:01:04 -07:00
  • b58e25e588 broadcast vid->location map to master clients for ec chards Chris Lu 2019-05-26 00:49:15 -07:00
  • af67d99ca4 incrementally update master ec shards state Chris Lu 2019-05-26 00:21:17 -07:00
  • db94a41f9e mount/unmount ec shards Chris Lu 2019-05-25 23:23:19 -07:00
  • 41e8ae61f8 generate, balance, delete copied shards, delete old volume Chris Lu 2019-05-25 14:02:06 -07:00
  • f0e6574d5e allocate ec shards to volume servers Chris Lu 2019-05-25 02:02:44 -07:00
  • 6f4b09b6a4 pb shard info uses ShardBits instead one message for one shard Chris Lu 2019-05-24 13:28:44 -07:00
  • 228850d588 shard id starts from zero Chris Lu 2019-05-24 11:52:23 -07:00
  • 24b8ad9a14 push the ec shard info to master Chris Lu 2019-05-23 23:47:49 -07:00
  • 8838176d82 register ec shards to topology Chris Lu 2019-05-23 23:34:29 -07:00
  • 8a96445f40 register ec shards to each data node Chris Lu 2019-05-23 22:51:18 -07:00
  • 4659d80035 prepare to register ec shard info in master Chris Lu 2019-05-23 00:42:28 -07:00
  • e913ee380a add comments Chris Lu 2019-05-23 00:04:24 -07:00
  • 7180520889 ec shard info can be queried via VolumeList() Chris Lu 2019-05-22 22:44:28 -07:00
  • 17ac1290c0 volume: load ec shards during heartbeats to master Chris Lu 2019-05-21 22:41:20 -07:00
  • 54b835e1ae filer: redis cluster add option for password Chris Lu 2019-05-20 09:00:30 -07:00
  • fbbc74abb4 adds VolumeEcGenerateSlices, VolumeEcCopy Chris Lu 2019-05-20 00:53:17 -07:00
  • ae499fd5aa Merge branch 'master' into erasure_coding Chris Lu 2019-05-19 21:38:18 -07:00