Commit Graph

  • 7de121d99b Merge pull request #1084 from song-zhang/fix-benchmark-usage Chris Lu 2019-10-14 12:25:58 -07:00
  • d53aee179b Merge pull request #10 from chrislusf/master joeslay 2019-10-14 16:03:40 +01:00
  • baa813ee30 maybe prevent merge conflicts this time? j.laycock 2019-10-14 16:02:55 +01:00
  • 583dc3afdd maybe make changes merge? j.laycock 2019-10-14 15:57:40 +01:00
  • 65f1095a54 fix benchmark cmd usage info zhangsong 2019-10-14 20:23:32 +08:00
  • 50e885da45 1.44 Chris Lu 2019-10-11 23:56:58 -07:00
  • e9dd5a602a HCFS: 1.2.3 Chris Lu 2019-10-11 23:56:04 -07:00
  • 7057e7a076 HCFS: 1.22 Chris Lu 2019-10-11 21:44:44 -07:00
  • 7a707617e5 follow the redirected master Chris Lu 2019-10-09 21:00:40 -07:00
  • 15f968b054 HCFS: avoid possible jar problem Chris Lu 2019-10-09 18:09:08 -07:00
  • 87e5a02a99 fix logic error Chris Lu 2019-10-09 00:07:18 -07:00
  • 939e4b57a8 go fmt Chris Lu 2019-10-09 00:03:18 -07:00
  • 09874f0d16 volume: return error if superblock is not initialized Chris Lu 2019-10-09 00:02:50 -07:00
  • a999ed94d0 update hdfs client Chris Lu 2019-10-08 22:49:10 -07:00
  • f8d4b7d1c0 support basic json filtering and selection Chris Lu 2019-10-06 22:35:05 -07:00
  • e26670c67a add some basic sql types Chris Lu 2019-10-02 12:06:31 -07:00
  • cf47f657af scaffold for volume server query feature Chris Lu 2019-10-02 12:06:03 -07:00
  • 37e3da5e9c Update README.md Chris Lu 2019-10-05 23:12:25 -07:00
  • 9d03aa6a38 Merge pull request #8 from chrislusf/master joeslay 2019-10-01 17:55:31 +01:00
  • eb27c2b037 Make releaseMemory private and return byte array instead, fix other platform compilation issues, reduce in-memory chunk size. j.laycock 2019-10-01 12:21:44 +01:00
  • 8599442ab1 Merge pull request #1077 from iliul/fix-commonprefix-issue Chris Lu 2019-09-29 12:05:03 -07:00
  • 2cb348a2c2 s3 api: fix listbucket common_prefixes issue Lei Liu 2019-09-29 21:05:37 +08:00
  • 1bb4449e5e Merge pull request #1076 from iliul/fix-lookup-statuscode Chris Lu 2019-09-28 23:34:05 -07:00
  • 3cc084269c master api: return http 404 when volumeId not exist Lei Liu 2019-09-29 14:17:37 +08:00
  • d5f5acb734 limit locking physical memory to 80% of max physical memory j.laycock 2019-09-20 12:44:29 +01:00
  • 48b093b3d2 Merge pull request #7 from chrislusf/master joeslay 2019-09-19 12:00:05 +01:00
  • 476140fd6b minor change to setProcessWorkingSetSize function j.laycock 2019-09-19 11:59:00 +01:00
  • 972e881d48 add more logs Chris Lu 2019-09-16 09:48:30 -07:00
  • 20ae559437 add logs Chris Lu 2019-09-16 08:19:10 -07:00
  • ad3efbb197 tweaking data types Chris Lu 2019-09-14 01:21:51 -07:00
  • b0e4771135 Merge pull request #1060 from divinerapier/master Chris Lu 2019-09-14 01:06:14 -07:00
  • bb31462b52 fix: thread unsafe divinerapier 2019-09-13 20:06:02 +08:00
  • 6fc6322c90 Change joeslay paths to chrislusf paths j.laycock 2019-09-12 14:18:21 +01:00
  • d8c34b032f Merge pull request #6 from chrislusf/master joeslay 2019-09-12 11:44:09 +01:00
  • ae53f63680 filer: recursive deletion optionally ignoring any errors Chris Lu 2019-09-11 20:26:20 -07:00
  • 5e9c65469e volume: skip readonly checking when Destroy() Chris Lu 2019-09-11 09:45:09 -07:00
  • c1a928887a Add some comments/documentation j.laycock 2019-09-11 10:41:59 +01:00
  • 9ea9a5e97a Merge pull request #5 from chrislusf/master joeslay 2019-09-11 10:25:27 +01:00
  • 15a4c91c28 Remove Finalizer j.laycock 2019-09-10 17:05:54 +01:00
  • 9c9dff7386 Virtual lock memory pages and Set Process Working set size to hint to windows harder not to write pages to disk as much, add finalize function, minor renaming j.laycock 2019-09-10 16:18:51 +01:00
  • 02710f9624 refactoring: remove unused functions Chris Lu 2019-09-09 10:03:41 -07:00
  • 0f861d23a2 avoid nil needle map Chris Lu 2019-09-09 09:48:08 -07:00
  • d757ed2fe3 Merge pull request #4 from chrislusf/master joeslay 2019-09-06 10:49:27 +01:00
  • 972b974f6c somehow auto updated go mod Chris Lu 2019-09-06 00:16:31 -07:00
  • 500e17a997 add go 1.13 Chris Lu 2019-09-06 00:16:15 -07:00
  • 803345e6af remove glide Chris Lu 2019-09-06 00:15:59 -07:00
  • 303234ebd5 change go.mod j.laycock 2019-09-05 13:48:55 +01:00
  • 63acc8c972 rename mem_buffer to mBuffer j.laycock 2019-09-05 13:46:29 +01:00
  • 44ae041e80 rename more memorymapped variables to memoryMapMaxSizeMB j.laycock 2019-09-05 13:42:23 +01:00
  • 5885ab67b3 rename volume property MemoryMap to MemoryMapMaxSizeMB j.laycock 2019-09-05 11:56:48 +01:00
  • 5a6dfb05fc Only use truncate flag when creating non memory map files, rename and use memory map size for reserving max file size j.laycock 2019-09-05 11:46:12 +01:00
  • f6146d6ad2 use 0 instead of false for max memory flag j.laycock 2019-09-05 11:43:18 +01:00
  • 4257582db5 Allocate in 16MB chunks, make creation of memory maps always aligned to 16MB chunks j.laycock 2019-09-05 11:15:01 +01:00
  • 84f2dc3b53 Remove test code j.laycock 2019-09-05 11:14:02 +01:00
  • 20d90dea5a filer: avoid hard-coded upload timeout Chris Lu 2019-09-05 01:26:59 -07:00
  • 4a878c0006 Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve Tom Maxwell 2019-09-04 15:27:14 +01:00
  • 6ee65356e3 Merge pull request #3 from chrislusf/master joeslay 2019-09-04 14:58:04 +01:00
  • cc756ddd79 Rename End_of_file variable, implement platform indepenent memory_map.go j.laycock 2019-09-04 14:24:17 +01:00
  • d9a997cb9e work with travis Chris Lu 2019-09-03 11:26:11 -07:00
  • 9aa0859697 Remove inmemory from vaccum stuff j.laycock 2019-09-03 18:20:45 +01:00
  • 6361e2b2fc fix travis Chris Lu 2019-09-03 10:20:16 -07:00
  • de5a7e60a2 remove temp hack j.laycock 2019-09-03 18:20:09 +01:00
  • cbd0a98fa1 Add InMemory to Volume Grow structure j.laycock 2019-09-03 18:19:02 +01:00
  • e33f5f5b33 travis build Chris Lu 2019-09-03 09:24:35 -07:00
  • ee8bcb0c12 remove println Chris Lu 2019-09-03 09:22:56 -07:00
  • 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct j.laycock 2019-09-03 17:00:59 +01:00
  • d637d86d22 Changes to try and pass the URL parameters through - in memory flag not working still Tom Maxwell 2019-09-03 15:41:28 +01:00
  • 9a459d984b Do not vacuum memory mapped files j.laycock 2019-09-03 15:05:43 +01:00
  • 89a0cb2e11 1.43 Chris Lu 2019-09-03 01:31:58 -07:00
  • d361ecb23b HCFS: 1.1.6 Chris Lu 2019-09-03 01:31:31 -07:00
  • fd509c3844 HCFS: working with HBase Chris Lu 2019-09-03 00:50:28 -07:00
  • 0123c7a898 Change to max 2GB for now j.laycock 2019-09-02 17:46:22 +01:00
  • e91139348e Merge pull request #2 from chrislusf/master joeslay 2019-09-02 11:39:40 +01:00
  • 595a1beff0 Swap imports to use joeslay j.laycock 2019-09-02 11:28:40 +01:00
  • 60c9215a00 HCFS: avoid verbose file not found exception stack trace Chris Lu 2019-09-01 21:40:26 -07:00
  • af8b413a9c HCFS: fix mkdirs NPE Chris Lu 2019-09-01 12:25:06 -07:00
  • cb299dfaa2 HCFS: use latest grpc versions, separate hadoop2 and hadoop3 Chris Lu 2019-09-01 03:46:51 -07:00
  • 1e62a2b233 Fix memory not being unmapped j.laycock 2019-08-30 16:55:33 +01:00
  • 5f283498c0 Merge pull request #1057 from ingardm/master Chris Lu 2019-08-30 08:52:50 -07:00
  • 840ccdc35d Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly j.laycock 2019-08-30 12:15:17 +01:00
  • dc50701e7d Overload createFile function, expose File in memory_map struct, delete from memory_map map on delete j.laycock 2019-08-28 16:59:42 +01:00
  • 523f3a12b3 use Os.File/uintptr instead of windows.Handle in memory map struct j.laycock 2019-08-28 15:40:47 +01:00
  • 0e5d3b1a70 Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files j.laycock 2019-08-28 14:48:06 +01:00
  • f7a0a0e62c new tool based on see_dat to remove duplicate fids. Duped fids could happen if a volume server was shut down before it could complete vacumming Ingard Mevåg 2019-08-30 11:26:50 +02:00
  • 170ee6ef0f tmp Chris Lu 2019-08-29 23:29:10 -07:00
  • 58168a8c52 volume: truncate dat files when creating Chris Lu 2019-08-26 13:01:38 -07:00
  • 36bde84000 Merge pull request #1 from chrislusf/master joeslay 2019-08-23 17:03:37 +01:00
  • 1e89e719b3 Add windows memory map functions to storage package j.laycock 2019-08-23 16:19:00 +01:00
  • 396c4fc143 Merge pull request #1054 from chrislusf/revert-1049-master Chris Lu 2019-08-23 08:06:19 -07:00
  • 35d471a818 Revert "use std encoding lib" Chris Lu 2019-08-23 07:59:09 -07:00
  • fa160e00f3 Merge pull request #1051 from xushuxun/master Chris Lu 2019-08-20 22:25:37 -07:00
  • 9af9f36b89 volume: read dat files' last modified time no matter dat files are catWrite or readonly xushuxun 2019-08-21 11:26:01 +08:00
  • b439055640 Merge pull request #1049 from divinerapier/master Chris Lu 2019-08-19 09:10:56 -07:00
  • e798e4e9c5 use std encoding lib divinerapier 2019-08-19 18:07:54 +08:00
  • 41caf8a777 Merge pull request #1045 from xushuxun/master Chris Lu 2019-08-15 20:47:35 -07:00
  • 5904d78bd4 weed backup: add ttl and replication parameter xushuxun 2019-08-16 11:05:22 +08:00
  • f9c1cd7370 avoid dead lock from dataFileAccessLock Chris Lu 2019-08-15 09:24:54 -07:00
  • 3cef29cbc3 Merge pull request #1041 from xushuxun/master Chris Lu 2019-08-15 00:41:38 -07:00
  • 46ae35cd7e wdclient: clear client cache when failed to connect to master leader xushuxun 2019-08-15 15:13:16 +08:00
  • 3d01510b02 Merge pull request #1 from chrislusf/master xushuxun 2019-08-15 11:20:01 +08:00