9c9dff7386
Virtual lock memory pages and Set Process Working set size to hint to windows harder not to write pages to disk as much, add finalize function, minor renaming
j.laycock
2019-09-10 16:18:51 +01:00
02710f9624
refactoring: remove unused functions
Chris Lu
2019-09-09 10:03:41 -07:00
0f861d23a2
avoid nil needle map
Chris Lu
2019-09-09 09:48:08 -07:00
5a6dfb05fc
Only use truncate flag when creating non memory map files, rename and use memory map size for reserving max file size
j.laycock
2019-09-05 11:46:12 +01:00
f6146d6ad2
use 0 instead of false for max memory flag
j.laycock
2019-09-05 11:43:18 +01:00
4257582db5
Allocate in 16MB chunks, make creation of memory maps always aligned to 16MB chunks
j.laycock
2019-09-05 11:15:01 +01:00
84f2dc3b53
Remove test code
j.laycock
2019-09-05 11:14:02 +01:00
20d90dea5a
filer: avoid hard-coded upload timeout
Chris Lu
2019-09-05 01:26:59 -07:00
4a878c0006
Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve
Tom Maxwell
2019-09-04 15:27:14 +01:00
e33f5f5b33
travis build
Chris Lu
2019-09-03 09:24:35 -07:00
ee8bcb0c12
remove println
Chris Lu
2019-09-03 09:22:56 -07:00
1f01eb78e8
Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct
j.laycock
2019-09-03 17:00:59 +01:00
d637d86d22
Changes to try and pass the URL parameters through - in memory flag not working still
Tom Maxwell
2019-09-03 15:41:28 +01:00
9a459d984b
Do not vacuum memory mapped files
j.laycock
2019-09-03 15:05:43 +01:00
89a0cb2e11
1.43
Chris Lu
2019-09-03 01:31:58 -07:00
d361ecb23b
HCFS: 1.1.6
Chris Lu
2019-09-03 01:31:31 -07:00
fd509c3844
HCFS: working with HBase
Chris Lu
2019-09-03 00:50:28 -07:00
0123c7a898
Change to max 2GB for now
j.laycock
2019-09-02 17:46:22 +01:00
595a1beff0
Swap imports to use joeslay
j.laycock
2019-09-02 11:28:40 +01:00
60c9215a00
HCFS: avoid verbose file not found exception stack trace
Chris Lu
2019-09-01 21:40:26 -07:00
af8b413a9c
HCFS: fix mkdirs NPE
Chris Lu
2019-09-01 12:25:06 -07:00
cb299dfaa2
HCFS: use latest grpc versions, separate hadoop2 and hadoop3
Chris Lu
2019-09-01 03:46:51 -07:00
1e62a2b233
Fix memory not being unmapped
j.laycock
2019-08-30 16:55:33 +01:00
5f283498c0
Merge pull request #1057 from ingardm/master
Chris Lu
2019-08-30 08:52:50 -07:00
840ccdc35d
Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly
j.laycock
2019-08-30 12:15:17 +01:00
dc50701e7d
Overload createFile function, expose File in memory_map struct, delete from memory_map map on delete
j.laycock
2019-08-28 16:59:42 +01:00
523f3a12b3
use Os.File/uintptr instead of windows.Handle in memory map struct
j.laycock
2019-08-28 15:40:47 +01:00
0e5d3b1a70
Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files
j.laycock
2019-08-28 14:48:06 +01:00
f7a0a0e62c
new tool based on see_dat to remove duplicate fids. Duped fids could happen if a volume server was shut down before it could complete vacumming
Ingard Mevåg
2019-08-30 11:26:50 +02:00
170ee6ef0f
tmp
Chris Lu
2019-08-29 23:29:10 -07:00
58168a8c52
volume: truncate dat files when creating
Chris Lu
2019-08-26 13:01:38 -07:00