f258f50b76
pagectl: separate xy margin for draw timeline
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-07-07 12:14:08 -04:00
f31cc2394b
compaction PoC: subcompaction ( #4656 )
...
This PR adds subcompaction support for compaction PoC. For compaction
job >= 4GB, it will be split into 4 threads.
---------
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-07-07 12:13:44 -04:00
7e7cdaa3eb
handle name conflict
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-07-05 16:26:02 -04:00
a079d250d9
compaction PoC: trivial move compaction ( #4604 )
...
reduce write amp. for bulk load, might also be useful for main branch
---------
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-07-05 15:27:25 -04:00
756319b0ce
do not excldue last tier
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-07-03 14:02:53 -04:00
8816fc98fc
fix compaction algorithm
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 18:11:51 -04:00
c3bcaa0551
rm println
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 15:02:30 -04:00
8aede79abf
fix
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 14:57:42 -04:00
d28e309c06
fix
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 14:48:54 -04:00
647b7a70a8
fix
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 14:31:00 -04:00
e7955895d1
fix
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 14:18:46 -04:00
dc9c842d21
true incremental
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 14:05:28 -04:00
05719cb9cd
debug
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 12:42:15 -04:00
0051a6c931
debug
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 12:27:36 -04:00
c9c40171cd
fix layer map
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 11:29:41 -04:00
376762e07e
fewer logs
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 09:16:46 -04:00
d4e262f646
delta with correct range
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-29 09:11:15 -04:00
d279b4421e
increase threshold
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-28 15:39:52 -04:00
b1f0bbd12a
add reduce num sorted run trigger
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-28 15:38:14 -04:00
7d16a9f96f
fix again
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-28 15:07:31 -04:00
878627161c
revert not
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-28 14:58:42 -04:00
4db4f42dec
correctly handle compaction
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-28 14:41:26 -04:00
6cb149e3c3
enable tiered again
...
Signed-off-by: Alex Chi Z <chi@neon.tech >
2023-06-28 14:30:17 -04:00
f3fdaf8ef1
parallel compaction
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-27 16:42:56 -04:00
eb93e686ab
fix deletion
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-27 14:47:04 -04:00
2cb79ae3ff
fix deletion
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-27 14:43:20 -04:00
dfe8527806
remove assertion
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-27 13:52:12 -04:00
335710cec6
bring back original compaction
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-27 13:38:02 -04:00
a78008ad82
max_merge_width
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-27 13:30:23 -04:00
30e7ffcd28
adjust compaction strategy
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-26 15:52:37 -04:00
43d564ce0a
incremental image layer
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-26 15:25:35 -04:00
f86ff5e54b
dump more
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-26 14:57:00 -04:00
9ed6ad1d24
fix weak ptr
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-26 14:33:00 -04:00
91f28cb516
include delta l0 in compaction, more metrics
...
Signed-off-by: Alex Chi <chi@neon.tech >
2023-06-26 13:56:29 -04:00
0b459eb414
fix ratio compute
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 15:11:15 -04:00
0865ed623c
fix comment
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 15:01:25 -04:00
9e0f103c7b
insert at 0
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 15:00:58 -04:00
9f216a78a1
print
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 15:00:10 -04:00
6967b4837b
fix
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 14:53:53 -04:00
9b50350857
threshold = 3
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 14:37:29 -04:00
8ebfa32a0c
compaction l0 adds to sorted runs
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 14:24:57 -04:00
9905d75715
dump file size
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 14:18:54 -04:00
b0b616f3ac
dump
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 14:12:33 -04:00
867b656ef2
bypass ut
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-22 11:28:34 -04:00
76b339b150
create partial image layers
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-21 14:38:11 -04:00
9b3fa1a2e1
fix compile error
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-21 14:16:44 -04:00
17781776c8
add two compaction triggers
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-21 10:27:24 -04:00
5274f487e4
add tiered compaction skeleton
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-20 14:43:07 -04:00
9b7747436c
incremental image?
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-20 11:05:16 -04:00
a2056666ae
pgserver: move mapping logic to layer cache
...
Signed-off-by: Alex Chi <iskyzh@gmail.com >
2023-06-14 15:07:38 -04:00
Alex Chi Z
Alex Chi Z