Alex Chi Z. 5a138d08a3 feat(pageserver): support partial gc-compaction for delta layers (#9611) ...

The final patch for partial compaction, part of
https://github.com/neondatabase/neon/issues/9114, close
https://github.com/neondatabase/neon/issues/8921 (note that we didn't
implement parallel compaction or compaction scheduler for partial
compaction -- currently this needs to be scheduled by using a Python
script to split the keyspace, and in the future, automatically split
based on the key partitioning when the pageserver wants to trigger a
gc-compaction)

## Summary of changes

* Update the layer selection algorithm to use the same selection as full
compaction (everything intersect/below gc horizon)
* Update the layer selection algorithm to also generate a list of delta
layers that need to be rewritten
* Add the logic to rewrite delta layers and add them back to the layer
map
* Update test case to do partial compaction on deltas

---------

Signed-off-by: Alex Chi Z <chi@neon.tech>

2024-11-11 20:30:32 +00:00

..

src

feat(pageserver): support partial gc-compaction for delta layers (#9611)

2024-11-11 20:30:32 +00:00

tests

Tiered compaction: cut deltas along lsn as well if needed (#7671)

2024-05-14 01:13:25 +02:00

Cargo.toml

Re-export git-version from utils and remove as direct dep (#9138)

2024-09-25 14:38:35 +02:00

TODO.md

Add new compaction abstraction, simulator, and implementation. (#6830)

2024-02-27 17:15:46 +01:00