Alex Chi Z. 67ddf1de28 feat(pageserver): create image layers at L0-L1 boundary (#12023) ...

## Problem

Previous attempt https://github.com/neondatabase/neon/pull/10548 caused
some issues in staging and we reverted it. This is a re-attempt to
address https://github.com/neondatabase/neon/issues/11063.

Currently we create image layers at latest record LSN. We would create
"future image layers" (i.e., image layers with LSN larger than disk
consistent LSN) that need special handling at startup. We also waste a
lot of read operations to reconstruct from L0 layers while we could have
compacted all of the L0 layers and operate on a flat level of historic
layers.

## Summary of changes

* Run repartition at L0-L1 boundary.
* Roll out with feature flags.
* Piggyback a change that downgrades "image layer creating below
gc_cutoff" to debug level.

---------

Signed-off-by: Alex Chi Z <chi@neon.tech>

2025-05-28 07:00:52 +00:00

..

benches

feat(direct IO): runtime alignment validation; support config flag on macOS; default to DirectRw (#11868)

2025-05-10 14:19:52 +00:00

client

pageserver: make imports work with tenant shut downs (#11855)

2025-05-13 17:49:49 +00:00

compaction

utils: explicit OTEL export config and OTEL enablement via common entry point (#11139)

2025-03-12 11:07:49 +00:00

ctl

pagectl: list layers for given key in decreasing LSN order (#11799)

2025-05-01 15:56:43 +00:00

page_api

page_api: tweak errors (#12019)

2025-05-27 12:06:51 +00:00

pagebench

benchmarking: extend test_page_service_batching.py to cover concurrent IO + batching under random reads (#10466)

2025-05-15 17:48:13 +00:00

src

feat(pageserver): create image layers at L0-L1 boundary (#12023)

2025-05-28 07:00:52 +00:00

test_data

pageserver: add layer visibility calculation (#8511)

2024-08-01 09:25:35 +00:00

Cargo.toml

feat(pageserver): integrate PostHog with gc-compaction rollout (#11917)

2025-05-26 13:09:37 +00:00