John Spray 840abe3954 pageserver: store aux files as deltas (#6742) ...

## Problem

Aux files were stored with an O(N^2) cost, since on each modification
the entire map is re-written as a page image.

This addresses one axis of the inefficiency in logical replication's use
of storage (https://github.com/neondatabase/neon/issues/6626). It will
still be writing a large amount of duplicative data if writing the same
slot's state every 15 seconds, but the impact will be O(N) instead of
O(N^2).

## Summary of changes

- Introduce `NeonWalRecord::AuxFile`
- In `DatadirModification`, if the AUX_FILES_KEY has already been set,
then write a delta instead of an image

2024-02-14 15:01:16 +00:00

..

benches

pageserver: make walredo shard-aware

2024-01-03 14:22:40 +00:00

client

storage controller: improved handling of node availability on restart (#6658)

2024-02-08 18:00:53 +00:00

ctl

live-reconfigurable virtual_file::IoEngine (#6552)

2024-02-07 17:47:55 +00:00

pagebench

live-reconfigurable virtual_file::IoEngine (#6552)

2024-02-07 17:47:55 +00:00

src

pageserver: store aux files as deltas (#6742)

2024-02-14 15:01:16 +00:00

test_data

Add walingest test (#5892)

2023-11-28 12:50:53 -05:00

Cargo.toml

feat(walredo): use posix_spawn by moving close_fds() work to walredo C code (#6574)

2024-02-01 22:38:34 +01:00