Vlad Lazar 25c4b676e0 pageserver: fix oversized key on vectored read (#7259) ...

## Problem
During this week's deployment we observed panics due to the blobs
for certain keys not fitting in the vectored read buffers. The likely
cause of this is a bloated AUX_FILE_KEY caused by logical replication.

## Summary of changes
This pr fixes the issue by allocating a buffer big enough to fit
the widest read. It also has the benefit of saving space if all keys
in the read have blobs smaller than the max vectored read size.

If the soft limit for the max size of a vectored read is violated,
we print a warning which includes the offending key and lsn.

A randomised (but deterministic) end to end test is also added for
vectored reads on the delta layer.

2024-03-28 14:27:15 +00:00

..

benches

walredo benchmark: throughput-oriented rewrite (#7190)

2024-03-21 15:24:56 +01:00

client

pageserver, controller: improve secondary download APIs for large shards (#7131)

2024-03-15 19:45:58 +00:00

compaction

Support compaction_threshold=1 for tiered compaction (#7257)

2024-03-28 13:48:47 +01:00

ctl

pageserver: optimise disk io for vectored get (#6780)

2024-02-28 12:06:00 +00:00

pagebench

tokio-epoll-uring: use it for on-demand downloads (#6992)

2024-03-15 18:57:05 +00:00

src

pageserver: fix oversized key on vectored read (#7259)

2024-03-28 14:27:15 +00:00

test_data

Add walingest test (#5892)

2023-11-28 12:50:53 -05:00

Cargo.toml

pageserver: limit total ephemeral layer bytes (#7218)

2024-03-26 15:45:32 +00:00