Arpad Müller d5d15eb6eb Warn if a blob in an image is larger than 256 MiB (#7852) ...

We'd like to get some bits reserved in the length field of image layers
for future usage (compression). This PR bases on the assumption that we
don't have any blobs that require more than 28 bits (3 bytes + 4 bits)
to store the length, but as a preparation, before erroring, we want to
first emit warnings as if the assumption is wrong, such warnings are less
disruptive than errors.

A metric would be even less disruptive (log messages are more slow, if
we have a LOT of such large blobs then it would take a lot of time to
print them). At the same time, likely such 256 MiB blobs will occupy an
entire layer file, as they are larger than our target size. For layer
files we already log something, so there shouldn't be a large increase
in overhead.

Part of #5431

2024-05-23 14:28:05 +02:00

..

benches

chore!: always use async walredo, warn if sync is configured (#7754)

2024-05-15 15:04:52 +02:00

client

feat(pagebench): add aux file bench (#7746)

2024-05-17 20:04:02 +00:00

compaction

Tiered compaction: improvements to the windows (#7787)

2024-05-16 22:25:19 +02:00

ctl

feat(pageserver): persist aux file policy in index part (#7668)

2024-05-17 19:22:49 +00:00

pagebench

feat(pagebench): add aux file bench (#7746)

2024-05-17 20:04:02 +00:00

src

Warn if a blob in an image is larger than 256 MiB (#7852)

2024-05-23 14:28:05 +02:00

test_data

Add walingest test (#5892)

2023-11-28 12:50:53 -05:00

Cargo.toml

feat(pageserver): add metadata key range and aux key encoding (#7401)

2024-04-23 15:16:04 +00:00