John Spray 306c4f9967 s3_scrubber: prepare for scrubbing buckets with generation-aware content (#5700) ...

## Problem

The scrubber didn't know how to find the latest index_part when
generations were in use.

## Summary of changes

- Teach the scrubber to do the same dance that pageserver does when
finding the latest index_part.json
- Teach the scrubber how to understand layer files with generation
suffixes.
- General improvement to testability: scan_metadata has a machine
readable output that the testing `S3Scrubber` wrapper can read.
- Existing test coverage of scrubber was false-passing because it just
didn't see any data due to prefixing of data in the bucket. Fix that.

This is incremental improvement: the more confidence we can have in the
scrubber, the more we can use it in integration tests to validate the
state of remote storage.

---------

Co-authored-by: Arpad Müller <arpad-m@users.noreply.github.com>

2023-11-03 17:36:02 +00:00

..

benches

Rename more zid-like idents (#2480)

2022-09-20 11:06:31 -07:00

scripts

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

src

s3_scrubber: prepare for scrubbing buckets with generation-aware content (#5700)

2023-11-03 17:36:02 +00:00

tests

Remove sync postgres_backend, tidy up its split usage.

2023-03-09 20:45:56 +03:00

Cargo.toml

fix: replace all std::PathBufs with camino::Utf8PathBuf (#5352)

2023-10-04 17:52:23 +03:00