John Spray 2226acef7c s3_scrubber: add tenant-snapshot (#7444) ...

## Problem

Downloading tenant data for analysis/debug with `aws s3 cp` works well
for small tenants, but for larger tenants it is unlikely that one ends
up with an index that matches layer files, due to the time taken to
download.

## Summary of changes

- Add a `tenant-snapshot` command to the scrubber, which reads timeline
indices and then downloads the layers referenced in the index, even if
they were deleted. The result is a snapshot of the tenant's remote
storage state that should be usable when imported (#7399 ).

2024-04-29 12:16:00 +00:00

..

pageserver

storage controller: fix repeated location_conf returning no shards (#7314)

2024-04-04 17:34:05 +00:00

safekeeper

Keep walproposer alive until shutdown checkpoint is safe on safekepeers

2024-03-11 23:29:32 +04:00

__init__.py

add pytest integration tests

2021-05-03 11:31:32 -07:00

benchmark_fixture.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

broker.py

refactor(NeonEnv): shutdown of child processes (#6327)

2024-01-12 10:23:21 +01:00

compare_fixtures.py

fixup(#6893): report_size() still used pageserver_created_persistent_* metrics (#6909)

2024-02-26 17:28:00 +01:00

compute_reconfigure.py

pageserver/controller: error handling for shard splitting (#7074)

2024-03-14 09:11:57 +00:00

flaky.py

test_runner: workaround rerunfailures and timeout incompatibility (#4469)

2023-06-16 18:08:11 +01:00

httpserver.py

refactor: globals in tests (#5298)

2023-09-13 22:05:30 +03:00

log_helper.py

test_runner: pass password to pgbench via PGPASSWORD (#2468)

2022-09-23 12:51:33 +00:00

metrics.py

pageserver: add read depth metrics and test (#7464)

2024-04-23 14:05:02 +01:00

neon_fixtures.py

s3_scrubber: add tenant-snapshot (#7444)

2024-04-29 12:16:00 +00:00

overlayfs.py

python tests: support overlayfs for NeonEnvBuilder.from_repo_dir (#6295)

2024-01-09 10:15:46 +00:00

parametrize.py

fix(test suite) virtual_file_io_engine and get_vectored_impl patametrization doesn't work (#7113)

2024-03-14 11:18:55 +00:00

pg_stats.py

Stricter mypy linters for test_runner/fixtures/*

2022-11-10 12:47:27 +01:00

pg_version.py

tests: support for running on single pg version, use in one place (#6525)

2024-01-31 17:37:25 +02:00

port_distributor.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

remote_storage.py

s3_scrubber: add tenant-snapshot (#7444)

2024-04-29 12:16:00 +00:00

slow.py

Stricter mypy linters for test_runner/fixtures/*

2022-11-10 12:47:27 +01:00

types.py

s3_scrubber: add tenant-snapshot (#7444)

2024-04-29 12:16:00 +00:00

utils.py

tests: log hygiene checks for storage controller (#6710)

2024-03-19 10:30:33 +00:00

workload.py

fixup: PR #7319 defined workload.py def stop() twice (#7333)

2024-04-05 19:11:04 +00:00