Arpad Müller 718645e56c Support tenant manifests in the scrubber (#9942) ...

Support tenant manifests in the storage scrubber:

* list the manifests, order them by generation
* delete all manifests except for the two most recent generations
* for the latest manifest: try parsing it.

I've tested this patch by running the against a staging bucket and it
successfully deleted stuff (and avoided deleting the latest two
generations).

In follow-up work, we might want to also check some invariants of the
manifest, as mentioned in #8088.

Part of #9386
Part of #8088

---------

Co-authored-by: Christian Schwarz <christian@neon.tech>

2024-12-05 13:00:40 +02:00

..

bin

pageserver: respond to multiple shutdown signals (#9982)

2024-12-05 13:00:40 +02:00

consumption_metrics

refactor(pageserver): use JSON field encoding for consumption metrics cache (#9470)

2024-10-30 18:13:11 +00:00

deletion_queue

fix(pageserver): ensure upload happens after delete (#9844)

2024-11-22 18:30:53 +00:00

http

safekeeper,pageserver: add heap profiling (#9778)

2024-12-05 13:00:40 +02:00

tenant

Support tenant manifests in the scrubber (#9942)

2024-12-05 13:00:40 +02:00

virtual_file

Address beta clippy lint needless_lifetimes (#9877)

2024-11-25 14:59:12 +00:00

walredo

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

assert_u64_eq_usize.rs

bypass PageCache for InMemoryLayer + avoid Value::deser on L0 flush (#8537)

2024-08-28 18:31:41 +00:00

auth.rs

storcon: add peer token for peer to peer communication (#9695)

2024-11-11 09:58:41 +00:00

aux_file.rs

feat(pageserver): compute aux file size on initial logical size calculation (#7958)

2024-06-04 13:47:48 -04:00

basebackup.rs

Add --replica parameter to basebackup (#9553)

2024-10-29 18:40:10 +02:00

config.rs

page_service: rewrite batching to work without a timeout (#9851)

2024-12-05 13:00:40 +02:00

consumption_metrics.rs

refactor(pageserver): use JSON field encoding for consumption metrics cache (#9470)

2024-10-30 18:13:11 +00:00

context.rs

page_service: batching observability & include throttled time in smgr metrics (#9870)

2024-12-05 13:00:40 +02:00

controller_upcall_client.rs

pageserver: more detailed logs when calling re-attach (#9996)

2024-12-05 13:00:40 +02:00

deletion_queue.rs

pageserver: download small objects using a smaller timeout (#9938)

2024-12-05 13:00:40 +02:00

disk_usage_eviction_task.rs

2024 oct new clippy lints (#9448)

2024-10-18 10:27:50 +01:00

import_datadir.rs

pageserver: only store SLRUs & aux files on shard zero (#9786)

2024-12-05 13:00:40 +02:00

l0_flush.rs

refactor(pageserver): rely on serde derive for toml deserialization (#7656)

2024-09-05 14:59:49 +02:00

lib.rs

page_service: rewrite batching to work without a timeout (#9851)

2024-12-05 13:00:40 +02:00

metrics.rs

pageserver: only throttle pagestream requests & bring back throttling deduction for smgr latency metrics (#9962)

2024-12-05 13:00:40 +02:00

page_cache.rs

pageserver: use direct IO for delta and image layer reads (#9326)

2024-10-21 11:01:25 -04:00

page_service.rs

pageserver: only throttle pagestream requests & bring back throttling deduction for smgr latency metrics (#9962)

2024-12-05 13:00:40 +02:00

pgdatadir_mapping.rs

pageserver: only store SLRUs & aux files on shard zero (#9786)

2024-12-05 13:00:40 +02:00

span.rs

debug_assert presence of shard_id tracing field (#6572)

2024-02-06 14:43:33 +00:00

statvfs.rs

2024 oct new clippy lints (#9448)

2024-10-18 10:27:50 +01:00

task_mgr.rs

fast imports: initial Importer and Storage changes (#9218)

2024-11-22 22:47:06 +00:00

tenant.rs

pageserver: only throttle pagestream requests & bring back throttling deduction for smgr latency metrics (#9962)

2024-12-05 13:00:40 +02:00

utilization.rs

controller: use PageserverUtilization for scheduling (#8711)

2024-08-23 18:32:56 +01:00

virtual_file.rs

pageserver: respect no_sync in VirtualFile (#9772)

2024-11-18 08:59:05 +00:00

walingest.rs

pageserver: only store SLRUs & aux files on shard zero (#9786)

2024-12-05 13:00:40 +02:00

walredo.rs

pageserver: move things around to prepare for decoding logic (#9504)

2024-10-29 10:00:34 +00:00