John Spray 8bdaee35f3 pageserver: safety checks on validity of uploaded indices (#10403) ...

## Problem

Occasionally, we encounter bugs in test environments that can be
detected at the point of uploading an index, but we proceed to upload it
anyway and leave a tenant in a broken state that's awkward to handle.

## Summary of changes

- Validate index when submitting it for upload, so that we can see the
issue quickly e.g. in an API invoking compaction
- Validate index before executing the upload, so that we have a hard
enforcement that any code path that tries to upload an index will not
overwrite a valid index with an invalid one.

2025-01-20 09:20:31 +00:00

..

bin

fix(page_service pipelining): tenant cannot shut down because gate kept open while flushing responses (#10386)

2025-01-16 20:34:02 +00:00

consumption_metrics

Display reqwest error source (#10004)

2024-12-04 13:05:53 +00:00

deletion_queue

Replace MAX_KEYS_PER_DELETE constant with function (#10061)

2024-12-10 11:29:38 +00:00

http

pageserver: add page_trace API for debugging (#10293)

2025-01-15 19:07:22 +00:00

tenant

pageserver: safety checks on validity of uploaded indices (#10403)

2025-01-20 09:20:31 +00:00

virtual_file

pageserver: fix buffered-writer on macos build (#10019)

2024-12-05 02:16:09 +00:00

walredo

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

assert_u64_eq_usize.rs

bypass PageCache for InMemoryLayer + avoid Value::deser on L0 flush (#8537)

2024-08-28 18:31:41 +00:00

auth.rs

storcon: add peer token for peer to peer communication (#9695)

2024-11-11 09:58:41 +00:00

aux_file.rs

feat(pageserver): compute aux file size on initial logical size calculation (#7958)

2024-06-04 13:47:48 -04:00

basebackup.rs

chore: fix clippy lints 2024-12-06 (#10138)

2024-12-16 15:33:21 +00:00

config.rs

page_service: rewrite batching to work without a timeout (#9851)

2024-11-30 00:16:24 +00:00

consumption_metrics.rs

refactor(pageserver): use JSON field encoding for consumption metrics cache (#9470)

2024-10-30 18:13:11 +00:00

context.rs

page_service: batching observability & include throttled time in smgr metrics (#9870)

2024-12-03 11:03:23 +00:00

controller_upcall_client.rs

pageserver: more detailed logs when calling re-attach (#9996)

2024-12-03 18:36:37 +00:00

deletion_queue.rs

pageserver: download small objects using a smaller timeout (#9938)

2024-11-29 15:11:44 +00:00

disk_usage_eviction_task.rs

2024 oct new clippy lints (#9448)

2024-10-18 10:27:50 +01:00

import_datadir.rs

safekeeper: decode and interpret for multiple shards in one go (#10201)

2025-01-15 11:10:24 +00:00

l0_flush.rs

refactor(pageserver): rely on serde derive for toml deserialization (#7656)

2024-09-05 14:59:49 +02:00

lib.rs

page_service: rewrite batching to work without a timeout (#9851)

2024-11-30 00:16:24 +00:00

metrics.rs

pageserver: add initdb metrics (#10434)

2025-01-17 14:51:33 +00:00

page_cache.rs

pageserver: use direct IO for delta and image layer reads (#9326)

2024-10-21 11:01:25 -04:00

page_service.rs

fix(page_service pipelining): tenant cannot shut down because gate kept open while flushing responses (#10386)

2025-01-16 20:34:02 +00:00

pgdatadir_mapping.rs

fix(pageserver): report timestamp is in the past if the key is missing (#10210)

2025-01-09 14:43:20 +00:00

span.rs

debug_assert presence of shard_id tracing field (#6572)

2024-02-06 14:43:33 +00:00

statvfs.rs

2024 oct new clippy lints (#9448)

2024-10-18 10:27:50 +01:00

task_mgr.rs

fast imports: initial Importer and Storage changes (#9218)

2024-11-22 22:47:06 +00:00

tenant.rs

pageserver: add initdb metrics (#10434)

2025-01-17 14:51:33 +00:00

utilization.rs

controller: use PageserverUtilization for scheduling (#8711)

2024-08-23 18:32:56 +01:00

virtual_file.rs

pageserver: make BufferedWriter do double-buffering (#9693)

2024-12-04 16:54:56 +00:00

walingest.rs

safekeeper: decode and interpret for multiple shards in one go (#10201)

2025-01-15 11:10:24 +00:00

walredo.rs

pageserver: move things around to prepare for decoding logic (#9504)

2024-10-29 10:00:34 +00:00