Alex Chi Z. 92d95b08cf fix(pageserver): extend split job key range to the end (#10484) ...

## Problem

Not really a bug fix, but hopefully can reproduce
https://github.com/neondatabase/neon/issues/10482 more.

If the layer map does not contain layers that end at exactly the end
range of the compaction job, the current split algorithm will produce
the last job that ends at the maximum layer key. This patch extends it
all the way to the compaction job end key.

For example, the user requests a compaction of 0000...FFFF. However, we
only have a layer 0000..3000 in the layer map, and the split job will
have a range of 0000..3000 instead of 0000..FFFF.

This is not a correctness issue but it would be better to fix it so that
we can get consistent job splits.

## Summary of changes

Compaction job split will always cover the full specified key range.

Signed-off-by: Alex Chi Z <chi@neon.tech>

2025-01-23 00:15:46 +00:00

..

bin

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

consumption_metrics

Display reqwest error source (#10004)

2024-12-04 13:05:53 +00:00

deletion_queue

Replace MAX_KEYS_PER_DELETE constant with function (#10061)

2024-12-10 11:29:38 +00:00

http

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

tenant

fix(pageserver): extend split job key range to the end (#10484)

2025-01-23 00:15:46 +00:00

virtual_file

pageserver: fix buffered-writer on macos build (#10019)

2024-12-05 02:16:09 +00:00

walredo

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

assert_u64_eq_usize.rs

bypass PageCache for InMemoryLayer + avoid Value::deser on L0 flush (#8537)

2024-08-28 18:31:41 +00:00

auth.rs

storcon: add peer token for peer to peer communication (#9695)

2024-11-11 09:58:41 +00:00

aux_file.rs

feat(pageserver): compute aux file size on initial logical size calculation (#7958)

2024-06-04 13:47:48 -04:00

basebackup.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

config.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

consumption_metrics.rs

refactor(pageserver): use JSON field encoding for consumption metrics cache (#9470)

2024-10-30 18:13:11 +00:00

context.rs

page_service: batching observability & include throttled time in smgr metrics (#9870)

2024-12-03 11:03:23 +00:00

controller_upcall_client.rs

pageserver: more detailed logs when calling re-attach (#9996)

2024-12-03 18:36:37 +00:00

deletion_queue.rs

pageserver: download small objects using a smaller timeout (#9938)

2024-11-29 15:11:44 +00:00

disk_usage_eviction_task.rs

2024 oct new clippy lints (#9448)

2024-10-18 10:27:50 +01:00

import_datadir.rs

safekeeper: decode and interpret for multiple shards in one go (#10201)

2025-01-15 11:10:24 +00:00

l0_flush.rs

refactor(pageserver): rely on serde derive for toml deserialization (#7656)

2024-09-05 14:59:49 +02:00

lib.rs

page_service: rewrite batching to work without a timeout (#9851)

2024-11-30 00:16:24 +00:00

metrics.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

page_cache.rs

pageserver: use direct IO for delta and image layer reads (#9326)

2024-10-21 11:01:25 -04:00

page_service.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

pgdatadir_mapping.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

span.rs

debug_assert presence of shard_id tracing field (#6572)

2024-02-06 14:43:33 +00:00

statvfs.rs

2024 oct new clippy lints (#9448)

2024-10-18 10:27:50 +01:00

task_mgr.rs

fast imports: initial Importer and Storage changes (#9218)

2024-11-22 22:47:06 +00:00

tenant.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

utilization.rs

controller: use PageserverUtilization for scheduling (#8711)

2024-08-23 18:32:56 +01:00

virtual_file.rs

pageserver: make BufferedWriter do double-buffering (#9693)

2024-12-04 16:54:56 +00:00

walingest.rs

pageserver: issue concurrent IO on the read path (#9353)

2025-01-22 15:30:23 +00:00

walredo.rs

pageserver: move things around to prepare for decoding logic (#9504)

2024-10-29 10:00:34 +00:00