John Spray 4049d2b7e1 scrubber: fix spurious "Missed some shards" errors (#8661) ...

## Problem

The storage scrubber was reporting warnings for lots of timelines like:
```
WARN Missed some shards at count ShardCount(0) tenant_id=25eb7a83d9a2f90ac0b765b6ca84cf4c
```

These were spurious: these tenants are fine. There was a bug in
accumulating the ShardIndex for each tenant, whereby multiple timelines
would lead us to add the same ShardIndex more than one.

Closes: #8646 

## Summary of changes

- Accumulate ShardIndex in a BTreeSet instead of a Vec
- Extend the test to reproduce the issue

2024-08-14 09:29:06 +01:00

..

bin

pageserver: remove vectored get related configs (#8695)

2024-08-13 12:45:54 +01:00

consumption_metrics

pageserver: improve readability of shard.rs (#7330)

2024-04-15 11:50:26 +01:00

context

feat(per-tenant throttling): exclude throttled time from page_service metrics + regression test (#6953)

2024-03-05 13:44:00 +00:00

deletion_queue

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

http

scrubber: fix spurious "Missed some shards" errors (#8661)

2024-08-14 09:29:06 +01:00

tenant

feat(detach_ancestor): better retries with persistent gc blocking (#8430)

2024-08-13 18:51:51 +01:00

virtual_file

pageserver: make bench_ingest build (but panic) on macOS (#8641)

2024-08-07 21:17:08 +01:00

walredo

test(pageserver): add test wal record for unit testing (#8015)

2024-06-13 09:44:37 -04:00

auth.rs

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

aux_file.rs

feat(pageserver): compute aux file size on initial logical size calculation (#7958)

2024-06-04 13:47:48 -04:00

basebackup.rs

fix(pageserver): include aux file in basebackup only once (#8207)

2024-07-01 14:36:49 +00:00

config.rs

pageserver: remove vectored get related configs (#8695)

2024-08-13 12:45:54 +01:00

consumption_metrics.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

context.rs

Fix nightly warnings 2024 june (#8151)

2024-07-12 13:58:04 +01:00

control_plane_client.rs

storcon: make heartbeats restart aware (#8222)

2024-07-25 14:09:12 +01:00

deletion_queue.rs

Use DefaultCredentialsChain AWS authentication in remote_storage (#8440)

2024-07-19 21:19:30 +02:00

disk_usage_eviction_task.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

import_datadir.rs

pageserver: apply shard filtering to blocks ingested during initdb (#7319)

2024-04-05 18:07:35 +01:00

l0_flush.rs

pageserver: add bench_ingest (#7409)

2024-08-06 16:39:40 +00:00

lib.rs

pageserver: shutdown all walredo managers 8s into shutdown (#8572)

2024-08-01 07:57:09 +02:00

metrics.rs

pageserver: add layer visibility calculation (#8511)

2024-08-01 09:25:35 +00:00

page_cache.rs

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

page_service.rs

fix: drain completed page_service connections (#8632)

2024-08-07 17:14:45 +00:00

pgdatadir_mapping.rs

Use smgrexists() instead of access() to enforce uniqueness of generated relfilenumber (#7992)

2024-07-23 18:41:55 +03:00

repository.rs

compaction_level0_phase1: bypass PS PageCache for data blocks (#8543)

2024-07-31 14:17:59 +02:00

span.rs

debug_assert presence of shard_id tracing field (#6572)

2024-02-06 14:43:33 +00:00

statvfs.rs

fix(test): do not fail test for filesystem race (#8643)

2024-08-08 10:34:47 +01:00

task_mgr.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

tenant.rs

feat(detach_ancestor): better retries with persistent gc blocking (#8430)

2024-08-13 18:51:51 +01:00

utilization.rs

pageserver: implement utilization score (#8703)

2024-08-13 15:15:55 +01:00

virtual_file.rs

pageserver: make bench_ingest build (but panic) on macOS (#8641)

2024-08-07 21:17:08 +01:00

walingest.rs

Update Rust to 1.80.0 (#8518)

2024-07-26 11:17:33 +02:00

walrecord.rs

test(pageserver): add test wal record for unit testing (#8015)

2024-06-13 09:44:37 -04:00

walredo.rs

fix(walredo): shutdown can complete too early (#8701)

2024-08-12 18:15:48 +01:00