Arseny Sher 478cc37a70 Propagate standby apply LSN to pageserver to hold off GC. ...

To avoid pageserver gc'ing data needed by standby, propagate standby apply LSN
through standby -> safekeeper -> broker -> pageserver flow and hold off GC for
it. Iteration of GC resets the value to remove the horizon when standby goes
away -- pushes are assumed to happen at least once between gc iterations. As a
safety guard max allowed lag compared to normal GC horizon is hardcoded as 10GB.
Add test for the feature.

Co-authored-by: Konstantin Knizhnik <knizhnik@neon.tech>

2024-05-21 16:21:29 +03:00

..

bin

pageserver: refine tenant_id->shard lookup (#7762)

2024-05-16 08:26:34 +00:00

consumption_metrics

pageserver: improve readability of shard.rs (#7330)

2024-04-15 11:50:26 +01:00

context

feat(per-tenant throttling): exclude throttled time from page_service metrics + regression test (#6953)

2024-03-05 13:44:00 +00:00

deletion_queue

pageserver: local layer path followups (#7640)

2024-05-08 16:50:21 +00:00

http

feat(pagebench): add aux file bench (#7746)

2024-05-17 20:04:02 +00:00

tenant

Propagate standby apply LSN to pageserver to hold off GC.

2024-05-21 16:21:29 +03:00

virtual_file

Update rust to 1.78.0 (#7598)

2024-05-03 15:59:28 +02:00

walredo

chore!: always use async walredo, warn if sync is configured (#7754)

2024-05-15 15:04:52 +02:00

auth.rs

attachment_service: JWT auth enforcement (#6897)

2024-02-26 18:17:06 +00:00

aux_file.rs

feat(pageserver): use fnv hash for aux file encoding (#7742)

2024-05-15 13:17:57 -04:00

basebackup.rs

feat: allow detaching from ancestor for timelines without writes (#7639)

2024-05-10 22:30:05 +03:00

config.rs

chore!: always use async walredo, warn if sync is configured (#7754)

2024-05-15 15:04:52 +02:00

consumption_metrics.rs

pageserver: improve readability of shard.rs (#7330)

2024-04-15 11:50:26 +01:00

context.rs

feat(per-tenant throttling): exclude throttled time from page_service metrics + regression test (#6953)

2024-03-05 13:44:00 +00:00

control_plane_client.rs

refactor: move NodeMetadata to pageserver_api; use it from neon_local (#7606)

2024-05-03 13:15:38 -04:00

deletion_queue.rs

pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752)

2024-05-15 12:05:24 +00:00

disk_usage_eviction_task.rs

pageserver: fixes for layer path changes (#7786)

2024-05-17 13:24:03 +01:00

import_datadir.rs

pageserver: apply shard filtering to blocks ingested during initdb (#7319)

2024-04-05 18:07:35 +01:00

lib.rs

pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752)

2024-05-15 12:05:24 +00:00

metrics.rs

pageserver: implement auto-splitting (#7681)

2024-05-17 16:01:24 +00:00

page_cache.rs

Fix warnings and compile errors on nightly (#6886)

2024-03-01 17:14:19 +01:00

page_service.rs

pageserver: refine tenant_id->shard lookup (#7762)

2024-05-16 08:26:34 +00:00

pgdatadir_mapping.rs

feat(pageserver): generate image layers for sparse keyspace (#7567)

2024-05-20 16:08:45 +00:00

repository.rs

feat: Timeline detach ancestor (#7456)

2024-05-07 13:47:57 +03:00

span.rs

debug_assert presence of shard_id tracing field (#6572)

2024-02-06 14:43:33 +00:00

statvfs.rs

Also allow unnecessary_fallible_conversions lint (#6294)

2024-01-09 04:22:36 +00:00

task_mgr.rs

feat: Timeline detach ancestor (#7456)

2024-05-07 13:47:57 +03:00

tenant.rs

feat(pageserver): do not read past image layers for vectored get (#7773)

2024-05-20 14:24:18 -04:00

trace.rs

fix: replace all std::PathBufs with camino::Utf8PathBuf (#5352)

2023-10-04 17:52:23 +03:00

utilization.rs

implement Serialize/Deserialize for SystemTime with RFC3339 format (#7203)

2024-04-08 15:53:07 +01:00

virtual_file.rs

chore(pageserver): plumb through RequestContext to VirtualFile open methods (#7725)

2024-05-13 14:52:06 +02:00

walingest.rs

Remove the now-unused 'latest' arguments (#7377)

2024-04-25 20:45:37 +03:00

walrecord.rs

feat: copy delta layer prefix or "truncate" (#7228)

2024-04-18 10:43:04 +03:00

walredo.rs

chore!: always use async walredo, warn if sync is configured (#7754)

2024-05-15 15:04:52 +02:00