John Spray 1a4c1eba92 pageserver: add LayerVisibilityHint (#8432) ...

## Problem

As described in https://github.com/neondatabase/neon/issues/8398, layer
visibility is a new hint that will help us manage disk space more
efficiently.

## Summary of changes

- Introduce LayerVisibilityHint and store it as part of access stats
- Automatically mark a layer visible if it is accessed, or when it is
created.

The impact on the access stats size will be reversed in
https://github.com/neondatabase/neon/pull/8431

This is functionally a no-op change: subsequent PRs will add the logic
that sets layers to Covered, and which uses the layer visibility as an
input to eviction and heatmap generation.

---------

Co-authored-by: Joonas Koivunen <joonas@neon.tech>

2024-07-23 15:37:12 +01:00

..

bin

pageserver: use identity file as node id authority and remove init command and config-override flags (#7766)

2024-07-23 11:41:12 +01:00

consumption_metrics

pageserver: improve readability of shard.rs (#7330)

2024-04-15 11:50:26 +01:00

context

feat(per-tenant throttling): exclude throttled time from page_service metrics + regression test (#6953)

2024-03-05 13:44:00 +00:00

deletion_queue

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

http

tests: make test_scrubber_physical_gc_ancestors more stable (#8453)

2024-07-23 12:57:57 +01:00

tenant

pageserver: add LayerVisibilityHint (#8432)

2024-07-23 15:37:12 +01:00

virtual_file

Fix nightly warnings 2024 june (#8151)

2024-07-12 13:58:04 +01:00

walredo

test(pageserver): add test wal record for unit testing (#8015)

2024-06-13 09:44:37 -04:00

auth.rs

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

aux_file.rs

feat(pageserver): compute aux file size on initial logical size calculation (#7958)

2024-06-04 13:47:48 -04:00

basebackup.rs

fix(pageserver): include aux file in basebackup only once (#8207)

2024-07-01 14:36:49 +00:00

config.rs

pageserver: use identity file as node id authority and remove init command and config-override flags (#7766)

2024-07-23 11:41:12 +01:00

consumption_metrics.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

context.rs

Fix nightly warnings 2024 june (#8151)

2024-07-12 13:58:04 +01:00

control_plane_client.rs

refactor: move NodeMetadata to pageserver_api; use it from neon_local (#7606)

2024-05-03 13:15:38 -04:00

deletion_queue.rs

Use DefaultCredentialsChain AWS authentication in remote_storage (#8440)

2024-07-19 21:19:30 +02:00

disk_usage_eviction_task.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

import_datadir.rs

pageserver: apply shard filtering to blocks ingested during initdb (#7319)

2024-04-05 18:07:35 +01:00

l0_flush.rs

L0 flush: opt-in mechanism to bypass PageCache reads and writes (#8190)

2024-07-02 16:29:09 +02:00

lib.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

metrics.rs

Enable zstd in tests (#8368)

2024-07-18 19:09:57 +01:00

page_cache.rs

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

page_service.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

pgdatadir_mapping.rs

Use DefaultCredentialsChain AWS authentication in remote_storage (#8440)

2024-07-19 21:19:30 +02:00

repository.rs

feat(pageserver): use leases to temporarily block gc (#8084)

2024-06-18 17:37:06 +00:00

span.rs

debug_assert presence of shard_id tracing field (#6572)

2024-02-06 14:43:33 +00:00

statvfs.rs

Also allow unnecessary_fallible_conversions lint (#6294)

2024-01-09 04:22:36 +00:00

task_mgr.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

tenant.rs

refactor(pageserver) remove task_mgr for most global tasks (#8449)

2024-07-22 17:25:06 +02:00

utilization.rs

implement Serialize/Deserialize for SystemTime with RFC3339 format (#7203)

2024-04-08 15:53:07 +01:00

virtual_file.rs

virtual_file: take a Slice in the read APIs, eliminate read_exact_at_n, fix UB for engine std-fs (#8186)

2024-06-28 11:20:37 +02:00

walingest.rs

Use DefaultCredentialsChain AWS authentication in remote_storage (#8440)

2024-07-19 21:19:30 +02:00

walrecord.rs

test(pageserver): add test wal record for unit testing (#8015)

2024-06-13 09:44:37 -04:00

walredo.rs

fix: shutdown does not kill walredo processes (#8150)

2024-06-27 15:58:28 +02:00