John Spray d9de65ee8f pageserver: permit reads behind GC cutoff during LSN grace period (#9833) ...

## Problem

In https://github.com/neondatabase/neon/issues/9754 and the flakiness of
`test_readonly_node_gc`, we saw that although our logic for controlling
GC was sound, the validation of getpage requests was not, because it
could not consider LSN leases when requests arrived shortly after
restart.

Closes https://github.com/neondatabase/neon/issues/9754

## Summary of changes

This is the "Option 3" discussed verbally -- rather than holding back gc
cutoff, we waive the usual validation of request LSN if we are still
waiting for leases to be sent after startup

- When validating LSN in `wait_or_get_last_lsn`, skip the validation
relative to GC cutoff if the timeline is still in its LSN lease grace
period
- Re-enable test_readonly_node_gc

2024-11-22 09:24:23 +00:00

..

data/extension_test/5670669815

[compute/postgres] feature: PostgreSQL 17 (#8573)

2024-09-12 23:18:41 +01:00

test_ancestor_branch.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_attach_tenant_config.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_auth_broker.py

[auth_broker]: regress test (#9541)

2024-10-29 11:39:09 +00:00

test_auth.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_backpressure.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_bad_connection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_basebackup_error.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branch_and_gc.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_branch_behind.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branching.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_broken_timeline.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_build_info_metric.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_change_pageserver.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_clog_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_close_fds.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_combocid.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_compaction.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_compatibility.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_compute_catalog.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_compute_locales.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_compute_metrics.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_config.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_crafted_wal_end.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createdropdb.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ddl_forwarding.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_disk_usage_eviction.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_download_extensions.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_endpoint_crash.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_explain_with_lfc_stats.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_extensions.py

compute_ctl: Add endpoint that allows extensions to be installed (#9344)

2024-10-18 15:07:36 +03:00

test_fsm_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_fullbackup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gc_aggressive.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gin_redo.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_hot_standby.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_import.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_ingestion_layer_size.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_installed_extensions.py

Add installed_extensions prometheus metric (#9608)

2024-11-13 09:36:48 +00:00

test_large_schema.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layer_bloating.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_eviction.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_writers_fail.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layers_from_future.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_lfc_resize.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_lfc_working_set_approximation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_local_file_cache.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_logging.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_logical_replication.py

Improve typing related to regress/test_logical_replication.py (#9725)

2024-11-11 17:36:45 -06:00

test_lsn_mapping.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_migrations.py

Grant access to pg_show_replication_origin_status for neon_superuser

2024-09-16 16:38:55 +01:00

test_multixact.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_cli.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_neon_extension.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_local_cli.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_superuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_next_xid.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_normal_work.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_oid_overflow.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_old_request_lsn.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_download.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_slru_download.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_ondemand_wal_download.py

Register custom xlog reader callbacks for on-demand WAL download in StartupDecodingContext (#9007)

2024-11-19 22:29:57 +02:00

test_pageserver_api.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_pageserver_catchup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_crash_consistency.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_pageserver_generations.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_pageserver_getpage_throttle.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_pageserver_layer_rolling.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_pageserver_metric_collection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_reconnect.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_restart.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_pageserver_restarts_under_workload.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_secondary.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_parallel_copy.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_query_cancellation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_regress.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_pg_waldump.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_physical_and_logical_replicaiton.py

Do not wallog AUX files at replica (#9457)

2024-11-13 08:50:01 +02:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-08 07:30:22 -07:00

test_pitr_gc.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_postgres_version.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_allowed_ips.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_metric_collection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_websockets.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_proxy.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_read_validation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_readonly_node.py

pageserver: permit reads behind GC cutoff during LSN grace period (#9833)

2024-11-22 09:24:23 +00:00

test_recovery.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_remote_storage.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_replica_start.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_role_grants.py

compute_ctl: Add endpoint that allows setting role grants (#9395)

2024-10-18 11:25:45 +01:00

test_s3_restore.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_setup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_sharding.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_sni_router.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_storage_controller.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_storage_scrubber.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_subscriber_restart.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_subxacts.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_conf.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_delete.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_tenant_detach.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_tenant_relocation.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_tenant_size.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_tenant_tasks.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenants_with_remote_storage.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenants.py

fix(pageserver): queue stopped error should be ignored during create timeline (#9767)

2024-11-19 14:10:09 -05:00

test_threshold_based_eviction.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_timeline_archive.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_timeline_delete.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_timeline_detach_ancestor.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_timeline_gc_blocking.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_timeline_size.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_twophase.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unlogged.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unstable_extensions.py

Create the notion of unstable extensions

2024-10-28 17:47:15 -05:00

test_vm_bits.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_vm_truncate.py

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

test_wal_acceptor_async.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_wal_acceptor.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_wal_receiver.py

Make test_pageserver_lsn_wait_error_safekeeper_stop less aggressive. (#9517)

2024-10-25 14:13:46 +01:00

test_wal_restore.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_walredo_not_left_behind_on_detach.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00