Alex Chi Z. e5c89f3da3 feat(pageserver): drop disposable keys during gc-compaction (#9765) ...

close https://github.com/neondatabase/neon/issues/9552, close
https://github.com/neondatabase/neon/issues/8920, part of
https://github.com/neondatabase/neon/issues/9114

## Summary of changes

* Drop keys not belonging to this shard during gc-compaction to avoid
constructing history that might have been truncated during shard
compaction.
* Run gc-compaction at the end of shard compaction test.

---------

Signed-off-by: Alex Chi Z <chi@neon.tech>

2024-11-18 19:27:52 +00:00

..

data/extension_test/5670669815

[compute/postgres] feature: PostgreSQL 17 (#8573)

2024-09-12 23:18:41 +01:00

test_ancestor_branch.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_attach_tenant_config.py

Add tenant config option to allow timeline_offloading (#9598)

2024-11-04 21:01:18 +01:00

test_auth_broker.py

[auth_broker]: regress test (#9541)

2024-10-29 11:39:09 +00:00

test_auth.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_backpressure.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_bad_connection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_basebackup_error.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branch_and_gc.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_branch_behind.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branching.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_broken_timeline.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_build_info_metric.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_change_pageserver.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_clog_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_close_fds.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_combocid.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_compaction.py

feat(pageserver): drop disposable keys during gc-compaction (#9765)

2024-11-18 19:27:52 +00:00

test_compatibility.py

Test versions mismatch (#9167)

2024-10-11 15:29:54 +02:00

test_compute_catalog.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_compute_locales.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_compute_metrics.py

Add tests for sql-exporter metrics

2024-10-29 15:13:06 -05:00

test_config.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_crafted_wal_end.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createdropdb.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ddl_forwarding.py

Get role name when not a C string

2024-10-28 18:21:45 -05:00

test_disk_usage_eviction.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_download_extensions.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_endpoint_crash.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_explain_with_lfc_stats.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_extensions.py

compute_ctl: Add endpoint that allows extensions to be installed (#9344)

2024-10-18 15:07:36 +03:00

test_fsm_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_fullbackup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gc_aggressive.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gin_redo.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_hot_standby.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_import.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_ingestion_layer_size.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_installed_extensions.py

Add installed_extensions prometheus metric (#9608)

2024-11-13 09:36:48 +00:00

test_large_schema.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layer_bloating.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_eviction.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_writers_fail.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layers_from_future.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_lfc_resize.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_lfc_working_set_approximation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_local_file_cache.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_logging.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_logical_replication.py

Improve typing related to regress/test_logical_replication.py (#9725)

2024-11-11 17:36:45 -06:00

test_lsn_mapping.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_migrations.py

Grant access to pg_show_replication_origin_status for neon_superuser

2024-09-16 16:38:55 +01:00

test_multixact.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_cli.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_neon_extension.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_local_cli.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_superuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_next_xid.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_normal_work.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_oid_overflow.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_old_request_lsn.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_download.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_slru_download.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_api.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_catchup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_crash_consistency.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_pageserver_generations.py

pageserver: refuse to load tenants with suspiciously old indices in old generations (#9719)

2024-11-13 18:07:39 +00:00

test_pageserver_getpage_throttle.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_pageserver_layer_rolling.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_pageserver_metric_collection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_reconnect.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_restart.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_pageserver_restarts_under_workload.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_secondary.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_parallel_copy.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_query_cancellation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_regress.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_pg_waldump.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_physical_and_logical_replicaiton.py

Do not wallog AUX files at replica (#9457)

2024-11-13 08:50:01 +02:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-08 07:30:22 -07:00

test_pitr_gc.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_postgres_version.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_allowed_ips.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_metric_collection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_websockets.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_proxy.py

proxy: more granular http status codes for sql-over-http errors (#9549)

2024-10-29 15:44:45 +00:00

test_read_validation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_readonly_node.py

test: disable test_readonly_node_gc until proper fix (#9755)

2024-11-14 15:26:58 +00:00

test_recovery.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_remote_storage.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_replica_start.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_role_grants.py

compute_ctl: Add endpoint that allows setting role grants (#9395)

2024-10-18 11:25:45 +01:00

test_s3_restore.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_setup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_sharding.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_sni_router.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_storage_controller.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_storage_scrubber.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_subscriber_restart.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_subxacts.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_conf.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_delete.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_tenant_detach.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_relocation.py

pageserver: refactor ingest inplace to decouple decoding and handling (#9472)

2024-10-24 17:12:47 +01:00

test_tenant_size.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_tenant_tasks.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenants_with_remote_storage.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenants.py

tests: Increase timeout in test_create_churn_during_restart (#9736)

2024-11-13 12:20:32 +02:00

test_threshold_based_eviction.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_timeline_archive.py

Bump default Postgres version for tests to v17 (#9777)

2024-11-18 15:06:24 +00:00

test_timeline_delete.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_timeline_detach_ancestor.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_timeline_gc_blocking.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_timeline_size.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_twophase.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unlogged.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unstable_extensions.py

Create the notion of unstable extensions

2024-10-28 17:47:15 -05:00

test_vm_bits.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_vm_truncate.py

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

test_wal_acceptor_async.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_wal_acceptor.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_wal_receiver.py

Make test_pageserver_lsn_wait_error_safekeeper_stop less aggressive. (#9517)

2024-10-25 14:13:46 +01:00

test_wal_restore.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_walredo_not_left_behind_on_detach.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00