Alex Chi Z. b22a84a7bf feat(pageserver): support key range for manual compaction trigger (#9723) ...

part of https://github.com/neondatabase/neon/issues/9114, we want to be
able to run partial gc-compaction in tests. In the future, we can also
expand this functionality to legacy compaction, so that we can trigger
compaction for a specific key range.

## Summary of changes

* Support passing compaction key range through pageserver routes.
* Refactor input parameters of compact related function to take the new
`CompactOptions`.
* Add tests for partial compaction. Note that the test may or may not
trigger compaction based on GC horizon. We need to improve the test case
to ensure things always get below the gc_horizon and the gc-compaction
can be triggered.

---------

Signed-off-by: Alex Chi Z <chi@neon.tech>

2024-11-19 19:38:41 +00:00

..

data/extension_test/5670669815

[compute/postgres] feature: PostgreSQL 17 (#8573)

2024-09-12 23:18:41 +01:00

test_ancestor_branch.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_attach_tenant_config.py

Add tenant config option to allow timeline_offloading (#9598)

2024-11-04 21:01:18 +01:00

test_auth_broker.py

[auth_broker]: regress test (#9541)

2024-10-29 11:39:09 +00:00

test_auth.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_backpressure.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_bad_connection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_basebackup_error.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branch_and_gc.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_branch_behind.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branching.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_broken_timeline.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_build_info_metric.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_change_pageserver.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_clog_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_close_fds.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_combocid.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_compaction.py

feat(pageserver): support key range for manual compaction trigger (#9723)

2024-11-19 19:38:41 +00:00

test_compatibility.py

Test versions mismatch (#9167)

2024-10-11 15:29:54 +02:00

test_compute_catalog.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_compute_locales.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_compute_metrics.py

Add tests for sql-exporter metrics

2024-10-29 15:13:06 -05:00

test_config.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_crafted_wal_end.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createdropdb.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ddl_forwarding.py

Get role name when not a C string

2024-10-28 18:21:45 -05:00

test_disk_usage_eviction.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_download_extensions.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_endpoint_crash.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_explain_with_lfc_stats.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_extensions.py

compute_ctl: Add endpoint that allows extensions to be installed (#9344)

2024-10-18 15:07:36 +03:00

test_fsm_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_fullbackup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gc_aggressive.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gin_redo.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_hot_standby.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_import.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_ingestion_layer_size.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_installed_extensions.py

Add installed_extensions prometheus metric (#9608)

2024-11-13 09:36:48 +00:00

test_large_schema.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layer_bloating.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_eviction.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_writers_fail.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layers_from_future.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_lfc_resize.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_lfc_working_set_approximation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_local_file_cache.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_logging.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_logical_replication.py

Improve typing related to regress/test_logical_replication.py (#9725)

2024-11-11 17:36:45 -06:00

test_lsn_mapping.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_migrations.py

Grant access to pg_show_replication_origin_status for neon_superuser

2024-09-16 16:38:55 +01:00

test_multixact.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_cli.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_neon_extension.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_local_cli.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_superuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_next_xid.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_normal_work.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_oid_overflow.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_old_request_lsn.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_download.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_slru_download.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_api.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_catchup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_crash_consistency.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_pageserver_generations.py

pageserver: refuse to load tenants with suspiciously old indices in old generations (#9719)

2024-11-13 18:07:39 +00:00

test_pageserver_getpage_throttle.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_pageserver_layer_rolling.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_pageserver_metric_collection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_reconnect.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_restart.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_pageserver_restarts_under_workload.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_secondary.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_parallel_copy.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_query_cancellation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_regress.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_pg_waldump.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_physical_and_logical_replicaiton.py

Do not wallog AUX files at replica (#9457)

2024-11-13 08:50:01 +02:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-08 07:30:22 -07:00

test_pitr_gc.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_postgres_version.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_allowed_ips.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_metric_collection.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_proxy_websockets.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_proxy.py

proxy: more granular http status codes for sql-over-http errors (#9549)

2024-10-29 15:44:45 +00:00

test_read_validation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_readonly_node.py

test: disable test_readonly_node_gc until proper fix (#9755)

2024-11-14 15:26:58 +00:00

test_recovery.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_remote_storage.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_replica_start.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_role_grants.py

compute_ctl: Add endpoint that allows setting role grants (#9395)

2024-10-18 11:25:45 +01:00

test_s3_restore.py

fix(test_regress): always use storcon virtual pageserver API to set tenant config (#9622)

2024-11-04 17:42:08 +01:00

test_setup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_sharding.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_sni_router.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_storage_controller.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_storage_scrubber.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_subscriber_restart.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_subxacts.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_conf.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_delete.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_tenant_detach.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenant_relocation.py

pageserver: refactor ingest inplace to decouple decoding and handling (#9472)

2024-10-24 17:12:47 +01:00

test_tenant_size.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_tenant_tasks.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenants_with_remote_storage.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_tenants.py

fix(pageserver): queue stopped error should be ignored during create timeline (#9767)

2024-11-19 14:10:09 -05:00

test_threshold_based_eviction.py

Improve type safety according to pyright

2024-11-08 14:43:15 -06:00

test_timeline_archive.py

Bump default Postgres version for tests to v17 (#9777)

2024-11-18 15:06:24 +00:00

test_timeline_delete.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_timeline_detach_ancestor.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_timeline_gc_blocking.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_timeline_size.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_twophase.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unlogged.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unstable_extensions.py

Create the notion of unstable extensions

2024-10-28 17:47:15 -05:00

test_vm_bits.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_vm_truncate.py

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

test_wal_acceptor_async.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_wal_acceptor.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_wal_receiver.py

Make test_pageserver_lsn_wait_error_safekeeper_stop less aggressive. (#9517)

2024-10-25 14:13:46 +01:00

test_wal_restore.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_walredo_not_left_behind_on_detach.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00