Alex Chi Z. c3b3b507f7 feat(pageserver): support detaching behavior v2 (#11158) ...

## Problem

close https://github.com/neondatabase/neon/issues/10310

## Summary of changes

This patch adds a new behavior for the detach_ancestor API: detach with
multi-level ancestor and no reparenting. Though we can potentially
support multi-level + do reparenting / single-level + no-reparenting in
the future, as it's not required for the recovery/snapshot epic, I'd
prefer keeping things simple now that we only handle the old one and the
new one instead of supporting the full feature matrix.

I only added a test case of successful detaching instead of testing
failures. I'd like to make this into staging and add more tests in the
future.

---------

Signed-off-by: Alex Chi Z <chi@neon.tech>

2025-03-12 22:27:23 +00:00

..

data

Fetch remote extension in ALTER EXTENSION UPDATE statements (#11102)

2025-03-09 17:29:44 +00:00

test_ancestor_branch.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_attach_tenant_config.py

pageserver: add separate semaphore for L0 compaction (#10780)

2025-02-12 16:12:21 +00:00

test_auth_broker.py

[auth_broker]: regress test (#9541)

2024-10-29 11:39:09 +00:00

test_auth.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_backpressure.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_bad_connection.py

compute: Disconnect if no response to a pageserver request is received (#10882)

2025-02-24 20:16:37 +00:00

test_basebackup_error.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branch_and_gc.py

pageserver: add compaction backpressure for layer flushes (#10405)

2025-01-24 09:47:28 +00:00

test_branch_behind.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_branching.py

Revert "pageserver: revert flush backpressure" (#10402)" (#10533)

2025-01-28 13:33:58 +00:00

test_broken_timeline.py

Persist pg_stat information in pageserver (#6560)

2025-02-20 06:38:55 +00:00

test_build_info_metric.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_change_pageserver.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_clog_truncate.py

pageserver: tighten up code around SLRU dir key handling (#10082)

2024-12-16 10:06:08 +00:00

test_close_fds.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_combocid.py

test_runner: use LFC by default (#8613)

2024-11-25 09:01:05 +00:00

test_compaction.py

test(pageserver): add small tenant compaction (#11049)

2025-03-12 20:34:19 +00:00

test_compatibility.py

pageserver: clean up DeletionQueue push_layers_sync (#10701)

2025-02-07 13:03:01 +00:00

test_compute_catalog.py

Fix dropping role with table privileges granted by non-neon_superuser (#10964)

2025-03-07 19:00:11 +00:00

test_compute_locales.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_compute_metrics.py

Fix flaky test_compute_installed_extensions_metric test (#10933)

2025-02-21 18:29:48 +00:00

test_compute_migrations.py

chore(compute): Simplify new compute_ctl metrics and fix flaky test (#10560)

2025-01-29 18:09:25 +00:00

test_compute_reconfigure.py

fix(compute): Respect skip_pg_catalog_updates in reconfigure() (#10696)

2025-02-12 17:54:21 +00:00

test_config.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_crafted_wal_end.py

safekeeper: use protobuf for sending compressed records to pageserver (#9821)

2024-11-27 12:12:21 +00:00

test_createdropdb.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_createuser.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ddl_forwarding.py

fix(adapter): password not set in role drop (#10130)

2024-12-14 17:37:13 +00:00

test_disk_usage_eviction.py

pageserver/storcon: add patch endpoints for tenant config metrics (#10020)

2024-12-11 19:16:33 +00:00

test_download_extensions.py

Fetch remote extension in ALTER EXTENSION UPDATE statements (#11102)

2025-03-09 17:29:44 +00:00

test_endpoint_crash.py

Add test to make sure sanitizers really work when expected (#10838)

2025-02-18 13:23:18 +00:00

test_explain_with_lfc_stats.py

test_runner: use LFC by default (#8613)

2024-11-25 09:01:05 +00:00

test_extensions.py

compute_ctl: Add endpoint that allows extensions to be installed (#9344)

2024-10-18 15:07:36 +03:00

test_fsm_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_fullbackup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gc_aggressive.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_gin_redo.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_hot_standby.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_import_pgdata.py

fast import: allow restore to provided connection string (#10407)

2025-02-14 16:10:06 +00:00

test_import.py

pageserver: fix spurious error logs in timeline lifecycle (#9589)

2024-10-31 14:44:59 +00:00

test_ingestion_layer_size.py

pageserver/storcon: add patch endpoints for tenant config metrics (#10020)

2024-12-11 19:16:33 +00:00

test_large_schema.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layer_bloating.py

Fix logical_replication_sync test fixture (#10531)

2025-02-03 12:44:47 +00:00

test_layer_eviction.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_layer_writers_fail.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_layers_from_future.py

Revert "feat(pageserver): repartition on L0-L1 boundary (#10548)" (#10870)

2025-02-18 15:43:33 +00:00

test_lfc_prefetch.py

Store prefetch results in LFC cache once as soon as they are received (#10442)

2025-02-21 16:56:16 +00:00

test_lfc_resize.py

Perform seqscan to fill LFC chunks with data so that on-disk file size included size of table (#10775)

2025-02-14 08:19:56 +00:00

test_lfc_working_set_approximation.py

test_runner: use LFC by default (#8613)

2024-11-25 09:01:05 +00:00

test_local_file_cache.py

Compute/LFC: Apply limits consistently (#10449)

2025-01-20 18:29:21 +00:00

test_logging.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_logical_replication.py

Fix logical_replication_sync test fixture (#10531)

2025-02-03 12:44:47 +00:00

test_lsn_mapping.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_multixact.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_nbtree_pagesplit_cycleid.py

Make sure we request pages with a known-flushed LSN. (#10413)

2025-01-16 08:34:11 +00:00

test_neon_cli.py

test_runner: skip more tests using decorator instead of pytest.skip (#9704)

2024-11-11 18:07:01 +00:00

test_neon_extension.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_neon_local_cli.py

Implement a second HTTP server within compute_ctl (#10574)

2025-02-11 18:02:22 +00:00

test_neon_superuser.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_next_xid.py

Update ruff to much newer version (#9433)

2024-10-18 12:42:41 +02:00

test_normal_work.py

compute <-> sk protocol v3 (#10647)

2025-02-25 11:56:05 +00:00

test_oid_overflow.py

test_runner: use LFC by default (#8613)

2024-11-25 09:01:05 +00:00

test_old_request_lsn.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_ondemand_download.py

pageserver: handle shutdown cleanly in layer download API (#10598)

2025-01-30 22:43:36 +00:00

test_ondemand_slru_download.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_ondemand_wal_download.py

Register custom xlog reader callbacks for on-demand WAL download in StartupDecodingContext (#9007)

2024-11-19 22:29:57 +02:00

test_page_service_batching_regressions.py

fix(page_service pipelining): tenant cannot shut down because gate kept open while flushing responses (#10386)

2025-01-16 20:34:02 +00:00

test_pageserver_api.py

feat(pageserver): add force patch index_part API (#11119)

2025-03-07 17:42:52 +00:00

test_pageserver_catchup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_crash_consistency.py

pageserver/storcon: add patch endpoints for tenant config metrics (#10020)

2024-12-11 19:16:33 +00:00

test_pageserver_generations.py

pageserver: clean up DeletionQueue push_layers_sync (#10701)

2025-02-07 13:03:01 +00:00

test_pageserver_getpage_throttle.py

tests & benchmarks: unify the way we customize the default tenant config (#9992)

2024-12-03 22:07:03 +00:00

test_pageserver_layer_rolling.py

fix(pageserver): run psql in thread to avoid blocking (#10177)

2024-12-19 09:45:06 +00:00

test_pageserver_metric_collection.py

Improve typing in test_runner/fixtures/httpserver.py (#10103)

2024-12-11 22:21:42 +00:00

test_pageserver_reconnect.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_restart.py

fix(neon): Add tests clarifying postgres sigabrt on pageserver unavailability (#10666)

2025-02-12 10:52:26 +00:00

test_pageserver_restarts_under_workload.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pageserver_secondary.py

storage controller: API-driven graceful migrations (#10913)

2025-03-07 17:02:38 +00:00

test_pg_query_cancellation.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pg_regress.py

test(pageserver): use reldirv2 by default in regress tests (#11081)

2025-03-05 21:02:44 +00:00

test_pg_waldump.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_pgstat.py

Move neon_pgstat_file_size_limit to the extension (#10959)

2025-02-25 12:23:04 +00:00

test_physical_and_logical_replicaiton.py

Fix logical_replication_sync test fixture (#10531)

2025-02-03 12:44:47 +00:00

test_physical_replication.py

Increase max connection for replica to prevent test flukyness (#10306)

2025-01-13 20:01:03 +00:00

test_pitr_gc.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_postgres_version.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_prefetch_buffer_resize.py

test_prefetch: reduce timeout to default 5m from 10m (#10105)

2024-12-13 14:52:54 +00:00

test_proxy_allowed_ips.py

switch from localtest.me to local.neon.build (#10714)

2025-02-07 12:25:16 +00:00

test_proxy_metric_collection.py

Improve typing in test_runner/fixtures/httpserver.py (#10103)

2024-12-11 22:21:42 +00:00

test_proxy_websockets.py

Add a websockets tunnel and a test for the proxy's websockets support. (#3823)

2025-01-13 11:35:39 +00:00

test_proxy.py

switch from localtest.me to local.neon.build (#10714)

2025-02-07 12:25:16 +00:00

test_read_validation.py

test_runner: use LFC by default (#8613)

2024-11-25 09:01:05 +00:00

test_readonly_node.py

pageserver: make true GC cutoff visible in admin API, rebrand latest_gc_cutoff as applied_gc_cutoff (#10707)

2025-02-13 10:33:47 +00:00

test_recovery.py

pageserver: add compaction backpressure for layer flushes (#10405)

2025-01-24 09:47:28 +00:00

test_relations.py

feat(pageserver): persist reldir v2 migration status (#10980)

2025-03-03 21:05:43 +00:00

test_remote_storage.py

Revert "pageserver: revert flush backpressure" (#10402)" (#10533)

2025-01-28 13:33:58 +00:00

test_replica_start.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_role_grants.py

compute_ctl: Add endpoint that allows setting role grants (#9395)

2024-10-18 11:25:45 +01:00

test_s3_restore.py

Python 3.11 (#9515)

2024-11-21 16:25:31 +00:00

test_safekeeper_deletion.py

safekeeper: allow remote deletion to proceed after dropped requests (#11042)

2025-03-03 16:03:51 +00:00

test_setup.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_sharding.py

tests: remove obsolete err log whitelisting (#11069)

2025-03-04 08:18:19 +00:00

test_signed_char.py

Add -fsigned-char for cross platform signed chars (#10852)

2025-02-28 21:07:21 +00:00

test_sni_router.py

switch from localtest.me to local.neon.build (#10714)

2025-02-07 12:25:16 +00:00

test_ssl.py

pageserver: https for management API (#11025)

2025-03-10 15:07:59 +00:00

test_storage_controller.py

storcon: do not update observed state on node activation (#11155)

2025-03-12 15:31:28 +00:00

test_storage_scrubber.py

tests: remove obsolete err log whitelisting (#11069)

2025-03-04 08:18:19 +00:00

test_subscriber_branching.py

Fix deadlock in drop_subscriptions_before_start (#10806)

2025-02-20 17:14:16 +00:00

test_subscriber_restart.py

Enable sanitizers for postgres v17 (#10401)

2025-02-06 12:53:43 +00:00

test_subxacts.py

safekeeper: use protobuf for sending compressed records to pageserver (#9821)

2024-11-27 12:12:21 +00:00

test_tenant_conf.py

pageserver/storcon: add patch endpoints for tenant config metrics (#10020)

2024-12-11 19:16:33 +00:00

test_tenant_delete.py

tests: refactor test_tenant_delete_races_timeline_creation (#10425)

2025-01-16 14:11:33 +00:00

test_tenant_detach.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_tenant_relocation.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_tenant_size.py

storcon: do not update observed state on node activation (#11155)

2025-03-12 15:31:28 +00:00

test_tenant_tasks.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_tenants_with_remote_storage.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_tenants.py

feat(pageserver): store reldir in sparse keyspace (#10593)

2025-02-14 20:31:54 +00:00

test_threshold_based_eviction.py

Improve typing in test_runner/fixtures/httpserver.py (#10103)

2024-12-11 22:21:42 +00:00

test_timeline_archive.py

Suppress "request was dropped" errors in test_timeline_archive (#11190)

2025-03-12 13:23:31 +00:00

test_timeline_delete.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_timeline_detach_ancestor.py

feat(pageserver): support detaching behavior v2 (#11158)

2025-03-12 22:27:23 +00:00

test_timeline_gc_blocking.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_timeline_size.py

pageserver: add compaction backpressure for layer flushes (#10405)

2025-01-24 09:47:28 +00:00

test_truncate.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_twophase.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unlogged.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00

test_unstable_extensions.py

Create the notion of unstable extensions

2024-10-28 17:47:15 -05:00

test_vm_bits.py

test_runner/regress: speed up test_check_visibility_map (#11086)

2025-03-05 13:50:35 +00:00

test_vm_truncate.py

Correctly truncate VM (#9342)

2024-11-14 17:19:13 +02:00

test_wal_acceptor_async.py

compute <-> sk protocol v3 (#10647)

2025-02-25 11:56:05 +00:00

test_wal_acceptor.py

safekeeper: allow remote deletion to proceed after dropped requests (#11042)

2025-03-03 16:03:51 +00:00

test_wal_receiver.py

test_runner: improve wait_until (#9936)

2024-12-02 10:26:15 +00:00

test_wal_restore.py

Switch compute-related locales to C.UTF-8 by default

2024-11-08 12:19:18 -06:00

test_walredo_not_left_behind_on_detach.py

Enable all pyupgrade checks in ruff

2024-10-08 14:32:26 -05:00