Vlad Lazar 8dbfda98d4 storcon: ignore deleted timelines on new location catch-up (#9244) ...

## Problem

If a timeline was deleted right before waiting for LSNs to catch up
before the cut-over,
then we would wait forever. 

## Summary of changes

Fix the issue and add a test for timeline deletions mid migration. 

Related https://github.com/neondatabase/neon/issues/9144

2024-10-02 17:23:26 +01:00

..

data/extension_test/5670669815

[compute/postgres] feature: PostgreSQL 17 (#8573)

2024-09-12 23:18:41 +01:00

test_ancestor_branch.py

test: do graceful shutdown by default (#8655)

2024-08-12 15:37:15 +03:00

test_attach_tenant_config.py

proxy+pageserver: shared leaky bucket impl (#8539)

2024-08-29 11:26:52 +00:00

test_auth.py

Remove support for pageserver <-> compute protocol version 1 (#8774)

2024-08-27 18:36:33 +03:00

test_aux_files.py

chore(pageserver): use kebab case for aux file flag (#7840)

2024-05-22 17:06:00 +00:00

test_backpressure.py

Revert "pageserver: use a single tokio runtime (#6555)" (#7246)

2024-03-26 15:24:18 +01:00

test_bad_connection.py

fix: drain completed page_service connections (#8632)

2024-08-07 17:14:45 +00:00

test_basebackup_error.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_branch_and_gc.py

tests: Remove creation of extra timelines in some tests

2024-09-30 17:56:40 +03:00

test_branch_behind.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_branching.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_broken_timeline.py

refactor(layer load API): all errors are permanent (#8527)

2024-07-26 15:48:44 +01:00

test_build_info_metric.py

feat: add build_tag env support for set_build_info_metric (#5576)

2023-10-27 10:47:11 +01:00

test_change_pageserver.py

tests: make test_change_pageserver more robust (#8442)

2024-07-22 14:17:02 +01:00

test_clog_truncate.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_close_fds.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_combocid.py

test: avoid some too long shutdowns by flushing before shutdown (#8772)

2024-08-21 14:26:27 -04:00

test_compaction.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_compatibility.py

test_compatibility: fix the regexes detecting the version (#9205)

2024-09-30 16:37:14 +02:00

test_compute_catalog.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_compute_metrics.py

Add views for metrics about pageserver requests (#9008)

2024-09-23 21:28:50 +03:00

test_config.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_crafted_wal_end.py

Allow bad state (not active) pageserver error/warns in walcraft test.

2024-05-06 06:45:27 +03:00

test_createdropdb.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_createuser.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_ddl_forwarding.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_disk_usage_eviction.py

Generate pgbench data on the server for most tests

2024-09-16 23:37:36 +01:00

test_download_extensions.py

[compute/postgres] feature: PostgreSQL 17 (#8573)

2024-09-12 23:18:41 +01:00

test_endpoint_crash.py

SELECT 💣(); (#8270)

2024-07-05 15:12:01 +01:00

test_explain_with_lfc_stats.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

refactor(test): duplication with fullbackup, tar content hashing (#7828)

2024-05-22 15:43:21 +03:00

test_gc_aggressive.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_gin_redo.py

Do not produce error if gin page is not restored in redo (#7876)

2024-05-29 22:18:09 +03:00

test_hot_standby.py

test: Make test_hot_standby_feedback more forgiving of slow initialization (#9113)

2024-09-24 16:41:59 +03:00

test_import.py

test: fix more flaky due to graceful shutdown (#8787)

2024-08-21 17:22:47 +01:00

test_ingestion_layer_size.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_large_schema.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_bloating.py

test: fix more flaky due to graceful shutdown (#8787)

2024-08-21 17:22:47 +01:00

test_layer_eviction.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_layer_writers_fail.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_layers_from_future.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

test_lfc_resize.py

test: Make test_lfc_resize more robust (#9117)

2024-09-24 23:38:16 +03:00

test_lfc_working_set_approximation.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_local_file_cache.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_logging.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_logical_replication.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_lsn_mapping.py

feat(pageserver): add an optional lease to the get_lsn_by_timestamp API (#8104)

2024-06-24 20:12:24 +00:00

test_migrations.py

Grant access to pg_show_replication_origin_status for neon_superuser

2024-09-16 16:38:55 +01:00

test_multixact.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_neon_cli.py

tests: Remove some spurious list_timelines calls

2024-09-30 17:56:37 +03:00

test_neon_extension.py

Bump default neon extension version to 1.5 (#9188)

2024-09-30 09:20:52 +03:00

test_neon_local_cli.py

fix(test suite): some tests leak child processes (#6497)

2024-01-26 18:23:53 +00:00

test_neon_superuser.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_next_xid.py

tests: wait walreceiver on sks to be gone on 'immediate' ep restart. (#9099)

2024-10-01 20:54:00 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_oid_overflow.py

refactor(test): unify how we clear shared buffers (#8634)

2024-08-13 20:14:42 +03:00

test_old_request_lsn.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_ondemand_download.py

test: limit test_layer_download_timeouted to MOCK_S3 (#8331)

2024-07-11 15:03:35 -04:00

test_ondemand_slru_download.py

Fix on-demand SLRU download on standby starting at WAL segment boundary (#8031)

2024-06-13 00:31:31 +03:00

test_pageserver_api.py

pageserver: use identity file as node id authority and remove init command and config-override flags (#7766)

2024-07-23 11:41:12 +01:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_crash_consistency.py

test_local_only_layers_after_crash: various fixes (#7986)

2024-06-07 10:18:05 +03:00

test_pageserver_generations.py

tests: make test_multi_attach more stable (#9202)

2024-10-01 10:15:18 +01:00

test_pageserver_getpage_throttle.py

proxy+pageserver: shared leaky bucket impl (#8539)

2024-08-29 11:26:52 +00:00

test_pageserver_layer_rolling.py

bypass PageCache for InMemoryLayer + avoid Value::deser on L0 flush (#8537)

2024-08-28 18:31:41 +00:00

test_pageserver_metric_collection.py

Rename some S3 usages to "remote storage" in exposed messages (#8999)

2024-09-17 19:15:01 +02:00

test_pageserver_reconnect.py

Generate pgbench data on the server for most tests

2024-09-16 23:37:36 +01:00

test_pageserver_restart.py

tests: Remove creation of extra timelines in some tests

2024-09-30 17:56:40 +03:00

test_pageserver_restarts_under_workload.py

Generate pgbench data on the server for most tests

2024-09-16 23:37:36 +01:00

test_pageserver_secondary.py

scrubber: clean up scan_metadata before prod (#8565)

2024-08-06 18:55:42 +01:00

test_parallel_copy.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_pg_query_cancellation.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_pg_regress.py

fix(neon): disable create tablespace stmt (#8657)

2024-08-09 09:18:55 +01:00

test_pg_waldump.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-08 07:30:22 -07:00

test_pitr_gc.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_postgres_version.py

test_postgres_version: reenable version check for prereleased versions

2024-09-18 14:51:59 +01:00

test_proxy_allowed_ips.py

proxy: include client IP in ip deny message (#6854)

2024-02-21 18:24:59 +01:00

test_proxy_metric_collection.py

refactor(test_consumption_metrics): split for pageserver and proxy (#5324)

2023-09-16 18:05:35 +03:00

test_proxy_websockets.py

proxy: swap tungstenite for a simpler impl (#7353)

2024-05-16 13:05:50 +02:00

test_proxy.py

Decode the database name in SQL/HTTP connections

2024-08-13 16:32:58 -05:00

test_read_validation.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_readonly_node.py

fix(pageserver): LSN lease edge cases around restarts/migrations (#9055)

2024-09-27 09:56:52 -04:00

test_recovery.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_remote_storage.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_replica_start.py

tests: wait walreceiver on sks to be gone on 'immediate' ep restart. (#9099)

2024-10-01 20:54:00 +03:00

test_s3_restore.py

test: copy dict to avoid error on retry (#8811)

2024-08-23 14:43:08 +01:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sharding.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_storage_controller.py

storcon: ignore deleted timelines on new location catch-up (#9244)

2024-10-02 17:23:26 +01:00

test_storage_scrubber.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_subscriber_restart.py

tests: wait walreceiver on sks to be gone on 'immediate' ep restart. (#9099)

2024-10-01 20:54:00 +03:00

test_subxacts.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_tenant_conf.py

pageserver: exclude un-read layers from short residence statistic (#8396)

2024-07-16 20:55:29 +01:00

test_tenant_delete.py

Add safekeeper scrubber test (#8785)

2024-08-31 01:12:25 +02:00

test_tenant_detach.py

pageserver: wait for lsn lease duration after transition into AttachedSingle (#9024)

2024-09-19 17:27:10 +01:00

test_tenant_relocation.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

test_tenant_size.py

tests: Remove some spurious list_timelines calls

2024-09-30 17:56:37 +03:00

test_tenant_tasks.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants_with_remote_storage.py

tests: Remove creation of extra timelines in some tests

2024-09-30 17:56:40 +03:00

test_tenants.py

storcon: make hb interval an argument and speed up tests (#8880)

2024-09-04 10:09:41 +01:00

test_threshold_based_eviction.py

Generate pgbench data on the server for most tests

2024-09-16 23:37:36 +01:00

test_timeline_archive.py

Implement archival_config timeline endpoint in the storage controller (#8680)

2024-09-02 13:51:45 +02:00

test_timeline_delete.py

tests: longer timeout in test_delete_timeline_client_hangup (#9161)

2024-09-30 15:46:07 +01:00

test_timeline_detach_ancestor.py

[compute/postgres] feature: PostgreSQL 17 (#8573)

2024-09-12 23:18:41 +01:00

test_timeline_gc_blocking.py

fix(pageserver): LSN lease edge cases around restarts/migrations (#9055)

2024-09-27 09:56:52 -04:00

test_timeline_size.py

Don't create 'empty' branch in neon_simple_env (#8965)

2024-09-09 12:38:34 +03:00

test_truncate.py

tests: Remove creation of extra timelines in some tests

2024-09-30 17:56:40 +03:00

test_twophase.py

Fix init of WAL page header at startup (#8914)

2024-09-21 04:00:38 +03:00

test_unlogged.py

NOAI (#9084)

2024-09-23 21:16:42 +00:00

test_vm_bits.py

tests: wait walreceiver on sks to be gone on 'immediate' ep restart. (#9099)

2024-10-01 20:54:00 +03:00

test_wal_acceptor_async.py

Evict WAL files from disk (#8022)

2024-06-26 18:58:56 +01:00

test_wal_acceptor.py

tests: wait walreceiver on sks to be gone on 'immediate' ep restart. (#9099)

2024-10-01 20:54:00 +03:00

test_wal_receiver.py

ingest: rate-limited warning if WAL commit timestamps lags for > wait_lsn_timeout (#8839)

2024-08-29 12:06:00 +01:00

test_wal_restore.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_walredo_not_left_behind_on_detach.py

pageserver: remove attach/detach apis (#8134)

2024-06-25 17:38:06 +01:00