John Spray 8d948f2e07 tests: make test_change_pageserver more robust (#8442) ...

## Problem

This test predates the storage controller. It stops pageservers and
reconfigures computes, but that races with the storage controller's node
failure detection, which can result in restarting nodes not getting the
attachments they expect, and the test failing

## Summary of changes

- Configure the storage controller to use a compute notify hook that
does nothing, so that it cannot interfere with the test's configuration
of computes.
- Instead of using the attach hook, just notify the storage controller
that nodes are offline, and reconcile tenants so that they will
automatically be attached to the other node.

2024-07-22 14:17:02 +01:00

..

data/extension_test/5670669815

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_ancestor_branch.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_attach_tenant_config.py

pageserver: remove trace_read_requests (#8338)

2024-07-11 15:17:07 +02:00

test_auth.py

remove page_service show <tenant_id> (#8372)

2024-07-15 15:33:56 +01:00

test_aux_files.py

chore(pageserver): use kebab case for aux file flag (#7840)

2024-05-22 17:06:00 +00:00

test_backpressure.py

Revert "pageserver: use a single tokio runtime (#6555)" (#7246)

2024-03-26 15:24:18 +01:00

test_bad_connection.py

Add retry loops and bump test timeout in test_pageserver_connection_stress (#7281)

2024-05-01 21:36:50 -07:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

pageserver: use PITR GC cutoffs as authoritative (#8365)

2024-07-15 17:43:05 +01:00

test_branch_behind.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_branching.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_broken_timeline.py

pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752)

2024-05-15 12:05:24 +00:00

test_build_info_metric.py

feat: add build_tag env support for set_build_info_metric (#5576)

2023-10-27 10:47:11 +01:00

test_change_pageserver.py

tests: make test_change_pageserver more robust (#8442)

2024-07-22 14:17:02 +01:00

test_clog_truncate.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_close_fds.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_compaction.py

Enable zstd in tests (#8368)

2024-07-18 19:09:57 +01:00

test_compatibility.py

NeonEnv.from_repo_dir: use storage_controller_db instead of attachments.json (#8382)

2024-07-18 10:56:07 +02:00

test_compute_catalog.py

compute_ctl: catalog API endpoints (#7575)

2024-05-16 12:04:16 +02:00

test_config.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_crafted_wal_end.py

Allow bad state (not active) pageserver error/warns in walcraft test.

2024-05-06 06:45:27 +03:00

test_createdropdb.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_createuser.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_ddl_forwarding.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_disk_usage_eviction.py

pageserver: remove absolute-order disk usage eviction (#8454)

2024-07-22 13:15:55 +01:00

test_download_extensions.py

Use test specific directory in test_remote_extensions (#5938)

2023-11-27 18:57:58 +00:00

test_endpoint_crash.py

SELECT 💣(); (#8270)

2024-07-05 15:12:01 +01:00

test_explain_with_lfc_stats.py

new test for LFC stats in explain (#6968)

2024-03-01 14:33:08 +00:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

refactor(test): duplication with fullbackup, tar content hashing (#7828)

2024-05-22 15:43:21 +03:00

test_gc_aggressive.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_gin_redo.py

Do not produce error if gin page is not restored in redo (#7876)

2024-05-29 22:18:09 +03:00

test_hot_standby.py

Fix test_replica_query_race flakiness (#8038)

2024-06-14 11:51:12 +03:00

test_import.py

pageserver: move page_service's import basebackup / import wal to mgmt API (#8292)

2024-07-09 23:17:42 +02:00

test_ingestion_layer_size.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_large_schema.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_bloating.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_eviction.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_layer_writers_fail.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_layers_from_future.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

test_lfc_resize.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_lfc_working_set_approximation.py

implement rolling hyper-log-log algorithm (#8068)

2024-07-04 22:03:58 +03:00

test_local_file_cache.py

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

test_logging.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_logical_replication.py

Fix memory context of NeonWALReader allocation.

2024-07-11 20:31:15 +03:00

test_lsn_mapping.py

feat(pageserver): add an optional lease to the get_lsn_by_timestamp API (#8104)

2024-06-24 20:12:24 +00:00

test_migrations.py

Hide import behind TYPE_CHECKING

2024-07-16 12:12:29 -05:00

test_multixact.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_neon_cli.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_neon_extension.py

implement rolling hyper-log-log algorithm (#8068)

2024-07-04 22:03:58 +03:00

test_neon_local_cli.py

fix(test suite): some tests leak child processes (#6497)

2024-01-26 18:23:53 +00:00

test_neon_superuser.py

fix(test): drop subscription when test completes (#6975)

2024-03-06 15:52:24 +00:00

test_next_xid.py

Fix tracking of the nextMulti in the pageserver's copy of CheckPoint (#6528)

2024-07-01 01:49:49 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_ondemand_download.py

test: limit test_layer_download_timeouted to MOCK_S3 (#8331)

2024-07-11 15:03:35 -04:00

test_ondemand_slru_download.py

Fix on-demand SLRU download on standby starting at WAL segment boundary (#8031)

2024-06-13 00:31:31 +03:00

test_pageserver_api.py

pageserver: remove tenant create API (#8135)

2024-06-28 09:14:19 +01:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_crash_consistency.py

test_local_only_layers_after_crash: various fixes (#7986)

2024-06-07 10:18:05 +03:00

test_pageserver_generations.py

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

test_pageserver_getpage_throttle.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_pageserver_layer_rolling.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_pageserver_metric_collection.py

pageserver: remove obsolete cached_metric_collection_interval (#8370)

2024-07-19 17:01:02 +01:00

test_pageserver_reconnect.py

Add test for proper handling of connection failure to avoid 'cannot wait on socket event without a socket' error (#8231)

2024-07-02 21:45:42 +03:00

test_pageserver_restart.py

fix(pageserver): abort on duplicate layers, before doing damage (#7799)

2024-06-04 16:16:23 +00:00

test_pageserver_restarts_under_workload.py

pageserver: improve the shutdown log error (#5792)

2023-11-07 16:57:26 +00:00

test_pageserver_secondary.py

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

test_parallel_copy.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_pg_query_cancellation.py

Rework PageStream connection state handling: (#7611)

2024-05-23 23:26:42 +02:00

test_pg_regress.py

tests: increase test_pg_regress and test_isolation timeouts (#8418)

2024-07-18 10:23:17 +01:00

test_pg_waldump.py

pg_waldump segment on safekeeper in test_pg_waldump.

2024-05-06 07:18:38 +03:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-08 07:30:22 -07:00

test_pitr_gc.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_postgres_version.py

Add Postgres commit sha to Postgres version (#4603)

2024-05-07 15:18:17 +00:00

test_proxy_allowed_ips.py

proxy: include client IP in ip deny message (#6854)

2024-02-21 18:24:59 +01:00

test_proxy_metric_collection.py

refactor(test_consumption_metrics): split for pageserver and proxy (#5324)

2023-09-16 18:05:35 +03:00

test_proxy_websockets.py

proxy: swap tungstenite for a simpler impl (#7353)

2024-05-16 13:05:50 +02:00

test_proxy.py

proxy: update tokio-postgres to allow arbitrary config params (#8076)

2024-06-24 10:20:27 +00:00

test_read_validation.py

Refactor how the request LSNs are tracked in compute (#7377)

2024-04-25 20:45:37 +03:00

test_readonly_node.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_recovery.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_remote_storage.py

tests: longer timeouts in test_timeline_deletion_with_files_stuck_in_upload_queue (#8438)

2024-07-19 19:30:28 +02:00

test_replica_start.py

Add neon.running_xacts_overflow_policy to make it possible for RO replica to startup without primary even in case running xacts overflow (#8323)

2024-07-15 15:52:00 +03:00

test_s3_restore.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sharding.py

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_storage_controller.py

storage controller: add node deletion API (#8226)

2024-07-11 17:05:47 +01:00

test_storage_scrubber.py

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

test_subscriber_restart.py

Increase timeout for wating subscriber caught-up (#8118)

2024-07-05 20:39:10 +03:00

test_subxacts.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_tenant_conf.py

pageserver: exclude un-read layers from short residence statistic (#8396)

2024-07-16 20:55:29 +01:00

test_tenant_delete.py

storage scrubber: GC ancestor shard layers (#8196)

2024-07-19 19:07:59 +03:00

test_tenant_detach.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

test_tenant_relocation.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-04 15:05:41 +01:00

test_tenant_size.py

tests: increase approx size equal threshold to avoid test_lsn_lease_size flakiness (#8282)

2024-07-08 21:50:13 +01:00

test_tenant_tasks.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants_with_remote_storage.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants.py

Avoid the storage controller in test_tenant_creation_fails (#8392)

2024-07-16 12:19:28 +02:00

test_threshold_based_eviction.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_timeline_delete.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_timeline_detach_ancestor.py

test: allow requests to any pageserver get cancelled (#8413)

2024-07-17 22:03:02 +01:00

test_timeline_size.py

tests: stabilize test_timeline_size_quota_on_startup (#8255)

2024-07-08 20:06:34 +00:00

test_truncate.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_twophase.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_unlogged.py

Extend test_unlogged to include a sequence

2024-05-21 09:18:11 -05:00

test_vm_bits.py

Another attempt at making test_vm_bits less flaky (#7989)

2024-06-12 09:18:52 +03:00

test_wal_acceptor_async.py

Evict WAL files from disk (#8022)

2024-06-26 18:58:56 +01:00

test_wal_acceptor.py

tests: fix metrics check in test_s3_eviction (#8419)

2024-07-18 10:14:56 +01:00

test_wal_receiver.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_wal_restore.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_walredo_not_left_behind_on_detach.py

pageserver: remove attach/detach apis (#8134)

2024-06-25 17:38:06 +01:00