John Spray 1ea5d8b132 tests: accomodate some messages that can fail tests (#8144) ...

## Problem

- `test_storage_controller_many_tenants` can fail with warnings in the
storage controller about tenant creation holding a lock for too long,
because this test stresses the machine running the test with many
concurrent timeline creations
- `test_tenant_delete_smoke` can fail when synthetic remote storage
errors show up

## Summary of changes

- tolerate warnings about slow timeline creation in
test_storage_controller_many_tenants
- tolerate both possible errors during error_tolerant_delete

2024-06-24 17:03:53 +00:00

..

data/extension_test/5670669815

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_ancestor_branch.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_attach_tenant_config.py

feat(pageserver): use leases to temporarily block gc (#8084)

2024-06-18 17:37:06 +00:00

test_auth.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_aux_files.py

chore(pageserver): use kebab case for aux file flag (#7840)

2024-05-22 17:06:00 +00:00

test_backpressure.py

Revert "pageserver: use a single tokio runtime (#6555)" (#7246)

2024-03-26 15:24:18 +01:00

test_bad_connection.py

Add retry loops and bump test timeout in test_pageserver_connection_stress (#7281)

2024-05-01 21:36:50 -07:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_branch_behind.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_branching.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_broken_timeline.py

pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752)

2024-05-15 12:05:24 +00:00

test_build_info_metric.py

feat: add build_tag env support for set_build_info_metric (#5576)

2023-10-27 10:47:11 +01:00

test_change_pageserver.py

tests/neon_local: rename "attachment service" -> "storage controller" (#7087)

2024-03-12 11:36:27 +00:00

test_clog_truncate.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_close_fds.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_compaction.py

fix(pageserver): abort on duplicate layers, before doing damage (#7799)

2024-06-04 16:16:23 +00:00

test_compatibility.py

chore(test): add version check for forward compat test (#7685)

2024-05-14 10:36:48 -04:00

test_compute_catalog.py

compute_ctl: catalog API endpoints (#7575)

2024-05-16 12:04:16 +02:00

test_config.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_crafted_wal_end.py

Allow bad state (not active) pageserver error/warns in walcraft test.

2024-05-06 06:45:27 +03:00

test_createdropdb.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_createuser.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_ddl_forwarding.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_disk_usage_eviction.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_download_extensions.py

Use test specific directory in test_remote_extensions (#5938)

2023-11-27 18:57:58 +00:00

test_explain_with_lfc_stats.py

new test for LFC stats in explain (#6968)

2024-03-01 14:33:08 +00:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

refactor(test): duplication with fullbackup, tar content hashing (#7828)

2024-05-22 15:43:21 +03:00

test_gc_aggressive.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_gin_redo.py

Do not produce error if gin page is not restored in redo (#7876)

2024-05-29 22:18:09 +03:00

test_hot_standby.py

Fix test_replica_query_race flakiness (#8038)

2024-06-14 11:51:12 +03:00

test_import.py

test_import_from_pageserver_small: try to make less flaky (#7843)

2024-05-23 14:44:08 +03:00

test_ingestion_layer_size.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_large_schema.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_bloating.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_eviction.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_layer_writers_fail.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_layers_from_future.py

fix: stop storing TimelineMetadata in index_part.json as bytes (#7699)

2024-06-11 15:38:54 +03:00

test_lfc_resize.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_lfc_working_set_approximation.py

Testcase for neon extension function approximate_working_set_size() (#6980)

2024-03-01 13:29:08 +01:00

test_local_file_cache.py

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

test_logging.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_logical_replication.py

Add On-demand WAL Download to logicalfuncs (#7960)

2024-06-11 17:59:32 -07:00

test_lsn_mapping.py

refactor(pageserver): designated api error type for cancelled request (#7949)

2024-06-06 14:00:14 +00:00

test_migrations.py

Simplify scanning compute logs in tests (#7997)

2024-06-10 12:52:49 +00:00

test_multixact.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_neon_cli.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_neon_extension.py

spec: allow neon extension auto-upgrade + softfail upgrade (#7231)

2024-03-28 17:22:35 +00:00

test_neon_local_cli.py

fix(test suite): some tests leak child processes (#6497)

2024-01-26 18:23:53 +00:00

test_neon_superuser.py

fix(test): drop subscription when test completes (#6975)

2024-03-06 15:52:24 +00:00

test_next_xid.py

refactor(test): duplication with fullbackup, tar content hashing (#7828)

2024-05-22 15:43:21 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_ondemand_download.py

test: no missed wakeups, cancellation and timeout flow to downloads (#7863)

2024-06-04 14:19:36 +03:00

test_ondemand_slru_download.py

Fix on-demand SLRU download on standby starting at WAL segment boundary (#8031)

2024-06-13 00:31:31 +03:00

test_pageserver_api.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_crash_consistency.py

test_local_only_layers_after_crash: various fixes (#7986)

2024-06-07 10:18:05 +03:00

test_pageserver_generations.py

Rename S3 scrubber to storage scrubber (#8013)

2024-06-11 22:45:22 +00:00

test_pageserver_getpage_throttle.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_pageserver_layer_rolling.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_pageserver_metric_collection.py

pageserver: eliminate CalculateSyntheticSizeError::LsnNotFound (test_metric_collection flake) (#8065)

2024-06-18 13:44:30 +01:00

test_pageserver_reconnect.py

Implement lockless update of pageserver_connstring GUC in shared memory (#6314)

2024-01-23 07:55:05 +02:00

test_pageserver_restart.py

fix(pageserver): abort on duplicate layers, before doing damage (#7799)

2024-06-04 16:16:23 +00:00

test_pageserver_restarts_under_workload.py

pageserver: improve the shutdown log error (#5792)

2023-11-07 16:57:26 +00:00

test_pageserver_secondary.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_parallel_copy.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_pg_query_cancellation.py

Rework PageStream connection state handling: (#7611)

2024-05-23 23:26:42 +02:00

test_pg_regress.py

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

test_pg_waldump.py

pg_waldump segment on safekeeper in test_pg_waldump.

2024-05-06 07:18:38 +03:00

test_physical_replication.py

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

test_pitr_gc.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_postgres_version.py

Add Postgres commit sha to Postgres version (#4603)

2024-05-07 15:18:17 +00:00

test_proxy_allowed_ips.py

proxy: include client IP in ip deny message (#6854)

2024-02-21 18:24:59 +01:00

test_proxy_metric_collection.py

refactor(test_consumption_metrics): split for pageserver and proxy (#5324)

2023-09-16 18:05:35 +03:00

test_proxy_websockets.py

proxy: swap tungstenite for a simpler impl (#7353)

2024-05-16 13:05:50 +02:00

test_proxy.py

proxy: update tokio-postgres to allow arbitrary config params (#8076)

2024-06-24 10:20:27 +00:00

test_read_trace.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_read_validation.py

Refactor how the request LSNs are tracked in compute (#7377)

2024-04-25 20:45:37 +03:00

test_readonly_node.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_recovery.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_remote_storage.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_replication_start.py

fixup(#7204 / postgres): revert IsPrimaryAlive checks (#7209)

2024-03-23 01:01:51 +00:00

test_s3_restore.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sharding.py

tests: fix a flake in test_sharding_split_compaction (#8136)

2024-06-24 14:54:54 +01:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_storage_controller.py

storcon: implement endpoints for cancellation of drain and fill operations (#8029)

2024-06-21 17:13:51 +01:00

test_storage_scrubber.py

Rename S3 scrubber to storage scrubber (#8013)

2024-06-11 22:45:22 +00:00

test_subscriber_restart.py

Store logical replication origin in KV storage (#7099)

2024-06-03 19:37:33 +03:00

test_subxacts.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_tenant_conf.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_tenant_delete.py

tests: accomodate some messages that can fail tests (#8144)

2024-06-24 17:03:53 +00:00

test_tenant_detach.py

pageserver: remove unused load/ignore APIs (#8122)

2024-06-21 10:02:15 +00:00

test_tenant_relocation.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_tenant_size.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_tenant_tasks.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants_with_remote_storage.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_threshold_based_eviction.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_timeline_delete.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_timeline_detach_ancestor.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_timeline_size.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_truncate.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_twophase.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_unlogged.py

Extend test_unlogged to include a sequence

2024-05-21 09:18:11 -05:00

test_vm_bits.py

Another attempt at making test_vm_bits less flaky (#7989)

2024-06-12 09:18:52 +03:00

test_wal_acceptor_async.py

Fix test_segment_init_failure.

2024-06-14 14:24:15 +03:00

test_wal_acceptor.py

Make pull_timeline work with auth enabled.

2024-06-18 15:45:39 +03:00

test_wal_receiver.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_wal_restore.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_walredo_not_left_behind_on_detach.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00