John Spray de9bf2af6c tests: fix metrics check in test_s3_eviction (#8419) ...

## Problem

This test would occasionally fail its metric check. This could happen in
the rare case that the nodes had all been restarted before their most
recent eviction.

The metric check was added in
https://github.com/neondatabase/neon/pull/8348

## Summary of changes

- Check metrics before each restart, accumulate into a bool that we
assert on at the end of the test

2024-07-22 14:36:56 +02:00

..

data/extension_test/5670669815

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_ancestor_branch.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_attach_tenant_config.py

pageserver: remove trace_read_requests (#8338)

2024-07-15 09:28:35 -04:00

test_auth.py

remove page_service show <tenant_id> (#8372)

2024-07-22 14:36:56 +02:00

test_aux_files.py

chore(pageserver): use kebab case for aux file flag (#7840)

2024-05-22 17:06:00 +00:00

test_backpressure.py

Revert "pageserver: use a single tokio runtime (#6555)" (#7246)

2024-03-26 15:24:18 +01:00

test_bad_connection.py

Add retry loops and bump test timeout in test_pageserver_connection_stress (#7281)

2024-05-01 21:36:50 -07:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

pageserver: use PITR GC cutoffs as authoritative (#8365)

2024-07-22 14:36:56 +02:00

test_branch_behind.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_branching.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_broken_timeline.py

pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752)

2024-05-15 12:05:24 +00:00

test_build_info_metric.py

feat: add build_tag env support for set_build_info_metric (#5576)

2023-10-27 10:47:11 +01:00

test_change_pageserver.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_clog_truncate.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_close_fds.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_compaction.py

pageserver: circuit breaker on compaction (#8359)

2024-07-15 09:28:35 -04:00

test_compatibility.py

NeonEnv.from_repo_dir: use storage_controller_db instead of attachments.json (#8382)

2024-07-22 14:36:56 +02:00

test_compute_catalog.py

compute_ctl: catalog API endpoints (#7575)

2024-05-16 12:04:16 +02:00

test_config.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_crafted_wal_end.py

Allow bad state (not active) pageserver error/warns in walcraft test.

2024-05-06 06:45:27 +03:00

test_createdropdb.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_createuser.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_ddl_forwarding.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_disk_usage_eviction.py

tests: allow list breaching min resident size in statvfs test (#8358)

2024-07-15 09:28:35 -04:00

test_download_extensions.py

Use test specific directory in test_remote_extensions (#5938)

2023-11-27 18:57:58 +00:00

test_endpoint_crash.py

SELECT 💣(); (#8270)

2024-07-08 17:22:36 +01:00

test_explain_with_lfc_stats.py

new test for LFC stats in explain (#6968)

2024-03-01 14:33:08 +00:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

refactor(test): duplication with fullbackup, tar content hashing (#7828)

2024-05-22 15:43:21 +03:00

test_gc_aggressive.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_gin_redo.py

Do not produce error if gin page is not restored in redo (#7876)

2024-05-29 22:18:09 +03:00

test_hot_standby.py

Fix test_replica_query_race flakiness (#8038)

2024-06-14 11:51:12 +03:00

test_import.py

pageserver: move page_service's import basebackup / import wal to mgmt API (#8292)

2024-07-15 09:28:35 -04:00

test_ingestion_layer_size.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_large_schema.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_bloating.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_eviction.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_layer_writers_fail.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_layers_from_future.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_lfc_resize.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_lfc_working_set_approximation.py

implement rolling hyper-log-log algorithm (#8068)

2024-07-08 17:22:35 +01:00

test_local_file_cache.py

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

test_logging.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_logical_replication.py

Fix memory context of NeonWALReader allocation.

2024-07-15 09:28:35 -04:00

test_lsn_mapping.py

feat(pageserver): add an optional lease to the get_lsn_by_timestamp API (#8104)

2024-06-24 20:12:24 +00:00

test_migrations.py

Hide import behind TYPE_CHECKING

2024-07-22 14:36:56 +02:00

test_multixact.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_neon_cli.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_neon_extension.py

implement rolling hyper-log-log algorithm (#8068)

2024-07-08 17:22:35 +01:00

test_neon_local_cli.py

fix(test suite): some tests leak child processes (#6497)

2024-01-26 18:23:53 +00:00

test_neon_superuser.py

fix(test): drop subscription when test completes (#6975)

2024-03-06 15:52:24 +00:00

test_next_xid.py

Fix tracking of the nextMulti in the pageserver's copy of CheckPoint (#6528)

2024-07-01 01:49:49 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_ondemand_download.py

test: limit test_layer_download_timeouted to MOCK_S3 (#8331)

2024-07-15 09:28:35 -04:00

test_ondemand_slru_download.py

Fix on-demand SLRU download on standby starting at WAL segment boundary (#8031)

2024-06-13 00:31:31 +03:00

test_pageserver_api.py

pageserver: remove tenant create API (#8135)

2024-06-28 09:14:19 +01:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_crash_consistency.py

test_local_only_layers_after_crash: various fixes (#7986)

2024-06-07 10:18:05 +03:00

test_pageserver_generations.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_pageserver_getpage_throttle.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_pageserver_layer_rolling.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_pageserver_metric_collection.py

pageserver: eliminate CalculateSyntheticSizeError::LsnNotFound (test_metric_collection flake) (#8065)

2024-06-18 13:44:30 +01:00

test_pageserver_reconnect.py

Add test for proper handling of connection failure to avoid 'cannot wait on socket event without a socket' error (#8231)

2024-07-08 17:22:35 +01:00

test_pageserver_restart.py

fix(pageserver): abort on duplicate layers, before doing damage (#7799)

2024-06-04 16:16:23 +00:00

test_pageserver_restarts_under_workload.py

pageserver: improve the shutdown log error (#5792)

2023-11-07 16:57:26 +00:00

test_pageserver_secondary.py

tests: make location_conf_churn more robust (#8271)

2024-07-08 17:22:35 +01:00

test_parallel_copy.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_pg_query_cancellation.py

Rework PageStream connection state handling: (#7611)

2024-05-23 23:26:42 +02:00

test_pg_regress.py

tests: use smaller layers in test_pg_regress (#8232)

2024-07-15 09:28:35 -04:00

test_pg_waldump.py

pg_waldump segment on safekeeper in test_pg_waldump.

2024-05-06 07:18:38 +03:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-15 09:28:35 -04:00

test_pitr_gc.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_postgres_version.py

Add Postgres commit sha to Postgres version (#4603)

2024-05-07 15:18:17 +00:00

test_proxy_allowed_ips.py

proxy: include client IP in ip deny message (#6854)

2024-02-21 18:24:59 +01:00

test_proxy_metric_collection.py

refactor(test_consumption_metrics): split for pageserver and proxy (#5324)

2023-09-16 18:05:35 +03:00

test_proxy_websockets.py

proxy: swap tungstenite for a simpler impl (#7353)

2024-05-16 13:05:50 +02:00

test_proxy.py

proxy: update tokio-postgres to allow arbitrary config params (#8076)

2024-06-24 10:20:27 +00:00

test_read_validation.py

Refactor how the request LSNs are tracked in compute (#7377)

2024-04-25 20:45:37 +03:00

test_readonly_node.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_recovery.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_remote_storage.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_replica_start.py

Add neon.running_xacts_overflow_policy to make it possible for RO replica to startup without primary even in case running xacts overflow (#8323)

2024-07-15 09:34:35 -04:00

test_s3_restore.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sharding.py

tests: stabilize test_sharding_split_compaction (#8318)

2024-07-15 09:28:35 -04:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_storage_controller.py

storage controller: add node deletion API (#8226)

2024-07-15 09:28:35 -04:00

test_storage_scrubber.py

Rename S3 scrubber to storage scrubber (#8013)

2024-06-11 22:45:22 +00:00

test_subscriber_restart.py

Increase timeout for wating subscriber caught-up (#8118)

2024-07-08 17:22:36 +01:00

test_subxacts.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_tenant_conf.py

pageserver: exclude un-read layers from short residence statistic (#8396)

2024-07-22 14:36:56 +02:00

test_tenant_delete.py

tests: extend allow list in deletion test (#8268)

2024-07-08 17:22:35 +01:00

test_tenant_detach.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_tenant_relocation.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_tenant_size.py

tests: increase approx size equal threshold to avoid test_lsn_lease_size flakiness (#8282)

2024-07-15 09:28:35 -04:00

test_tenant_tasks.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants_with_remote_storage.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants.py

Avoid the storage controller in test_tenant_creation_fails (#8392)

2024-07-22 14:36:56 +02:00

test_threshold_based_eviction.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_timeline_delete.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_timeline_detach_ancestor.py

test: allow requests to any pageserver get cancelled (#8413)

2024-07-22 14:36:56 +02:00

test_timeline_size.py

tests: stabilize test_timeline_size_quota_on_startup (#8255)

2024-07-15 09:28:35 -04:00

test_truncate.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_twophase.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_unlogged.py

Extend test_unlogged to include a sequence

2024-05-21 09:18:11 -05:00

test_vm_bits.py

Another attempt at making test_vm_bits less flaky (#7989)

2024-06-12 09:18:52 +03:00

test_wal_acceptor_async.py

Evict WAL files from disk (#8022)

2024-06-26 18:58:56 +01:00

test_wal_acceptor.py

tests: fix metrics check in test_s3_eviction (#8419)

2024-07-22 14:36:56 +02:00

test_wal_receiver.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_wal_restore.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_walredo_not_left_behind_on_detach.py

pageserver: remove attach/detach apis (#8134)

2024-06-25 17:38:06 +01:00