John Spray 7cfaecbeb6 tests: stabilize test_timeline_size_quota_on_startup (#8255) ...

## Problem

`test_timeline_size_quota_on_startup` assumed that writing data beyond
the size limit would always be blocked. This is not so: the limit is
only enforced if feedback makes it back from the pageserver to the
safekeeper + compute.

Closes: https://github.com/neondatabase/neon/issues/6562

## Summary of changes

- Modify the test to wait for the pageserver to catch up. The size limit
was never actually being enforced robustly, the original version of this
test was just writing much more than 30MB and about 98% of the time
getting lucky such that the feedback happened to arrive before the tests
for loop was done.
- If the test fails, log the logical size as seen by the pageserver.

2024-07-15 09:28:35 -04:00

..

data/extension_test/5670669815

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_ancestor_branch.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_attach_tenant_config.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_auth.py

page_service: stop exposing get_last_record_rlsn (#8244)

2024-07-08 17:22:35 +01:00

test_aux_files.py

chore(pageserver): use kebab case for aux file flag (#7840)

2024-05-22 17:06:00 +00:00

test_backpressure.py

Revert "pageserver: use a single tokio runtime (#6555)" (#7246)

2024-03-26 15:24:18 +01:00

test_bad_connection.py

Add retry loops and bump test timeout in test_pageserver_connection_stress (#7281)

2024-05-01 21:36:50 -07:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_branch_behind.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_branching.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_broken_timeline.py

pageserver: remove Option<> around remote storage, clean up metadata file refs (#7752)

2024-05-15 12:05:24 +00:00

test_build_info_metric.py

feat: add build_tag env support for set_build_info_metric (#5576)

2023-10-27 10:47:11 +01:00

test_change_pageserver.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_clog_truncate.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_close_fds.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_compaction.py

fix(pageserver): abort on duplicate layers, before doing damage (#7799)

2024-06-04 16:16:23 +00:00

test_compatibility.py

chore(test): add version check for forward compat test (#7685)

2024-05-14 10:36:48 -04:00

test_compute_catalog.py

compute_ctl: catalog API endpoints (#7575)

2024-05-16 12:04:16 +02:00

test_config.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_crafted_wal_end.py

Allow bad state (not active) pageserver error/warns in walcraft test.

2024-05-06 06:45:27 +03:00

test_createdropdb.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_createuser.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_ddl_forwarding.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_disk_usage_eviction.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_download_extensions.py

Use test specific directory in test_remote_extensions (#5938)

2023-11-27 18:57:58 +00:00

test_endpoint_crash.py

SELECT 💣(); (#8270)

2024-07-08 17:22:36 +01:00

test_explain_with_lfc_stats.py

new test for LFC stats in explain (#6968)

2024-03-01 14:33:08 +00:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

refactor(test): duplication with fullbackup, tar content hashing (#7828)

2024-05-22 15:43:21 +03:00

test_gc_aggressive.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_gin_redo.py

Do not produce error if gin page is not restored in redo (#7876)

2024-05-29 22:18:09 +03:00

test_hot_standby.py

Fix test_replica_query_race flakiness (#8038)

2024-06-14 11:51:12 +03:00

test_import.py

test: Add helper function for importing a Postgres cluster (#8025)

2024-06-26 21:54:29 +00:00

test_ingestion_layer_size.py

fix: allow layer flushes more often (#7927)

2024-06-10 13:50:17 +00:00

test_large_schema.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_bloating.py

test_runner: replace all .format() with f-strings (#7194)

2024-04-02 14:32:14 +01:00

test_layer_eviction.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_layer_writers_fail.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_layers_from_future.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_lfc_resize.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_lfc_working_set_approximation.py

implement rolling hyper-log-log algorithm (#8068)

2024-07-08 17:22:35 +01:00

test_local_file_cache.py

remove materialized page cache (#8105)

2024-06-20 11:56:14 +02:00

test_logging.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_logical_replication.py

Simplify test_wal_page_boundary_start test (#8214)

2024-07-08 17:22:35 +01:00

test_lsn_mapping.py

feat(pageserver): add an optional lease to the get_lsn_by_timestamp API (#8104)

2024-06-24 20:12:24 +00:00

test_migrations.py

Simplify scanning compute logs in tests (#7997)

2024-06-10 12:52:49 +00:00

test_multixact.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_neon_cli.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_neon_extension.py

implement rolling hyper-log-log algorithm (#8068)

2024-07-08 17:22:35 +01:00

test_neon_local_cli.py

fix(test suite): some tests leak child processes (#6497)

2024-01-26 18:23:53 +00:00

test_neon_superuser.py

fix(test): drop subscription when test completes (#6975)

2024-03-06 15:52:24 +00:00

test_next_xid.py

Fix tracking of the nextMulti in the pageserver's copy of CheckPoint (#6528)

2024-07-01 01:49:49 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_ondemand_download.py

test: no missed wakeups, cancellation and timeout flow to downloads (#7863)

2024-06-04 14:19:36 +03:00

test_ondemand_slru_download.py

Fix on-demand SLRU download on standby starting at WAL segment boundary (#8031)

2024-06-13 00:31:31 +03:00

test_pageserver_api.py

pageserver: remove tenant create API (#8135)

2024-06-28 09:14:19 +01:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_crash_consistency.py

test_local_only_layers_after_crash: various fixes (#7986)

2024-06-07 10:18:05 +03:00

test_pageserver_generations.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_pageserver_getpage_throttle.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_pageserver_layer_rolling.py

test(detach_ancestor): ensure L0 compaction in history is ok (#7813)

2024-05-21 20:08:43 +03:00

test_pageserver_metric_collection.py

pageserver: eliminate CalculateSyntheticSizeError::LsnNotFound (test_metric_collection flake) (#8065)

2024-06-18 13:44:30 +01:00

test_pageserver_reconnect.py

Add test for proper handling of connection failure to avoid 'cannot wait on socket event without a socket' error (#8231)

2024-07-08 17:22:35 +01:00

test_pageserver_restart.py

fix(pageserver): abort on duplicate layers, before doing damage (#7799)

2024-06-04 16:16:23 +00:00

test_pageserver_restarts_under_workload.py

pageserver: improve the shutdown log error (#5792)

2023-11-07 16:57:26 +00:00

test_pageserver_secondary.py

tests: make location_conf_churn more robust (#8271)

2024-07-08 17:22:35 +01:00

test_parallel_copy.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_pg_query_cancellation.py

Rework PageStream connection state handling: (#7611)

2024-05-23 23:26:42 +02:00

test_pg_regress.py

tests: use smaller layers in test_pg_regress (#8232)

2024-07-15 09:28:35 -04:00

test_pg_waldump.py

pg_waldump segment on safekeeper in test_pg_waldump.

2024-05-06 07:18:38 +03:00

test_physical_replication.py

Hide import behind TYPE_CHECKING

2024-07-15 09:28:35 -04:00

test_pitr_gc.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_postgres_version.py

Add Postgres commit sha to Postgres version (#4603)

2024-05-07 15:18:17 +00:00

test_proxy_allowed_ips.py

proxy: include client IP in ip deny message (#6854)

2024-02-21 18:24:59 +01:00

test_proxy_metric_collection.py

refactor(test_consumption_metrics): split for pageserver and proxy (#5324)

2023-09-16 18:05:35 +03:00

test_proxy_websockets.py

proxy: swap tungstenite for a simpler impl (#7353)

2024-05-16 13:05:50 +02:00

test_proxy.py

proxy: update tokio-postgres to allow arbitrary config params (#8076)

2024-06-24 10:20:27 +00:00

test_read_trace.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_read_validation.py

Refactor how the request LSNs are tracked in compute (#7377)

2024-04-25 20:45:37 +03:00

test_readonly_node.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_recovery.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_remote_storage.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_replica_start.py

Restore running xacts from CLOG on replica startup (#7288)

2024-07-04 18:58:34 +03:00

test_s3_restore.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sharding.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_storage_controller.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_storage_scrubber.py

Rename S3 scrubber to storage scrubber (#8013)

2024-06-11 22:45:22 +00:00

test_subscriber_restart.py

Increase timeout for wating subscriber caught-up (#8118)

2024-07-08 17:22:36 +01:00

test_subxacts.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_tenant_conf.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_tenant_delete.py

tests: extend allow list in deletion test (#8268)

2024-07-08 17:22:35 +01:00

test_tenant_detach.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_tenant_relocation.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_tenant_size.py

feat(pageserver): integrate lsn lease into synthetic size (#8220)

2024-07-08 17:22:35 +01:00

test_tenant_tasks.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants_with_remote_storage.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_tenants.py

pageserver: downgrade stale generation messages to INFO (#8256)

2024-07-08 17:22:35 +01:00

test_threshold_based_eviction.py

tests: add optional cursor to log_contains + fix truthiness issues in callers (#6960)

2024-03-01 10:45:39 +01:00

test_timeline_delete.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_timeline_detach_ancestor.py

pageserver: always detach before deleting (#8082)

2024-06-21 15:39:19 +01:00

test_timeline_size.py

tests: stabilize test_timeline_size_quota_on_startup (#8255)

2024-07-15 09:28:35 -04:00

test_truncate.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_twophase.py

tests: Remove "postgres is running on ... branch" messages

2024-02-11 01:34:31 +02:00

test_unlogged.py

Extend test_unlogged to include a sequence

2024-05-21 09:18:11 -05:00

test_vm_bits.py

Another attempt at making test_vm_bits less flaky (#7989)

2024-06-12 09:18:52 +03:00

test_wal_acceptor_async.py

Evict WAL files from disk (#8022)

2024-06-26 18:58:56 +01:00

test_wal_acceptor.py

Allow to change compute safekeeper list without restart.

2024-06-27 15:08:35 +03:00

test_wal_receiver.py

test_suite: patch, don't replace, the tenant_config field, where appropriate (#7771)

2024-05-17 12:24:02 +02:00

test_wal_restore.py

python: allow using allowed_errors.py (#7719)

2024-05-13 15:16:23 +03:00

test_walredo_not_left_behind_on_detach.py

pageserver: remove attach/detach apis (#8134)

2024-06-25 17:38:06 +01:00