Joonas Koivunen f902777202 fix: consumption metrics on restart (#5323) ...

Write collected metrics to disk to recover previously sent metrics on
restart.

Recover the previously collected metrics during startup, send them over
at right time
  - send cached synthetic size before actual is calculated
  - when `last_record_lsn` rolls back on startup
      - stay at last sent `written_size` metric
      - send `written_size_delta_bytes` metric as 0

Add test support: stateful verification of events in python tests.

Fixes: #5206
Cc: #5175 (loggings, will be enhanced in follow-up)

2023-09-16 11:24:42 +03:00

..

data/extension_test/5670669815

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_ancestor_branch.py

make flush frozen layer an atomic operation (#4720)

2023-07-20 13:39:19 -04:00

test_attach_tenant_config.py

test: Remote storage refactorings (#5243)

2023-09-08 13:54:23 +03:00

test_auth.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_backpressure.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

timeline creation: reflect failures due to ancestor LSN issues in status code (#4600)

2023-07-03 15:21:10 +03:00

test_branch_behind.py

timeline creation: reflect failures due to ancestor LSN issues in status code (#4600)

2023-07-03 15:21:10 +03:00

test_branching.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_broken_timeline.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_build_info_metric.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_clog_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_close_fds.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_compatibility.py

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_config.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_crafted_wal_end.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_createdropdb.py

Add a test case for "CREATE DATABASE STRATEGY=file_copy". (#5301)

2023-09-15 16:50:57 +03:00

test_createuser.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_ddl_forwarding.py

refactor: globals in tests (#5298)

2023-09-13 22:05:30 +03:00

test_disk_usage_eviction.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_download_extensions.py

Feat/postgres 16 (#4761)

2023-09-12 15:11:32 +02:00

test_duplicate_layers.py

tests: enable higher concurrency and adjust tests with outlier runtime (#4904)

2023-08-08 09:16:21 +01:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_gc_aggressive.py

refactor: globals in tests (#5298)

2023-09-13 22:05:30 +03:00

test_gc_cutoff.py

refactor: failpoint support (#5033)

2023-08-19 01:01:44 +03:00

test_hot_standby.py

test_runner: remove excessive timeouts (#4659)

2023-08-09 16:27:53 +01:00

test_import.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_large_schema.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_layer_eviction.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_layer_writers_fail.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_logging.py

add libmetric metric for each logged log message (#4055)

2023-04-25 14:10:18 +02:00

test_lsn_mapping.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_metric_collection.py

fix: consumption metrics on restart (#5323)

2023-09-16 11:24:42 +03:00

test_multixact.py

Mx offset bug (#4775)

2023-07-21 21:20:53 +03:00

test_neon_cli.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_neon_local_cli.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_next_xid.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_ondemand_download.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_pageserver_api.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_restart.py

test: Remote storage refactorings (#5243)

2023-09-08 13:54:23 +03:00

test_pageserver_restarts_under_workload.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_parallel_copy.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_pg_regress.py

test: make pg_regress less flaky, hopefully (#4903)

2023-08-10 15:24:43 +03:00

test_pitr_gc.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_proxy.py

proxy http: reproduce issue with transactions in pool (#5293)

2023-09-12 17:13:25 -04:00

test_read_trace.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_read_validation.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_readonly_node.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_recovery.py

fix: demote warnings, fix flakyness (#4837)

2023-07-31 07:43:12 +00:00

test_remote_storage.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_subxacts.py

test: make pg_regress less flaky, hopefully (#4903)

2023-08-10 15:24:43 +03:00

test_tenant_conf.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_tenant_delete.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_tenant_detach.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_tenant_relocation.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_tenant_size.py

Misc test flakyness fixes (#5233)

2023-09-11 11:42:49 +03:00

test_tenant_tasks.py

propagate lock guard to background deletion task (#4495)

2023-06-15 17:30:12 +03:00

test_tenants_with_remote_storage.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_tenants.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_threshold_based_eviction.py

fix(consumption_metrics): exp backoff retry (#5317)

2023-09-16 01:11:01 +03:00

test_timeline_delete.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_timeline_size.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00

test_truncate.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_twophase.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_unlogged.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_vm_bits.py

Handle update of VM in XLOG_HEAP_LOCK/XLOG_HEAP2_LOCK_UPDATED WAL records (#4896)

2023-09-15 17:47:29 +03:00

test_wal_acceptor_async.py

tests: enable higher concurrency and adjust tests with outlier runtime (#4904)

2023-08-08 09:16:21 +01:00

test_wal_acceptor.py

refactor: globals in tests (#5298)

2023-09-13 22:05:30 +03:00

test_wal_receiver.py

Raise pageserver walreceiver timeouts.

2023-06-19 15:59:38 +04:00

test_wal_restore.py

tests: enable multiple pageservers in neon_local and neon_fixture (#5231)

2023-09-08 16:19:57 +01:00

test_walredo_not_left_behind_on_detach.py

Move tenant & timeline dir method to NeonPageserver and use them everywhere (#5262)

2023-09-15 11:17:18 +01:00