Joonas Koivunen f4db85de40 Continued startup speedup (#4372) ...

Startup continues to be slow, work towards to alleviate it.

Summary of changes:

- pretty the functional improvements from #4366 into
`utils::completion::{Completion, Barrier}`
- extend "initial load completion" usage up to tenant background tasks
    - previously only global background tasks
- spawn_blocking the tenant load directory traversal
- demote some logging
- remove some unwraps
- propagate some spans to `spawn_blocking`

Runtime effects should be major speedup to loading, but after that, the
`BACKGROUND_RUNTIME` will be blocked for a long time (minutes). Possible
follow-ups:
- complete initial tenant sizes before allowing background tasks to
block the `BACKGROUND_RUNTIME`

2023-05-30 16:25:07 +03:00

..

test_ancestor_branch.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_attach_tenant_config.py

attach-time tenant config (#4255)

2023-05-24 17:46:30 +03:00

test_auth.py

Make new tenant/timeline IDs mandatory in create APIs. (#4304)

2023-05-26 16:19:36 +03:00

test_backpressure.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_behind.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branching.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_broken_timeline.py

refactor TenantState transitions (#4321)

2023-05-29 17:52:41 +03:00

test_build_info_metric.py

tests: use parse_metrics everywhere (#3737)

2023-03-03 14:53:27 +01:00

test_clog_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_close_fds.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_compatibility.py

Re-enable compatibility tests on Postgres 15 (#4274)

2023-05-18 19:56:09 +01:00

test_compute_ctl.py

Enable hot standby PostgreSQL replicas.

2023-04-27 15:26:44 +02:00

test_config.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_crafted_wal_end.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_createdropdb.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_createuser.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_ddl_forwarding.py

Fix flakiness of test_metric_collection (#4346)

2023-05-26 00:05:11 +03:00

test_disk_usage_eviction.py

test: allow benign warning in relation to startup ordering (#4262)

2023-05-22 11:59:54 +03:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_gc_aggressive.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_gc_cutoff.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_hot_standby.py

Un-xfail fixed tests on Postgres 15 (#4275)

2023-05-18 22:38:33 +01:00

test_import.py

keep track of timeline deletion status in IndexPart to prevent timeline resurrection (#3919)

2023-05-10 10:27:12 +02:00

test_large_schema.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_layer_eviction.py

Remove wait_for_sk_commit_lsn_to_reach_remote_storage.

2023-04-26 13:46:33 +04:00

test_layer_writers_fail.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_logging.py

add libmetric metric for each logged log message (#4055)

2023-04-25 14:10:18 +02:00

test_lsn_mapping.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_metric_collection.py

Fix flakiness of test_metric_collection (#4346)

2023-05-26 00:05:11 +03:00

test_multixact.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_neon_cli.py

tests: make neon_fixtures a bit thinner by splitting out some pageserver related helpers (#3977)

2023-04-07 13:47:28 +03:00

test_neon_local_cli.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_next_xid.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_ondemand_download.py

ondemand_download_large_rel: solve flakyness (#3697)

2023-05-17 16:19:02 +02:00

test_pageserver_api.py

test_runner: add --pg-version pytest argument (#4037)

2023-05-05 02:57:47 +03:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_restart.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_restarts_under_workload.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_parallel_copy.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pg_regress.py

Un-xfail fixed tests on Postgres 15 (#4275)

2023-05-18 22:38:33 +01:00

test_pitr_gc.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_proxy.py

Add SQL-over-HTTP endpoint to Proxy

2023-05-23 20:01:40 +03:00

test_read_trace.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_read_validation.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_readonly_node.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_recovery.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_remote_storage.py

refactor TenantState transitions (#4321)

2023-05-29 17:52:41 +03:00

test_setup.py

Reorganize python tests.

2022-08-30 18:25:38 +03:00

test_sni_router.py

test_runner: update dependencies (#4328)

2023-05-24 12:47:01 +01:00

test_subxacts.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_tenant_conf.py

test_runner: update dependencies (#4328)

2023-05-24 12:47:01 +01:00

test_tenant_detach.py

refactor TenantState transitions (#4321)

2023-05-29 17:52:41 +03:00

test_tenant_relocation.py

upload new timeline index part json before 201 or on retry (#4204)

2023-05-15 14:16:43 +03:00

test_tenant_size.py

Run regressions tests on both Postgres 14 and 15 (#4192)

2023-05-12 15:28:51 +01:00

test_tenant_tasks.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_tenants_with_remote_storage.py

Remove wait_for_sk_commit_lsn_to_reach_remote_storage.

2023-04-26 13:46:33 +04:00

test_tenants.py

Continued startup speedup (#4372)

2023-05-30 16:25:07 +03:00

test_threshold_based_eviction.py

eviction: regression test + distinguish layer write from map insert (#4005)

2023-05-04 16:16:48 +02:00

test_timeline_delete.py

Don't allow two timeline_delete operations to run concurrently. (#4313)

2023-05-27 15:55:43 +03:00

test_timeline_size.py

test_runner: add --pg-version pytest argument (#4037)

2023-05-05 02:57:47 +03:00

test_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_twophase.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_unlogged.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_vm_bits.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_wal_acceptor_async.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_wal_acceptor.py

test_runner: add --pg-version pytest argument (#4037)

2023-05-05 02:57:47 +03:00

test_wal_receiver.py

Print WalReceiver context on WAL waiting timeout (#4090)

2023-05-03 16:25:19 +03:00

test_wal_restore.py

Run regressions tests on both Postgres 14 and 15 (#4192)

2023-05-12 15:28:51 +01:00

test_walredo_not_left_behind_on_detach.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00