Conrad Ludgate 25934ec1ba proxy: reduce global conn pool contention (#4747) ...

## Problem

As documented, the global connection pool will be high contention.

## Summary of changes

Use DashMap rather than Mutex<HashMap>.

Of note, DashMap currently uses a RwLock internally, but it's partially
sharded to reduce contention by a factor of N. We could potentially use
flurry which is a port of Java's concurrent hashmap, but I have no good
understanding of it's performance characteristics. Dashmap is at least
equivalent to hashmap but less contention.

See the read heavy benchmark to analyse our expected performance
<https://github.com/xacrimon/conc-map-bench#ready-heavy>

I also spoke with the developer of dashmap recently, and they are
working on porting the implementation to use concurrent HAMT FWIW

2023-08-16 17:20:28 +01:00

..

data/extension_test/5670669815

Tar Remote Extensions (#4715)

2023-08-02 12:38:12 +03:00

test_ancestor_branch.py

make flush frozen layer an atomic operation (#4720)

2023-07-20 13:39:19 -04:00

test_attach_tenant_config.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_auth.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_backpressure.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_basebackup_error.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_branch_and_gc.py

timeline creation: reflect failures due to ancestor LSN issues in status code (#4600)

2023-07-03 15:21:10 +03:00

test_branch_behind.py

timeline creation: reflect failures due to ancestor LSN issues in status code (#4600)

2023-07-03 15:21:10 +03:00

test_branching.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_broken_timeline.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_build_info_metric.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_clog_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_close_fds.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_compatibility.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_config.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_crafted_wal_end.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_createdropdb.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_createuser.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_ddl_forwarding.py

Make control plane connector send encrypted password (#4607)

2023-06-30 14:17:44 -07:00

test_disk_usage_eviction.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_download_extensions.py

test: mark test_download_extensions.py skipped for now (#4948)

2023-08-10 11:05:27 +00:00

test_duplicate_layers.py

tests: enable higher concurrency and adjust tests with outlier runtime (#4904)

2023-08-08 09:16:21 +01:00

test_fsm_truncate.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_fullbackup.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_gc_aggressive.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_gc_cutoff.py

fix: demote warnings, fix flakyness (#4837)

2023-07-31 07:43:12 +00:00

test_hot_standby.py

test_runner: remove excessive timeouts (#4659)

2023-08-09 16:27:53 +01:00

test_import.py

test_runner: remove excessive timeouts (#4659)

2023-08-09 16:27:53 +01:00

test_large_schema.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_layer_eviction.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_layer_writers_fail.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_logging.py

add libmetric metric for each logged log message (#4055)

2023-04-25 14:10:18 +02:00

test_lsn_mapping.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_metric_collection.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_multixact.py

Mx offset bug (#4775)

2023-07-21 21:20:53 +03:00

test_neon_cli.py

Fix git-env version for PRs (#4641)

2023-07-10 20:01:01 +01:00

test_neon_local_cli.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_next_xid.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_normal_work.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_old_request_lsn.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_ondemand_download.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_pageserver_api.py

test_runner: add --pg-version pytest argument (#4037)

2023-05-05 02:57:47 +03:00

test_pageserver_catchup.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_pageserver_restart.py

pageserver: expose prometheus metrics for startup time (#4893)

2023-08-08 12:41:37 +03:00

test_pageserver_restarts_under_workload.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_parallel_copy.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_pg_regress.py

test: make pg_regress less flaky, hopefully (#4903)

2023-08-10 15:24:43 +03:00

test_pitr_gc.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_proxy.py

proxy: reduce global conn pool contention (#4747)

2023-08-16 17:20:28 +01:00

test_read_trace.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_read_validation.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_readonly_node.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_recovery.py

fix: demote warnings, fix flakyness (#4837)

2023-07-31 07:43:12 +00:00

test_remote_storage.py

Compaction: unify key and value reference vecs (#4888)

2023-08-16 18:27:18 +03:00

test_setup.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_sni_router.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_subxacts.py

test: make pg_regress less flaky, hopefully (#4903)

2023-08-10 15:24:43 +03:00

test_tenant_conf.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_tenant_delete.py

Harden retries on tenant/timeline deletion path. (#4973)

2023-08-14 17:16:49 +03:00

test_tenant_detach.py

Delete tenant's data from s3 (#4855)

2023-08-10 18:53:16 +03:00

test_tenant_relocation.py

tests: remove redundant wait_while (#4952)

2023-08-11 10:18:13 +03:00

test_tenant_size.py

quote_ident identifiers when creating neon_superuser (#4562)

2023-06-24 10:34:15 +03:00

test_tenant_tasks.py

propagate lock guard to background deletion task (#4495)

2023-06-15 17:30:12 +03:00

test_tenants_with_remote_storage.py

Correctly remove orphaned objects in RemoteTimelineClient::delete_all (#5000)

2023-08-16 17:31:16 +03:00

test_tenants.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_threshold_based_eviction.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_timeline_delete.py

Correctly remove orphaned objects in RemoteTimelineClient::delete_all (#5000)

2023-08-16 17:31:16 +03:00

test_timeline_size.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_truncate.py

python: more linting (#4734)

2023-07-18 12:56:40 +03:00

test_twophase.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_unlogged.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_vm_bits.py

Rename "Postgres nodes" in control_plane to endpoints.

2023-04-13 14:34:29 +03:00

test_wal_acceptor_async.py

tests: enable higher concurrency and adjust tests with outlier runtime (#4904)

2023-08-08 09:16:21 +01:00

test_wal_acceptor.py

Fix test_s3_wal_replay flakiness.

2023-08-16 12:57:43 +03:00

test_wal_receiver.py

Raise pageserver walreceiver timeouts.

2023-06-19 15:59:38 +04:00

test_wal_restore.py

tests: split neon_fixtures.py (#4871)

2023-08-03 17:20:24 +03:00

test_walredo_not_left_behind_on_detach.py

Use compute_ctl to manage Postgres in tests. (#3886)

2023-06-06 14:59:36 +01:00