Erik Grinaker abcd00181c pageserver: set a concurrency limit for LocalFS (#10676) ...

## Problem

The local filesystem backend for remote storage doesn't set a
concurrency limit. While it can't/won't enforce a concurrency limit
itself, this also bounds the upload queue concurrency. Some tests create
thousands of uploads, which slows down the quadratic scheduling of the
upload queue, and there is no point spawning that many Tokio tasks.

Resolves #10409.

## Summary of changes

Set a concurrency limit of 100 for the LocalFS backend.

Before: `test_layer_map[release-pg17].test_query: 68.338 s`
After: `test_layer_map[release-pg17].test_query: 5.209 s`

2025-02-06 07:24:36 +00:00

..

src

pageserver: set a concurrency limit for LocalFS (#10676)

2025-02-06 07:24:36 +00:00

tests

remote_storage: configurable connection pooling for ABS (#10169)

2024-12-17 12:24:51 +00:00

Cargo.toml

remote_storage: configurable connection pooling for ABS (#10169)

2024-12-17 12:24:51 +00:00