Erik Grinaker e58e29e639 pageserver: limit number of upload queue tasks (#10384) ...

## Problem

The upload queue can currently schedule an arbitrary number of tasks.
This can both spawn an unbounded number of Tokio tasks, and also
significantly slow down upload queue scheduling as it's quadratic in
number of operations.

Touches #10096.

## Summary of changes

Limit the number of inprogress tasks to the remote storage upload
concurrency. While this concurrency limit is shared across all tenants,
there's certainly no point in scheduling more than this -- we could even
consider setting the limit lower, but don't for now to avoid
artificially constraining tenants.

2025-01-14 18:01:14 +00:00

..

src

pageserver: limit number of upload queue tasks (#10384)

2025-01-14 18:01:14 +00:00

tests

remote_storage: configurable connection pooling for ABS (#10169)

2024-12-17 12:24:51 +00:00

Cargo.toml

remote_storage: configurable connection pooling for ABS (#10169)

2024-12-17 12:24:51 +00:00