John Spray c84656a53e pageserver: implement auto-splitting (#7681) ...

## Problem

Currently tenants are only split into multiple shards if a human being
calls the API to do it.

Issue: #7388 

## Summary of changes

- Add a pageserver API for returning the top tenants by size
- Add a step to the controller's background loop where if there is no
reconciliation or optimization to be done, it looks for things to split.
- Add a test that runs pgbench on many tenants concurrently, and checks
that splitting happens as expected as tenants grow, without interrupting
the client I/O.

This PR is quite basic: there is a tasklist in
https://github.com/neondatabase/neon/issues/7388 for further work. This
PR is meant to be safe (off by default), and sufficient to enable our
staging environment to run lots of sharded tenants without a human
having to set them up.

2024-05-17 16:01:24 +00:00

..

src

pageserver: implement auto-splitting (#7681)

2024-05-17 16:01:24 +00:00

Cargo.toml

add a Rust client for Pageserver page_service (#6128)

2023-12-18 18:17:19 +00:00