Vlad Lazar d7662fdc7b feat(page_service): timeout-based batching of requests (#9321) ...

## Problem

We don't take advantage of queue depth generated by the compute
on the pageserver. We can process getpage requests more efficiently
by batching them. 

## Summary of changes

Batch up incoming getpage requests that arrive within a configurable
time window (`server_side_batch_timeout`).
Then process the entire batch via one `get_vectored` timeline operation.
By default, no merging takes place.

## Testing

* **Functional**: https://github.com/neondatabase/neon/pull/9792
* **Performance**: will be done in staging/pre-prod

# Refs

* https://github.com/neondatabase/neon/issues/9377
* https://github.com/neondatabase/neon/issues/9376

Co-authored-by: Christian Schwarz <christian@neon.tech>

2024-11-18 20:24:03 +00:00

..

src

feat(page_service): timeout-based batching of requests (#9321)

2024-11-18 20:24:03 +00:00

tests

remove aws-lc-rs dep and fix storage_broker tls (#9613)

2024-11-04 13:29:13 +00:00

Cargo.toml

Remove unnecessary dependencies (#9000)

2024-09-17 17:55:45 +03:00