Conrad Ludgate 6987b5c44e proxy: add more rates to endpoint limiter (#6130) ...

## Problem

Single rate bucket is limited in usefulness

## Summary of changes

Introduce a secondary bucket allowing an average of 200 requests per
second over 1 minute, and a tertiary bucket allowing an average of 100
requests per second over 10 minutes.

Configured by using a format like

```sh
proxy --endpoint-rps-limit 300@1s --endpoint-rps-limit 100@10s --endpoint-rps-limit 50@1m
```

If the bucket limits are inconsistent, an error is returned on startup

```
$ proxy --endpoint-rps-limit 300@1s --endpoint-rps-limit 10@10s
Error: invalid endpoint RPS limits. 10@10s allows fewer requests per bucket than 300@1s (100 vs 300)
```

2023-12-13 21:43:49 +00:00

..

aimd.rs

Proxy control plane rate limiter (#5785)

2023-11-15 09:15:59 +00:00

limit_algorithm.rs

Proxy control plane rate limiter (#5785)

2023-11-15 09:15:59 +00:00

limiter.rs

proxy: add more rates to endpoint limiter (#6130)

2023-12-13 21:43:49 +00:00