mirror of
https://github.com/neondatabase/neon.git
synced 2026-01-14 00:42:54 +00:00
c8316b7a3f
## Problem 1. Using chrono for durations only is wasteful 2. The arc/mutex was not being utilised 3. Locking every shard in the dashmap every GC could cause latency spikes 4. More buckets ## Summary of changes 1. Use `Instant` instead of `NaiveTime`. 2. Remove the `Arc<Mutex<_>>` wrapper, utilising that dashmap entry returns mut access 3. Clear only a random shard, update gc interval accordingly 4. Multiple buckets can be checked before allowing access When I benchmarked the check function, it took on average 811ns when multithreaded over the course of 10 million checks.
8 lines
231 B
Rust
8 lines
231 B
Rust
mod aimd;
|
|
mod limit_algorithm;
|
|
mod limiter;
|
|
pub use aimd::Aimd;
|
|
pub use limit_algorithm::{AimdConfig, Fixed, RateLimitAlgorithm, RateLimiterConfig};
|
|
pub use limiter::Limiter;
|
|
pub use limiter::{EndpointRateLimiter, RateBucketInfo};
|