Conrad Ludgate 9cfe08e3d9 proxy password threadpool (#7806) ...

## Problem

Despite making password hashing async, it can still take time away from
the network code.

## Summary of changes

Introduce a custom threadpool, inspired by rayon. Features:

### Fairness

Each task is tagged with it's endpoint ID. The more times we have seen
the endpoint, the more likely we are to skip the task if it comes up in
the queue. This is using a min-count-sketch estimator for the number of
times we have seen the endpoint, resetting it every 1000+ steps.

Since tasks are immediately rescheduled if they do not complete, the
worker could get stuck in a "always work available loop". To combat
this, we check the global queue every 61 steps to ensure all tasks
quickly get a worker assigned to them.

### Balanced

Using crossbeam_deque, like rayon does, we have workstealing out of the
box. I've tested it a fair amount and it seems to balance the workload
accordingly

2024-05-22 17:05:43 +00:00

..

src

use cargo-hakari to manage workspace_hack crate

2022-03-29 10:42:04 +03:00

.gitattributes

add missing files, update workspace hack

2022-04-14 20:41:21 +03:00

build.rs

add missing files, update workspace hack

2022-04-14 20:41:21 +03:00

Cargo.toml

proxy password threadpool (#7806)

2024-05-22 17:05:43 +00:00