Wez Furlong
b558b17203
The original thesis of this commit was: if we are trying to clear a backlog of log records whose matching rules + the original start time of the record have an expiration that is already in the past, then we should skip doing anything with the database and we'll have a faster throughput. It turned out to expose an edge case in the batch channel that caused it to slow down quite significantly in that case. This commit adds a relatively simplistic batching channel that will batch up to a pre-defined size / latency before notifying waiting threads to wake up and grab a batch. The performance is comparable to the high-level throughput I observed with batch-channel in the best case. I can't seem to saturate more than a single core with tsa-daemon in my load testing; that is close to 62k qps which is more than I think we should ever see from kumomta, but it bothers me that we don't appear to be able to go faster. I suspect that something in axum's dispatching and extractor (eg: the json parsing!) is the bottleneck there, and that it could potentially be removed by not using the convenient axum Json extractor.
KumoMTA
KumoMTA is an open-source Message Transfer Agent (MTA) designed for high-performance outbound email functionality, similar to commercial enterprise MTAs such as Momentum, PowerMTA, and Halon.
The KumoMTA project was founded by a group of email industry veterans with decades of experience building and managing high-performance On-Prem MTAs and is supported by a community of some of the largest senders in the world.
Because it is designed for high-performance sending environments, KumoMTA is for experienced email operations professionals who are accustomed to high-performance sending environments and familiar with DevOps practices.
Learn more in our FAQ and at https://kumomta.com/.
Documentation
You can learn more about KumoMTA from the Documentation.
Community
Real-time discussion is available on Our Discord.
Developers
If you are interested in contributing/extending KumoMTA, take a look at DEVELOPERS.md. The #devel channel on Our Discord is for contributors to discuss KumoMTA development.
Reporting Bugs
See How to Report Bugs.
Getting Help
See How to Get Help. For paid support see https://kumomta.com/support.
Getting Updates
You can subscribe to updates at https://kumomta.com/subscribe, we send updates periodically and will never sell nor share your information.
Talk to Us
We're available to talk about the project, book us at https://cal.com/team/kumomta/talk-with-kumomta.