mirror of
https://github.com/whit3rabbit/anyllm-proxy.git
synced 2026-09-22 16:00:51 +00:00
Captures stream_timeout_secs from AppState before the tokio::spawn and wraps the byte-stream loop in tokio::time::timeout, mirroring the same guard already present in streaming.rs. A stalled backend on /v1/chat/completions no longer holds the connection indefinitely. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>