Files
anyllm-proxy/crates/proxy
whit3rabbitandClaude Sonnet 4.6 bccddd9a7e fix: apply stream_timeout_secs to chat_completions streaming path
Captures stream_timeout_secs from AppState before the tokio::spawn and
wraps the byte-stream loop in tokio::time::timeout, mirroring the same
guard already present in streaming.rs. A stalled backend on
/v1/chat/completions no longer holds the connection indefinitely.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-30 17:17:19 -05:00
..