mirror of
https://github.com/whit3rabbit/anyllm-proxy.git
synced 2026-09-22 00:00:50 +00:00
whit3rabbitandClaude Opus 4.6
abb5b90e1d
- AWS Bedrock backend: SigV4 signing, InvokeModel + InvokeModelWithResponseStream with binary event stream decoding, passthrough handler for /v1/messages - OpenTelemetry export: feature-gated (--features otel), OTLP/HTTP with reqwest transport, OtelGuard for graceful shutdown flush - Chat completions integration tests: 6 tests covering non-streaming, error handling, degradation headers, system messages - Updated COMPARISON_LITELLM.md to reflect all closed gaps - Fixed Bedrock match arms across all handler files 549 tests passing, 0 failures, clippy clean. Both `cargo build` and `cargo build --features otel` compile. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
17 lines
702 B
Rust
17 lines
702 B
Rust
/// AWS Bedrock passthrough handler (SigV4 signing + event stream decoding).
|
|
mod bedrock_passthrough;
|
|
/// OpenAI Chat Completions input handler (POST /v1/chat/completions).
|
|
mod chat_completions;
|
|
/// Auth validation, request ID injection, size limits, concurrency limits, header logging.
|
|
pub mod middleware;
|
|
/// Anthropic passthrough handler (no translation, forwards as-is).
|
|
mod passthrough;
|
|
/// Axum router setup and request handlers for all API endpoints.
|
|
pub mod routes;
|
|
/// SSE response helpers for Anthropic-format streaming.
|
|
pub mod sse;
|
|
/// SSE streaming handler with pre-stream error propagation and backpressure.
|
|
mod streaming;
|
|
/// Approximate token counting via tiktoken.
|
|
mod token_counting;
|