mirror of
https://github.com/whit3rabbit/anyllm-proxy.git
synced 2026-09-21 16:00:49 +00:00
whit3rabbitandClaude Opus 4.6
a4e655c8bb
Phase 1-8 implementation of the LiteLLM gap fill feature set: - POST /v1/chat/completions: Accept OpenAI-format input, translate through Anthropic pipeline, return OpenAI-format responses (streaming + non-streaming) - Reverse translation layer: openai_to_anthropic_request, anthropic_to_openai_response, ReverseStreamingTranslator (Anthropic SSE -> OpenAI ChatCompletionChunk) - Azure OpenAI backend: BACKEND=azure with deployment-scoped URLs, api-key header, api-version query param (default 2024-10-21) - Virtual key management: SQLite-backed CRUD via admin API (POST/GET/DELETE /admin/api/keys), DashMap in-memory cache, immediate revocation - Per-key rate limiting: RPM sliding window enforcement in auth middleware, 429 with retry-after header on limit exceeded - Client library v0.2.0: ClientBuilder, ToolBuilder, ToolChoiceBuilder, typed streaming, rustdoc examples - New dependencies: dashmap, aws-sigv4, aws-credential-types (prod); opentelemetry stack (feature-gated, optional) 534 tests passing, 0 failures, clippy clean. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>