whit3rabbit
ebf5455b10
docs: simplify README, add docs/CLI.md, center ASCII art and add WebUI screenshots, and add copy-command to Auto Router
2026-07-16 20:41:24 -05:00
whit3rabbit
1c7d66cc54
Large refactor of files over 400+ of lines of code to make it more managable. Just clean up/splitting of files.
2026-07-12 21:14:16 -05:00
whit3rabbit and Claude Sonnet 5
8d1136ea97
chore: refresh LiteLLM provider/model catalog and pricing
...
Regenerate litellm_snapshot.rs from upstream LiteLLM data: adds 7 new
providers (darkbloom, libertai, pinstripes, scaleway, tencent,
tensormesh, tinyfish) and fixes model/pricing drift across ~28
existing providers. Drop the now-redundant hand-maintained scaleway
legacy stub in favor of the generated entry. Refresh model_pricing.json
for the new claude-sonnet-5 entry.
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com >
2026-07-04 10:36:38 -05:00
whit3rabbit and Claude Sonnet 4.6
681b0d47d9
chore: bump to 0.9.8, add CHANGELOG, cargo update
...
- Version: 0.9.7 → 0.9.8 (workspace + all pinned inter-crate deps)
- New: AnthropicMessagesClient passthrough client
- New: RetryPolicy struct, retry_transport_errors flag, extra_header builder
- New: ssrf_allow_loopback, ssrf_allow_private, extra_headers in HttpClientConfig
- New: ChatMessage::effective_text(), claude-fable-5 in provider catalog
- Fix: relaxed serde defaults for lax local backends (Ollama, llama.cpp)
- Fix: warn on empty choices in openai_to_anthropic_response
- ci: create-release now uses CHANGELOG section as release body
- docs: CHANGELOG.md created, release process documented in CLAUDE.md
- deps: cargo update (~105 packages, tokio 1.52, axum 0.8.9, rustls 0.23.40)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-06-12 22:37:09 -05:00
github-actions[bot]
2f4f62d0f8
bot: update model pricing from LiteLLM [skip ci]
2026-06-01 07:33:46 +00:00
github-actions[bot]
d7e2740a38
bot: update model pricing from LiteLLM [skip ci]
2026-05-25 07:22:42 +00:00
github-actions[bot]
fea7a8e9cd
bot: update model pricing from LiteLLM [skip ci]
2026-05-18 07:11:57 +00:00
github-actions[bot]
5618e975e9
bot: update model pricing from LiteLLM [skip ci]
2026-05-11 07:00:50 +00:00
github-actions[bot]
856159684c
bot: update model pricing from LiteLLM [skip ci]
2026-04-27 06:45:30 +00:00
github-actions[bot]
69929e494b
bot: update model pricing from LiteLLM [skip ci]
2026-04-20 06:37:28 +00:00
whit3rabbit and Claude Sonnet 4.6
be038e4164
feat: add provider catalog, bedrock native passthrough, and generic passthrough
...
Introduces anyllm_providers crate as metadata-only catalog (ProviderDef,
ModelDef, registry). Wires any provider-id as BACKEND via OpenAIClient.
Adds bedrock_native.rs (Converse/InvokeModel with SigV4) and
generic_passthrough.rs catch-all for Translate mode. Updates config,
backend clients, streaming, token counting, and compatibility tests
to support the expanded provider surface. Updates model pricing and docs.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-04-08 16:33:59 -05:00
whit3rabbit and Claude Opus 4.6
d6b9d61071
feat: add caching, batch API, cost tracking, budget/RBAC, audio/image passthrough
...
LiteLLM parity features:
- Response caching (in-memory moka, optional Redis tier) with per-request TTL
- Batch API (file upload, job creation/listing via OpenAI delegation)
- Per-key budget enforcement (daily/monthly/lifetime) with lazy period reset
- RBAC (admin/developer key roles, developer keys blocked from /admin/)
- Audio transcription/speech and image generation passthrough
- Fallback chain config (YAML-based, 5xx/429 failover)
- Cost tracking foundation (model pricing DB, per-key spend queries)
Code quality cleanup (simplify pass):
- Extract try_cache_response helper (was copy-pasted 4x)
- Extract common_routes for batch/models (was duplicated across 3 HandlerMode arms)
- Deduplicate embeddings_passthrough to delegate to raw_passthrough
- Remove dead code: inject_cost_header, BudgetDuration::from_str_lossy, duplicate CacheConfig
- Collapse epoch_to_ymd wrapper into pub(crate) days_to_ymd
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-03-26 20:23:38 -05:00
whit3rabbit
github-actions[bot]