mirror of
https://github.com/whit3rabbit/anyllm-proxy.git
synced 2026-09-22 00:00:50 +00:00
whit3rabbitandClaude Opus 4.8
65cf673b97
Large admin-ui refactor (Performative component system, sidebar nav,
provider/route tabs) plus backend module restructuring.
Admin UI contract fixes (this session):
- Fix Models page crash: useBackends unwraps {backends:[...]}; align
ModelEntry to {model_name, deployments} and ModelsResponse.strategy;
fix add-model body to {model_name, actual_model, backend_name}.
- Fix Backends/Providers health rendering: source per-backend status and
latency from the uptime endpoint (health_checks); narrow Backend type to
the real get_backends shape.
- Route + sidebar-link the previously-unrouted Backends tab.
Verified: cargo test (exit 0), clippy -D warnings (exit 0), fmt --check,
admin-ui tsc + vite build all green.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
27 lines
1019 B
Markdown
27 lines
1019 B
Markdown
# anyllm_batch_engine
|
|
|
|
Batch job orchestration: SQLite-backed queue, workers, file store, and event-driven webhook notifications. Powers the proxy's Batch API.
|
|
|
|
See root `../../CLAUDE.md` for workspace-wide commands and conventions.
|
|
|
|
## Test
|
|
|
|
```bash
|
|
cargo test -p anyllm_batch_engine
|
|
```
|
|
|
|
## Layout
|
|
|
|
- `engine.rs` — worker loop / orchestration.
|
|
- `job.rs` — job model + lifecycle states.
|
|
- `queue/sqlite.rs` — the durable queue (trait in `queue/mod.rs`).
|
|
- `db.rs` — schema + persistence.
|
|
- `file_store.rs` — input/output file blobs for batch jobs.
|
|
- `webhook/dispatcher.rs` + `webhook/sqlite.rs` — delivery with retry, durable state.
|
|
- `validation.rs` — request validation before enqueue.
|
|
|
|
## Gotchas
|
|
|
|
- Queue and webhook state are both persisted in SQLite — a restart resumes in-flight jobs. Don't assume in-memory state survives only the process; it does not for jobs.
|
|
- This crate owns batch persistence; the proxy's `batch/` module is the HTTP surface that calls into it. Keep the boundary clean.
|