Commit Graph
12659 Commits
Author SHA1 Message Date
centdixandClaude Opus 4.5 550bcbcff3 refactor: rewrite ai eval benchmark runner
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-08 14:18:44 +02:00
centdixandClaude Opus 4.5 d176983c21 refactor: simplify ai eval history
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-08 12:19:10 +02:00
centdixandClaude Opus 4.5 f734a0464b refactor: simplify ai eval benchmark cli
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-08 11:20:30 +02:00
centdixandClaude Opus 4.5 1b664f5525 feat: add deterministic benchmark validators
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-07 16:23:07 +02:00
centdixandClaude Opus 4.5 44d87f50e0 refactor: unify ai eval case schema
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-07 15:50:31 +02:00
centdixandClaude Opus 4.5 50033239e1 refactor: use commander for ai_evals cli
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-07 15:04:54 +02:00
centdixandClaude Opus 4.5 f923c5376c feat: record first frontend flow benchmark
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-03 18:14:08 +02:00
centdixandClaude Opus 4.5 8c9603a01f feat: add frontend script benchmark surface
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-03 17:29:44 +02:00
centdixandClaude Opus 4.5 ced9a763c3 docs: align benchmark architecture docs
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 14:46:07 +02:00
centdixandClaude Opus 4.5 63e0752d5e refactor: move frontend benchmarks into ai_evals
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 14:29:06 +02:00
centdixandClaude Opus 4.5 2392448728 feat: add frontend benchmark surfaces
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 13:16:22 +02:00
centdixandClaude Opus 4.5 9e569c4000 docs: shift benchmark priority to frontend
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 12:29:40 +02:00
centdixandClaude Opus 4.5 cbc3683a80 feat: add cli benchmark history commands
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 01:33:48 +02:00
centdixandClaude Opus 4.5 9afe1f2875 feat: add repeated cli benchmark runs
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 01:02:49 +02:00
centdix c82be111e4 docs: add prompt testing status tracker\n\nCo-Authored-By: Claude Opus 4.5 <noreply@anthropic.com> 2026-04-01 00:55:27 +02:00
centdixandClaude Opus 4.5 ef9f380821 feat: add cli variant snapshot helper
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 00:52:14 +02:00
centdixandClaude Opus 4.5 876943468b refactor: move init guidance overrides to env vars
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-04-01 00:46:59 +02:00
centdixandClaude Opus 4.5 5a48886b4c feat: share cli ai guidance generation
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 22:53:16 +02:00
centdixandClaude Opus 4.5 05b5898132 feat: make cli evals skill-sensitive
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 22:37:42 +02:00
centdixandClaude Opus 4.5 455fcb0fef docs: add cli benchmark comparison workflow
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 22:23:56 +02:00
centdixandClaude Opus 4.5 3e214f7992 feat: add benchmark cli compare command
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:57:53 +02:00
centdixandClaude Opus 4.5 fbb7d101d6 refactor: remove legacy cli test harness
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:52:19 +02:00
centdixandClaude Opus 4.5 3426e01584 test: add cli flow benchmark case
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:45:06 +02:00
centdixandClaude Opus 4.5 df01f33dfa refactor: move cli eval adapter into ai_evals
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:44:57 +02:00
centdixandClaude Opus 4.5 7da096fee3 feat: add benchmark cli shell
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:31:40 +02:00
centdixandClaude Opus 4.5 8a4c2cfb25 docs: clarify benchmark cli architecture
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:26:32 +02:00
centdixandClaude Opus 4.5 ade5159e90 test: add cli artifact eval runner
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:19:22 +02:00
centdixandClaude Opus 4.5 8bf7883a97 docs: prioritize cli benchmark roadmap
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:09:36 +02:00
centdixandClaude Opus 4.5 a31b14ba50 feat: add benchmark history tracking scaffold
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-31 18:05:12 +02:00
centdixandClaude Opus 4.5 ff85853fdb test: auto-populate cli skill fixtures
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-30 15:55:27 +02:00
centdixandClaude Opus 4.5 3eb1a3c415 test: migrate app evals to shared cases
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-30 15:55:14 +02:00
centdixandClaude Opus 4.5 27b9e55976 test: scaffold shared flow eval cases
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-30 15:51:34 +02:00
centdixandClaude Opus 4.5 0d3406682f docs: add system prompt testing plan
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-30 15:46:48 +02:00
centdixandClaude Opus 4.6 98934d59c5 fix: use route_service instead of fallback_service for MCP router (#8614)
fallback_service on a router with no explicit routes is invisible to
axum's nest() — requests never reach the nested fallback, resulting in
404s. route_service("/", service) registers an actual route so nest()
forwards correctly.

Also reverts layer back to route_layer for the ApiAuthed extractor
since there is now a real route to match against.

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 11:54:07 +00:00
Ruben FiszelandClaude Opus 4.5 33032ed297 fix: enforce workspace isolation on flow resume endpoint (#8612)
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-03-30 10:54:18 +00:00
Diego ImbertandClaude Opus 4.6 22da5bd9ea fix: handle DuckDB boolean types in ColumnDef deserializers (#8610)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 10:27:46 +00:00
Diego ImbertandClaude Opus 4.6 f3012ee7cc fix: cast DuckDB IS_NULLABLE to string in metadata query (#8607)
DuckDB's information_schema.columns returns IS_NULLABLE as a boolean,
but the ColumnDef struct expects a string ('YES'/'NO'). This caused
deserialization to fail with "invalid type: boolean, expected a string"
when expanding WM_INTERNAL_DB markers (e.g. COUNT) for Ducklake tables.

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 09:14:26 +00:00
Ruben FiszelandClaude Opus 4.6 5f2d3e6812 fix: add path traversal check in service_logs get_log_file endpoint (#8605)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-30 08:18:08 +00:00
Ruben Fiszelandrubenfiszel 9bcda7023f chore(main): release 1.668.5 (#8594)
* chore(main): release 1.668.5

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
v1.668.5
2026-03-29 15:25:16 +00:00
Ruben FiszelandClaude Opus 4.6 9f86c72133 widen login rate limit defaults to reduce false positives (#8603)
* fix: widen login rate limit defaults to reduce false positives

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* fix: increase rate limits further for large-scale deployments

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 14:01:13 +00:00
Ruben FiszelandClaude Opus 4.6 754b88a52c fix: harden login rate limiting with CLOUD_HOSTED gating and memory eviction (#8602)
* fix: harden login rate limiting with CLOUD_HOSTED gating, memory eviction, and race fix

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

* fix: replace global DashMap with atomics and move extract_client_ip inside conditional

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 13:52:13 +00:00
Ruben FiszelandClaude Opus 4.6 06bbe7b94b fix: add per-IP and per-account brute force protection on login endpoint (#8601)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 13:16:11 +00:00
Ruben FiszelandClaude Opus 4.6 970e859a41 fix: validate JSON before sql_builder bind to prevent injection via JSONB queries (#8599)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:51:15 +00:00
Ruben FiszelandClaude Opus 4.6 845db72b73 fix: prevent SSRF and local file read via git repository resource URLs (#8600)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:48:55 +00:00
Ruben FiszelandClaude Opus 4.6 f5fc9f8485 fix: require mcp: scope for MCP endpoints instead of blanket bypass (#8597)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:39:48 +00:00
Ruben FiszelandClaude Opus 4.6 be7fbeb8b1 fix: disable workspace webhook events when CLOUD_HOSTED (#8598)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:34:00 +00:00
Ruben FiszelandClaude Opus 4.6 8c770a206a fix: rename snippet param to avoid svelte compiler shadowing bug in asset usages drawer (#8595)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:21:37 +00:00
Ruben FiszelandClaude Opus 4.6 74fba2abf3 fix: add timestamp validation to webhook signature verification (#8596)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:19:59 +00:00
Ruben FiszelandClaude Opus 4.6 b4d1f2aac7 fix: use constant-time comparison for API key and basic auth validation (#8593)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 12:01:52 +00:00
Ruben Fiszelandrubenfiszel 8baa7f8a20 chore(main): release 1.668.4 (#8592)
* chore(main): release 1.668.4

* Apply automatic changes

---------

Co-authored-by: rubenfiszel <275584+rubenfiszel@users.noreply.github.com>
v1.668.4
2026-03-29 07:21:52 +00:00