feat(openai): configure Guardian concurrency priority at runtime (#306)

Configure Guardian reservations through persisted runtime settings and frozen request policies. Combine concurrency controls and queues in the admin UI, with the scheduling strategy shown first.

Prioritize Guardian account waiters, recheck displaced queue heads before lease acquisition, and report request-specific available capacity. Preserve account, key and wait-budget limits.

Co-authored-by: Yongzhao Chen <yongzhao.derek@gmail.com>
Co-authored-by: Zyy <zyycn@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
This commit is contained in:
Yongzhao
2026-10-01 22:49:11 +08:00
committed by GitHub
co-authored by Yongzhao Chen Zyy Claude Opus 5.5 Codex
parent a0e8f768dd
commit 90e241f74b
45 changed files with 820 additions and 158 deletions
+1
View File
@@ -29,6 +29,7 @@ export interface RuntimeSettings {
refreshMarginSeconds: number
refreshConcurrency: number
maxConcurrentPerAccount: number
openaiGuardianReservedConcurrency: number
requestIntervalMs: number
maxWaitingPerKey: number
maxWaitingPerAccount: number