mirror of
https://github.com/stablyai/orca.git
synced 2026-10-25 00:03:59 +00:00
* refactor(tests): split oversized test files off the max-lines suppression list Every `*.test.ts`/`*.spec.ts` that carried an `eslint/oxlint-disable max-lines` directive is now split into focused, behavior-scoped suites that fit the 800-line test budget, with shared setup extracted into co-located `*-test-harness.ts` / `*-test-fixtures.ts` modules (300-line budget). 83 files became ~930; the largest output is 797 effective lines. `orca-runtime.test.ts` is intentionally untouched. Test bodies were moved by scripted line-range slicing rather than retyped, so assertions are byte-identical. The only permitted body edits were mechanical rebinding where a shared value moved into a harness (e.g. `tmpHome` -> `homes.tmpHome`). Registries that enumerate test files were updated in lockstep: - config/max-lines-baseline.txt: pruned 341 -> 258 entries (all 83 removed). - config/reliability-gates.jsonc: 33 gates repointed at the split files, with assertionRefs split per file where a gate's coverage now spans several. - .github/workflows/pr.yml: the real-zsh lane now lists the 4 split files that actually exercise zsh, so they keep running in the dedicated shell lane. Also renamed agent-hooks `server-test-fixtures.ts` to `server.test-fixtures.ts` so the global-fetch call-site audit keeps skipping it, and added `.js` extensions to the CLI suites' dynamic harness imports (node16 resolution) to unbreak `build:cli`. Verification: full suite 52,449 passing vs 52,448 at baseline with zero assertions lost; `pnpm lint`, `pnpm typecheck`, and `pnpm build:cli` all exit 0; the terminal-pane e2e spec runs 31/31 headless. * refactor(tests): split hook-idle arbitration suite that oxfmt pushed over budget The pre-commit oxfmt pass reflowed pty-connection-hook-idle-arbitration.test.ts to 811 effective lines, 11 over the test budget. Split the hook-completion side effect and replacement-agent veto cases into their own suite; both files now sit well under the cap and the 15 tests are unchanged. * test: port upstream test changes into the split files after rebase Rebasing onto main surfaced 27 tests that main had added to files this branch deleted, plus edits to tests that had already moved. Taking the deletion side of those modify/delete conflicts would have dropped that coverage silently, so each upstream change is ported into the split file that now owns the behavior — for example main's six orchestration mailbox tests land across orchestration-runs, -send, and -check. Also repoints `orchestration.notification-mailbox-consistency`, a gate main added after this branch's gate remap, at those same three split files, and re-prunes the max-lines baseline against main's (257 entries). Verified: all 27 upstream test titles present; full suite 52,761 passing with the only diff vs baseline being 12 tests main itself removed and 3 that moved from skipped to passing; lint and typecheck exit 0. * fix(test): flush pending continuations before tearing down terminal test globals CI shard 5/16 failed on both Node 24 and 26 with `ReferenceError: window is not defined` from pty-connection.ts, surfacing through pty-connection-daemon-snapshot-replay.test.ts. The reattach/settle chains `await` a real promise and then touch `window.api`. Under fake timers those continuations cannot run, so they only become schedulable once restoreTerminalTestGlobals() switches back to real timers — which previously happened immediately before `delete globalThis.window`, so a late continuation threw and failed the whole file. Flush async ticks in that window instead. This is latent in the source rather than new: the pre-split 25k-line file kept running other tests after these, which gave the chains time to settle before teardown. Splitting the file moved teardown directly behind them. * fix(test): keep an inert window after terminal test teardown instead of deleting it The async-tick flush was not enough: the reattach/settle chain can resolve after teardown regardless of how long we drain, so CI shard 5/16 still failed with `ReferenceError: window is not defined` from pty-connection.ts. A real renderer never loses `window`, so deleting it was the artificial part. Swap in an inert proxy whose properties resolve to callables and whose calls resolve to undefined, making a late `window.api.pty.*` call a harmless no-op. The next test replaces it wholesale via installTerminalTestGlobals(), and no test asserts that `window` is absent.
200 lines
5.9 KiB
TypeScript
200 lines
5.9 KiB
TypeScript
import { afterEach, beforeEach, describe, expect, it, vi } from 'vitest'
|
||
import { _internals } from './server'
|
||
import { buildBody } from './server.test-fixtures'
|
||
|
||
const { getCohortAtEmitMock, trackMock } = vi.hoisted(() => ({
|
||
getCohortAtEmitMock: vi.fn(),
|
||
trackMock: vi.fn()
|
||
}))
|
||
|
||
vi.mock('../telemetry/client', () => ({
|
||
track: trackMock
|
||
}))
|
||
|
||
vi.mock('../telemetry/cohort-classifier', () => ({
|
||
getCohortAtEmit: getCohortAtEmitMock
|
||
}))
|
||
|
||
beforeEach(() => {
|
||
_internals.resetCachesForTests()
|
||
trackMock.mockReset()
|
||
getCohortAtEmitMock.mockReset()
|
||
getCohortAtEmitMock.mockReturnValue({ nth_repo_added: 2 })
|
||
})
|
||
|
||
afterEach(() => {
|
||
vi.restoreAllMocks()
|
||
})
|
||
|
||
describe('Pi hook normalization', () => {
|
||
it('before_agent_start maps to working and captures the prompt', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'before_agent_start', prompt: 'rename this fn' }),
|
||
'production'
|
||
)
|
||
expect(result?.payload.state).toBe('working')
|
||
expect(result?.payload.agentType).toBe('pi')
|
||
expect(result?.payload.prompt).toBe('rename this fn')
|
||
})
|
||
|
||
it('OMP uses Pi-compatible events but keeps OMP agent attribution', () => {
|
||
const started = _internals.normalizeHookPayload(
|
||
'omp',
|
||
buildBody({ hook_event_name: 'before_agent_start', prompt: 'status for omp' }),
|
||
'production'
|
||
)
|
||
expect(started?.payload).toMatchObject({
|
||
state: 'working',
|
||
prompt: 'status for omp',
|
||
agentType: 'omp'
|
||
})
|
||
|
||
const done = _internals.normalizeHookPayload(
|
||
'omp',
|
||
buildBody({ hook_event_name: 'agent_end' }),
|
||
'production'
|
||
)
|
||
expect(done?.payload).toMatchObject({
|
||
state: 'done',
|
||
prompt: 'status for omp',
|
||
agentType: 'omp'
|
||
})
|
||
})
|
||
|
||
it('agent_start without a prompt keeps the cached prompt from the current turn', () => {
|
||
_internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'before_agent_start', prompt: 'first prompt' }),
|
||
'production'
|
||
)
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'agent_start' }),
|
||
'production'
|
||
)
|
||
expect(result?.payload.state).toBe('working')
|
||
expect(result?.payload.prompt).toBe('first prompt')
|
||
})
|
||
|
||
it('before_agent_start clears the previous turn’s tool cache', () => {
|
||
_internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({
|
||
hook_event_name: 'tool_call',
|
||
tool_name: 'bash',
|
||
tool_input: { command: 'ls' }
|
||
}),
|
||
'production'
|
||
)
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'before_agent_start', prompt: 'next' }),
|
||
'production'
|
||
)
|
||
expect(result?.payload.toolName).toBeUndefined()
|
||
expect(result?.payload.toolInput).toBeUndefined()
|
||
})
|
||
|
||
it('tool_call surfaces tool_name + tool_input preview', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({
|
||
hook_event_name: 'tool_call',
|
||
tool_name: 'bash',
|
||
tool_input: { command: 'pnpm test' }
|
||
}),
|
||
'production'
|
||
)
|
||
expect(result?.payload.state).toBe('working')
|
||
expect(result?.payload.toolName).toBe('bash')
|
||
expect(result?.payload.toolInput).toBe('pnpm test')
|
||
})
|
||
|
||
it('tool_execution_start also populates the tool preview', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({
|
||
hook_event_name: 'tool_execution_start',
|
||
tool_name: 'read',
|
||
tool_input: { path: 'src/main/index.ts' }
|
||
}),
|
||
'production'
|
||
)
|
||
expect(result?.payload.state).toBe('working')
|
||
expect(result?.payload.toolName).toBe('read')
|
||
expect(result?.payload.toolInput).toBe('src/main/index.ts')
|
||
})
|
||
|
||
it('message_end (assistant) stays in working but captures lastAssistantMessage', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({
|
||
hook_event_name: 'message_end',
|
||
role: 'assistant',
|
||
text: 'Done — I refactored the helper.'
|
||
}),
|
||
'production'
|
||
)
|
||
expect(result?.payload.state).toBe('working')
|
||
expect(result?.payload.lastAssistantMessage).toBe('Done — I refactored the helper.')
|
||
})
|
||
|
||
it('message_end (user) is ignored', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'message_end', role: 'user', text: 'hi' }),
|
||
'production'
|
||
)
|
||
// Why: pi captures the user prompt via before_agent_start, so a user-role message_end must not flip lastAssistantMessage.
|
||
expect(result?.payload.lastAssistantMessage).toBeUndefined()
|
||
})
|
||
|
||
it('agent_end maps to done', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'agent_end' }),
|
||
'production'
|
||
)
|
||
expect(result?.payload.state).toBe('done')
|
||
expect(result?.payload.agentType).toBe('pi')
|
||
})
|
||
|
||
it('session_shutdown leaves a running Pi status intact', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'session_shutdown' }),
|
||
'production'
|
||
)
|
||
// Why: Pi emits shutdown on reload/replace while the PTY stays alive; only agent_end proves turn completion.
|
||
expect(result).toBeNull()
|
||
})
|
||
|
||
it('done preserves the cached lastAssistantMessage from a prior message_end', () => {
|
||
_internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({
|
||
hook_event_name: 'message_end',
|
||
role: 'assistant',
|
||
text: 'final reply'
|
||
}),
|
||
'production'
|
||
)
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'agent_end' }),
|
||
'production'
|
||
)
|
||
expect(result?.payload.lastAssistantMessage).toBe('final reply')
|
||
})
|
||
|
||
it('unknown event names are dropped', () => {
|
||
const result = _internals.normalizeHookPayload(
|
||
'pi',
|
||
buildBody({ hook_event_name: 'never_heard_of_it' }),
|
||
'production'
|
||
)
|
||
expect(result).toBeNull()
|
||
})
|
||
})
|