Commit Graph
20375 Commits
Author SHA1 Message Date
Kelvin Amoaba 1e6c7aa738 fix(speech): count any engine answer as progress while a dictation finishes 2026-11-09 19:39:44 +00:00
Kelvin Amoaba b8e082b011 fix(speech): let a slow on-device finish run while it still returns text
The stop timeout counted 60 s from Finish however much audio the engine still had
to decode, so a CPU model on a busy machine failed a dictation it was still
transcribing. It now fails only after 60 s without text for that dictation.
2026-11-09 19:39:44 +00:00
Kelvin Amoaba 1bf2276bdd fix(dictation): match the pill's Chinese and Japanese phrases to the inserted text, and space Korean ones (#40455)
* fix(dictation): join Chinese and Japanese phrases without a space, and space Korean ones

The shared transcript fold joined every phrase with a space, so the pill and
phone replies showed Chinese and Japanese text with spaces the inserted text
doesn't have. It now joins with the same rule as insertion. That rule treated
Hangul like Chinese and Japanese, so Korean phrases were inserted with no space
between sentences; Korean spaces words, so Hangul now spaces like Latin text.

* fix(dictation): don't space after Chinese and Japanese full-width punctuation

* fix(dictation): join retried phrases with the same spacing rule

* fix(dictation): escape the spacing rule's non-ASCII marks for the orcad bundle

The shared fold now pulls the spacing rule into the orcad server bundle, which
must stay ASCII. A rich-draft test pinned Hangul joining without a space; it
now expects the Korean spacing.
2026-11-09 19:39:34 +00:00
Kelvin Amoaba 3aee704b8b fix(speech): keep words spoken while the model loads (#40454)
Stopping a CPU dictation closed the renderer's audio port while frames still
waited behind a decode in the speech worker; the close ended the stream at once
and the queued frames were dropped. A close after 'end' now leaves them to
decode. A model slower than 30 s to load also lost the start of the dictation,
since the renderer kept only 30 s of startup audio; it now keeps as much as the
host waits for the load.
2026-11-09 19:39:23 +00:00
OrcaWinandOrcaWin 9e128042fa test: remove low-value suites and redundant examples (#40457)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 11:31:20 -08:00
Kelvin Amoaba 58733086c9 feat(speech): spell dictated code terms with a personal and per-repo dictionary (#40450)
* feat(speech): spell dictionary terms in dictation, with repo terms and Whisper prompt

* test(speech): pin host repo terms for phone dictation

* fix(speech): keep symbol terms whole, accept null setup params, resolve SSH repos

* refactor(speech): key transcript words once and type phone terms at the reply schema

* refactor(speech): merge speech-types imports in the speech IPC
2026-11-09 19:22:46 +00:00
Kelvin Amoaba f126d6ef37 feat(runtime): tell phones when the desktop refreshes a PR (#40438)
* feat(runtime): tell phones when the desktop refreshes a PR

* fix(runtime): name every checkout a coalesced PR read stood for

* fix(runtime): don't count a read that couldn't load checks as a checks change
2026-11-09 19:16:14 +00:00
OrcaWinandOrcaWin 77781c71f7 test: remove low-value CLI and renderer inventories (#40445)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 11:14:08 -08:00
Kelvin Amoaba d291670a01 refactor(speech): remove sherpa-onnx (#39473)
transcribe-cpp is now the only on-device engine on every platform, so
the sherpa-onnx packages, their packaging (extraResources, the darwin
libonnxruntime prune, the native-variant assert and the Linux libstdc++
exemption), the sherpa recognizer in the speech process and the
per-model engine choice all go. Hotwords are written as plain terms.
2026-11-09 18:59:10 +00:00
OrcaWinandOrcaWin 85f58ec64f test: remove low-value CLI, settings and shortcut suites (#40441)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 10:53:47 -08:00
Kelvin Amoaba 6530fd1777 perf(github): answer phone PR lookups from the desktop's last result (#40430)
* perf(github): answer phone PR lookups from the desktop's last result

* fix(github): order last PR outcomes by lookup start sequence

* fix(github): keep reused phone PR outcomes out of the refresh observers

* fix(github): reuse a fallback-found PR only for the same fallback number
2026-11-09 18:06:06 +00:00
buf0-bot[bot] e1b6fbe7bf Update README downloads badge (#40440)
Co-authored-by: buf0-bot[bot] <252831055+buf0-bot[bot]@users.noreply.github.com>
2026-11-09 18:00:37 +00:00
Kelvin Amoaba fd46321d85 feat(speech): move the speech models to transcribe-cpp and offer an update for old downloads (#39468)
* feat(speech): move the speech catalog to transcribe-cpp models

Parakeet v2/v3, Whisper tiny and SenseVoice now download their GGUF
builds, which run on transcribe-cpp everywhere, Intel Macs included (on
the CPU). A model still holding its old sherpa-onnx download shows
"Update to the faster version (<size>)"; updating replaces the old
files, and dictating before then says the model needs that update.

The five models with no GGUF build are retired and their users moved
over: the Japanese Parakeet, the Chinese-English Zipformer and the
Paraformer to SenseVoice, and the Korean and Chinese streaming
Zipformers to the new Nemotron 3.5 (28 languages). Nemotron's locale
codes (ko-KR) are matched from the ISO language setting.

* feat(speech): offer the speech model update once after the engine change

A card in the notification corner tells people whose selected on-device
model needs the new download, or whose retired model was replaced, and
starts the same download as Settings > Voice. After a replacement it
offers to delete the retired model's files.

* feat(speech): move retired Korean and Chinese models to SenseVoice and offer Whisper Large v3 Turbo

On transcribe-cpp 0.4.1 with Metal, SenseVoice beat Nemotron 3.5 on Korean
and Chinese FLEURS clips, so the retired Korean and Chinese streaming
Zipformers now move to SenseVoice. Whisper Large v3 Turbo (Q8_0, 886 MB)
joins the catalog as the most accurate choice for Japanese, Korean and
Chinese. Nemotron 3.5 stays, described by the languages it does best.
2026-11-09 18:00:13 +00:00
Kelvin Amoaba bca56f7776 feat(mobile): keep dictating after leaving the session, with a floating pill (#40421)
* feat(mobile): keep dictating after leaving the session, with a floating pill

* feat(mobile): translate the dictation pill and its toasts

* fix(mobile): type away words without claiming the terminal, and keep the pill above screens

* fix(mobile): float the pill above bottom bars, reopen the owner's own screen, and tell a refused start wherever you are

* fix(mobile): float the dictation pill above the source control bar

* fix(mobile): keep pill state out of the host context and reopen the starting screen first

* refactor(mobile): subscribe the pill only while it shows and trim the session dictation hook

* fix(mobile): key bar clearances by symbol
2026-11-09 17:52:00 +00:00
OrcaWinandOrcaWin fc379afda7 test: remove low-value locale, automation and settings cases (#40437)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 09:49:58 -08:00
Kelvin Amoaba 94dab9fc69 feat(mobile): save the chat when the app leaves the foreground (#40417)
* feat(mobile): save the chat when the app leaves the foreground

A swipe-kill from the app switcher can end the app before the page is
hidden: iOS fires visibilitychange only at background, and Android Recents
leaves the activity resumed. The shell now sends an appInactive frame on
iOS inactive and Android window blur, to pages that declare they read it,
and the page saves any chat rows the store doesn't hold yet.

* fix(mobile): keep the leave callback out of render

* fix(mobile): notice a changed middle row before skipping a chat save
2026-11-09 17:38:36 +00:00
Kelvin Amoaba cff1b3188e perf(mobile): show accounts from the last snapshot (#40425)
* perf(mobile): show accounts from the last snapshot

* fix(mobile): never count a stored accounts snapshot as live

* test(mobile): pin when accounts usage counts as live

* fix(mobile): date accounts reads by when they were sent and block switches until live

* fix(mobile): show accounts usage only from this screen's own read, drop replies from before a reconnect
2026-11-09 17:37:56 +00:00
OrcaWinandOrcaWin ef25c04eef test: remove low-value terminal, browser-session and SSH cases (#40433)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 09:34:56 -08:00
Kelvin Amoaba d39d87f13c feat(settings): add a Use GPU switch for on-device dictation (#39466)
* feat(settings): add a Use GPU switch for on-device dictation

On by default (Auto: the GPU when it works, the CPU when it fails).
Turning it off keeps the transcribe-cpp speech process on the CPU, for
machines whose GPU driver freezes or restarts them. The row shows when
the selected model runs on transcribe-cpp.

* fix(speech): reload the warm speech model when Use GPU changes

A loaded recognizer kept the GPU choice it started with, so turning Use GPU
off left the next dictations on the GPU until the model unloaded.

* fix(speech): reload the speech model after a dictation when Use GPU changed during it

A recognizer still in use when Use GPU changed stayed loaded afterwards with
the old choice. It now unloads as soon as its last dictation ends, and the
warm-up loads it again with the new choice.
2026-11-09 17:20:09 +00:00
OrcaWinandOrcaWin 403736b844 test: remove redundant browser matrices and SSH inventories (#40429)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 09:18:23 -08:00
Kelvin Amoaba 16e21424a7 feat(dictation): show committed and in-flight words in the dictation pill (#40428)
The pill showed only the current partial and went back to Listening after
each final, so pause-committed phrases from transcribe-cpp never appeared.
The host's transcript fold moves to src/shared and the desktop pill uses it
too: committed text in the foreground, tentative text muted.
2026-11-09 17:16:31 +00:00
OrcaWinandOrcaWin da8396395c test: remove low-value browser, hook and SSH cases (#40423)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 09:04:22 -08:00
Kelvin Amoaba 9a45e8bdfb feat(speech): dictate through any OpenAI-compatible transcription service (#40160)
Add an OpenAI-compatible model whose base URL, model and optional key
are set up in a Voice settings dialog and sealed together in ~/.orca,
so a key is never sent to a host it wasn't saved for. It reaches
OpenAI, Groq, Mistral and local servers, and replaces the unused
userModels setting.
2026-11-09 16:57:24 +00:00
Kelvin Amoaba ab2f5786e0 feat(mobile): keep a failed dictation's recording and offer Retry (#40276) 2026-11-09 16:54:30 +00:00
OrcaWinandOrcaWin f54514ea24 test: prune low-value browser WSL and telemetry coverage (#40418)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 08:42:54 -08:00
Kelvin Amoaba 0b8e94aa5c feat(speech): run GGUF models on transcribe-cpp with a CPU fallback (#39326)
* feat(speech): run GGUF models on transcribe-cpp, falling back to the CPU

The speech host child can now load a second engine. A model whose files
are GGUF runs on transcribe-cpp (Metal on Apple silicon, Vulkan on
Windows and Linux, CPU otherwise); everything else stays on sherpa-onnx,
which remains the only engine on Intel Macs.

A GPU that fails to load, errors, stalls for 25 s or crashes the process
moves the dictation to a CPU-only process (TRANSCRIBE_BACKENDS=cpu) that
replays the audio the GPU had not decoded yet, so no words are lost or
repeated. A GPU that crashed or would not load is remembered per
transcribe-cpp version and OS release, and voice.speechGpu = 'off' keeps
it on the CPU.

Packaging copies transcribe-cpp, koffi and the target's native package
into resources/node_modules outside asar, fails when a target's package
is missing, and ships the MSVC runtime beside transcribe.dll on Windows.

No catalog model is GGUF yet, so nothing runs on transcribe-cpp until
the catalog change that follows.

* fix(speech): keep the speech queue running after a failed task, and drop audio frames after a discard

* fix(speech): keep the engine's file reads off the main thread's hot paths

The engine lookup and the GPU failure marker are read once per process
instead of on every dictation start and mobile catalog request, the marker
is written asynchronously, and the child reads the hotwords file with
fs/promises. The baseline moves the existing engine presence checks from
stt-worker-paths to the shared package table and adds the once-per-process
marker reads.
2026-11-09 16:37:03 +00:00
OrcaWinandOrcaWin 26810fe4a8 test: prune low-value terminal and workspace coverage (#40413)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 08:29:13 -08:00
OrcaWinandOrcaWin 2f68fb8175 test: prune low-value worktree, SSH and activation coverage (#40406)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 08:15:22 -08:00
OrcaWinandOrcaWin 23588ed935 test: remove low-value browser, store and adapter suites (#40399)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 07:54:05 -08:00
Kelvin Amoaba 7fffb5c794 fix(mobile): stop Review's branch compare re-reading back to back during git bursts (#40278)
* fix(mobile): stop Review's branch compare re-reading back to back during git bursts

fetchHostQuery re-read a compare as soon as it landed marked by a git event, so a burst of gitStatusChanged events with reads slower than the event spacing kept the desktop running compares back to back, and kept going after Review closed. A re-read now goes at once only after a quiet spell (a write's own event), otherwise floorMs after the last read landed, and stops once Review's build is no longer current. A superseded build no longer evicts the entry a newer build is reading.

* fix(mobile): show each compare that lands during a git burst while Review reads it again

* fix(mobile): keep note edits when a later compare lands on a shown Review build
2026-11-09 15:52:13 +00:00
OrcaWinandOrcaWin 3ce8d75ae9 test: remove low-value agent-hook and row-projection coverage (#40395)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 07:35:12 -08:00
OrcaWinandOrcaWin c82839fb7b test: remove agent-hook projections and URL inventories (#40388)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 07:14:40 -08:00
Neil 93f90fca89 fix(vm-recipes): tell paired phones to re-read workspaces when a VM create's pending checkout changes (#40384)
The phone filters in-progress VM checkouts only when it reads its host
workspace list, so a read made before a window's hide reached the main
process kept showing the checkout until the next unrelated change. Emit
worktreesChanged for each repo whose pending checkout appears or goes
away; phones already re-read their host workspace list on that event.
2026-11-09 07:04:08 -08:00
OrcaWinandOrcaWin e0bf451bec test: remove thin agent-hook and mobile migration suites (#40382)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 06:59:23 -08:00
Neil 9a21a515d3 fix(vm-recipes): hide an in-progress VM checkout in every window, the phone and the jump palette (#40373)
* fix(vm-recipes): hide an in-progress VM checkout in every window, the phone and the jump palette

A VM create's checkout was hidden only in the sidebar of the window that
started the create. Windows now publish their pending VM checkouts to the
main process, which shares every window's set with all windows and
filters the paired phone's host workspace list and workspace context.
The jump palette and the sidebar read the shared set, and a grouped VM
project no longer draws an empty-project placeholder while its create
is pending. A window's set is dropped when it closes, crashes or reloads.

* test(project-groups): reset leaked runtime environment revisions between files
2026-11-09 06:51:21 -08:00
OrcaWinandOrcaWin bcb1b1c9f7 test: remove sidebar VM-wake and template hover suites (#40379)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 06:44:58 -08:00
OrcaWinandOrcaWin 2eaba5b39e test: remove low-value VM, mobile, work-item and terminal suites (#40376)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 06:31:53 -08:00
OrcaWinandOrcaWin b2c049a8cb test: remove browser startup and CLI prerequisite mock suites (#40371)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 06:21:19 -08:00
Kelvin Amoaba 8b1c394a41 perf(mobile): open Home with last-known workspaces and counts (#40129)
* perf(mobile): open Home with last-known workspaces and counts

* fix(mobile): keep disconnected desktops on Home and judge agents by the client's connect time

* fix(mobile): store the seeded Home counts before removing the old snapshot

* fix(mobile): floor router reads after failures, catch up reads that span a stream reopen, seed the wide host list from Home

* fix(mobile): keep the old Home snapshot until the store can take it, and never re-date stored totals

* perf(mobile): key Home's counts in the host list module so the page boot never loads Home's code

* test(mobile): type the Home catalog adapter's modules with type imports

* perf(mobile): read Home's stored rows in one batch beside the host list, and keep mark-read a delta read

* perf(mobile): paint Home's desktop rows without waiting for the stored counts

* perf(mobile): restore Home's stored rows after the desktop list paints, from its host ids

* perf(mobile): read Home's counts on the connected edge itself, not a render later
2026-11-09 14:06:15 +00:00
OrcaWinandOrcaWin 2f46f0c057 test: remove low-value VM creation assertions (#40367)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 06:02:36 -08:00
Kelvin Amoaba 7f63600a23 feat(mobile): keep commit, PR and review drafts across app kills (#40114)
* feat(mobile): keep commit, PR and review drafts across kills

* refactor(mobile): build commit, PR and review drafts on the shared draft fields, and clear only the text that was sent

* fix(mobile): keep a toggle made during Write with AI, the edit note while its sheet closes, and a newer PR edit after an earlier save

* test(mobile): wait for the saved review note row instead of sleeping

* perf(mobile): keep a hash of the PR text an edit was typed against, not a second copy
2026-11-09 14:02:12 +00:00
Kelvin Amoaba a68d614010 feat(mobile): open chats on their last messages after a relaunch (#40166)
* feat(mobile): open chats on their last messages after a relaunch

The phone's store keeps each chat's newest rows (up to 512 KiB, 500 rows)
and its resume point, written when a turn settles, on hidden and when the
chat closes. A relaunched session opens on its stored chat tab, paints the
saved rows, and resumes from the stored cursor; the live read restates what
the agent is doing. Offline, the composer line says when the copy is from.

* test(mobile): keep the relaunch test typechecking

* i18n(mobile): translate the offline as-of line

* perf(mobile): encode chat copies in slices off the settle frame
2026-11-09 13:58:05 +00:00
Kelvin Amoaba fabd615179 perf(mobile): keep three visited terminals mounted (#40111)
* perf(mobile): keep three visited terminals mounted and release hidden WebGL

* fix(mobile): scope the mounted-terminal LRU to the terminal frame

* fix(mobile): keep chat's lease-only stream when a terminal pane unmounts

* fix(mobile): report a hidden terminal's cell box only once it is shown

* perf(mobile): keep hidden terminals' WebGL contexts instead of rebuilding them on every switch
2026-11-09 13:57:38 +00:00
Neil 6c951c0a9a feat(vm-recipes): show VM lifecycle states in the sidebar, with Suspend/Resume VM (#40046)
* feat(vm-recipes): show VM lifecycle states in the sidebar, with Suspend/Resume VM

* fix(vm-recipes): Suspend VM suspends an idle parent with active children; dedupe repeat suspends

- With active children, Suspend VM sleeps this workspace too, so its VM
  suspends once their sessions stop.
- A repeat Suspend VM while one is pending is dropped in the coordinator
  instead of trusting a possibly stale suspended record.
- After a direct suspend, re-probe the host so its header reads Suspended.
2026-11-09 05:54:03 -08:00
Kelvin Amoaba 41867a2a85 perf(mobile): stop rebooting the Home spare page on every hop and after iOS memory warnings (#40270)
* perf(mobile): back off spare page refills after an unclaimed drop or memory warning

* fix(mobile): skip a spare whose store read outlived an unclaimed drop

* fix(mobile): arm the spare refill timer on whole milliseconds
2026-11-09 13:52:05 +00:00
Kelvin Amoaba 6f83fb3c46 fix(mobile): floor event-driven reads after failures and catch up reads that span a stream reopen (#40142)
* fix(mobile): floor event-driven reads after failures and catch up reads that span a stream reopen

* test(mobile): pin the event router's read floor after a refused read in a recording
2026-11-09 13:51:51 +00:00
Kelvin Amoaba e22bb7c46c feat(mobile): keep Tasks and new-workspace drafts across kills (#40127)
* feat(mobile): keep Tasks and new-workspace drafts across kills

Task comments (per item and project row), the New issue title and body,
and the New workspace note now live in device-store draft rows. They come
back after the form closes or the app is killed, and only into an empty
field. A comment's setter stays bound to its item, so a send that settles
after the user moved on clears the right row.

* fix(mobile): rebuild comment sends when the draft's item changes

* fix(mobile): key the workspace note by host and keep cleared fields cleared

* fix(mobile): clear only the note a finished create sent

* fix(mobile): count clearing an empty draft field as the user's choice

* perf(mobile): cap field drafts, read sheet drafts on open, retry a failed read once

* fix(mobile): retry a failed draft read after a pause and keep New issue text typed during a create

* fix(mobile): save draft text again once a failed store read can be retried

* fix(mobile): remove a stored draft when an unread field is cleared
2026-11-09 13:51:32 +00:00
Kelvin Amoaba a26277b275 perf(github): use the desktop's PR fallback rule on the phone and forward refreshes (#40128)
* perf(github): use the desktop's PR fallback rule on the phone and forward refreshes

* fix(github): keep a merged fallback PR while the phone has no head
2026-11-09 13:51:12 +00:00
Kelvin Amoaba be691385bd feat(runtime): tell phones when relay hosts change (#40122)
* feat(runtime): tell phones when relay hosts change

* fix(runtime): keep the relay host backstop live and watch every list input

* fix(mobile): hold the relay host feed only for desktops that announce changes

* perf(runtime): watch relay host inputs only while phones read the list
2026-11-09 13:50:43 +00:00
OrcaWinandOrcaWin 4c3dc79108 test: remove low-value messaging simulator and editor suites (#40363)
Co-authored-by: OrcaWin <293788423+OrcaWin@users.noreply.github.com>
2026-11-09 05:44:21 -08:00