24 KiB
Mobile push: contract and build spec
Tracking issue: stablyai/orca#8129. Design page: /tmp/orca-mobile-push/orca-mobile-push.html.
This document is the single contract every lane builds against. Do not deviate without updating it.
Summary
A small Orca-hosted push gateway (cloud/apps/push) holds the APNs key and FCM credentials and sends
to phones. The desktop host registers each paired phone's native push token with the gateway and asks
the gateway to push on every mobile notification it already fans out over the socket. The phone dedupes
by notificationId#notificationSeq. No ack gate, no generic mode, no staging gateway, one auth path for
signed-in and accountless hosts.
Identities
- Host public key: the desktop's existing X25519 E2EE public key (
src/main/runtime/e2ee-keypair.ts), 32 bytes, base64. The phone already stores it per host aspublicKeyB64. - hostFingerprint:
sha256(hostPublicKey)base64url, first 16 chars. Identical derivation toderiveRelayHostIdinsrc/main/runtime/relay/relay-http-client.ts. Both desktop and phone can compute it. - deviceId: the desktop's
DeviceEntry.deviceIdfor the paired phone. Opaque UUID. - registrationId: gateway-assigned opaque id for one (hostFingerprint, deviceId) pair.
Gateway HTTP API
Base URL: https://push.onorca.dev (dev override via env). JSON bodies, Content-Type: application/json.
All schemas are zod, .strict(), exported from cloud/packages/push-contract.
Host authentication: challenge, proof, session
The host keypair is X25519 (box), so it cannot sign. Reuse the relay's challenge shape.
POST /v1/host/challenge
{ "v": 1, "hostPublicKeyB64": "<32 bytes b64>" }
→ 200
{ "challengeId": "<opaque>", "gatewayEphemeralPublicKeyB64": "<32 b64>", "nonceB64": "<24 b64>",
"ciphertextB64": "<b64>", "expiresAt": <epoch ms> }
- Gateway generates an ephemeral box keypair per challenge, a 24-byte nonce, and a 32-byte secret.
plaintext = "orca-push-host-challenge/v1\0" || u32be(len(transcript)) || transcript || secret(32)ciphertext = nacl.box(plaintext, nonce, hostPublicKey, gatewayEphemeralSecretKey)- Transcript is the relay's length-prefixed field encoding (
field(name, value)= u32be(len(name)) || name || u32be(len(value)) || value), fields in this exact order:protocol="orca-push-host-proof/v1",version=0x01,gatewayOrigin,gatewayEphemeralPublicKey,challengeNonce,challengeId,issuedAt(u64be ms),expiresAt(u64be ms),hostFingerprint,hostPublicKey. - Challenge TTL 10 s, and 10 s is the whole window the gateway honours. The 30 s clock skew tolerance is the host's alone: it validates a timestamp the gateway chose, so it needs the allowance and the gateway does not. A gateway that subtracted the tolerance from its own check would run a 40 s TTL. Store challenge (id, secret hash, host fingerprint, host public key, expiry) in DB so any Cloud Run instance can verify. Expired rows are pruned 30 s late so a slow proof reads as expired rather than as an unknown challenge.
- Issuing a challenge writes no
push_hostsrow. It is unauthenticated, so apush_hostsrow would be a free permanent write for any caller. The row is upserted inPOST /v1/host/sessiononce the proof verifies, from the public key the challenge row carries.
POST /v1/host/session
{ "v": 1, "challengeId": "<opaque>", "proofB64": "<32 b64>" }
- Host opens the box with its secret key, validates every transcript field (same checks as
validateTranscriptinsrc/main/runtime/relay/relay-host-proof.ts, adapted to the push fields), and returnsproof = HMAC-SHA256(secret, "orca-push-host-proof/v1\0ack\0" || transcript). - Gateway verifies with
timingSafeEqual, consumes the challenge (single use), and returns
{ "sessionToken": "<opaque 32 b64url>", "expiresAt": <epoch ms>, "hostFingerprint": "<16 chars>" }
- Session TTL 24 h. Stored hashed (sha256) in DB. Bearer on every other call:
Authorization: Bearer <sessionToken>. 401 with{ "error": "session_expired" }on expiry; host re-runs the challenge.
Device registration
POST /v1/devices (Bearer)
{ "v": 1, "deviceId": "<uuid>", "platform": "ios" | "android", "token": "<native token>",
"apnsEnvironment": "sandbox" | "production", // ios only, required for ios
"filter": { "sources": ["agent-task-complete", "terminal-bell", "plugin"],
"agentStates": ["needs-input", "finished"] } }
→ 200 { "registrationId": "<opaque>" }. Upsert keyed by (hostFingerprint, deviceId); a new token
replaces the old. deviceId is caller-chosen, so a host is capped at 64 registrations: the 65th
distinct deviceId → 409 { "error": "too_many_devices" }. Re-registering a deviceId the host
already owns is always accepted, and deleting a registration frees its slot. GET /v1/devices is
bounded at 1024 rows to match its response schema, which the per-host cap keeps well out of reach.
filter is stored but enforced by the host (see desktop); gateway stores it only so a
host restart can re-read it. iOS tokens are variable-length, hex-encoded byte strings; Android
tokens are FCM registration strings.
DELETE /v1/devices/:registrationId (Bearer) → 204. Only the owning host may delete.
GET /v1/devices (Bearer) → { "devices": [{ registrationId, deviceId, platform, dead: boolean }] }.
Send
POST /v1/send (Bearer)
{ "v": 1,
"registrationIds": ["<id>", "..."],
"notification": {
"notificationId": "<max 2048 chars, may be absent for terminal-bell>",
"notificationSeq": <int>, "notificationEpoch": "<uuid>",
"source": "agent-task-complete" | "terminal-bell" | "plugin",
"agentState": "needs-input" | "finished" | null,
"title": "<max 80 chars>", "body": "<max 180 chars>",
"worktreeId": "<max 2048 chars|absent>" } }
→ 200
{ "results": [{ "registrationId": "<id>", "status": "queued" | "dead" | "rate_limited" | "error" }] }
queuedmeans accepted into the coalescing window.deadmeans the provider reported the token unregistered; the host must drop the registration. Never block the socket fan-out on this call.- Quota: 60 sends per hostFingerprint per rolling hour, 200 per registration per rolling day. Over quota
→
rate_limitedper result, HTTP 200. Whole request over a hard cap of 20 registrationIds → 400. The cap counts the ids as sent; the gateway then dedupes them, so a repeated id spends quota once, yields one result, and counts once towardcoalescedCount.resultsmay therefore be shorter thanregistrationIds, and callers must match a result by itsregistrationId, never by position. - Notification JSON is limited to 3000 UTF-8 bytes to leave provider envelope space; identities are preserved exactly, including long filesystem paths. Oversized payloads fail validation.
- Gateway retries are deduplicated by host, registration, notification epoch, and sequence in the
quota ledger for its 25-hour retention window. Duplicates return
queuedwithout reserving quota or enqueueing another delivery. - Both quota counters are reserved under a per-host lock held for the whole transaction. PostgreSQL reads at READ COMMITTED, so a concurrent count-then-insert would otherwise admit a whole burst.
Request limits and unauthenticated abuse
- Every POST is capped at 16 KiB by a streaming body limit, not by
Content-Lengthalone: a chunked body declares no length. Over the cap → 413{ "error": "request_too_large" }. POST /v1/host/challengeandPOST /v1/host/sessionare the only unauthenticated routes. They share one token bucket per client IP, 30 requests per minute, refilling continuously. Over the bucket → 429{ "error": "rate_limited" }. The client IP is the lastx-forwarded-forhop, not the first: Cloud Run appends the connecting peer, so everything left of that value is caller-supplied and can be a fresh forgery on every request, which would hand a flood a new bucket each time.ORCA_PUSH_TRUSTED_PROXY_HOPS(default 0) says how many appenders sit between the platform and the client, so a future load balancer sets it to 1. A header with fewer hops than that depth is not trusted at all. Falls back tox-real-ipand then to a single shared bucket. The bucket is per instance and in memory, so the effective cap scales with the instance count; it exists to blunt a flood, not to meter.- Every other
/v1route is capped by a second, wider bucket per client IP, 240 requests per minute, applied before the bearer is looked up. A bearer has to be read from the database before it can be refused, and that read takes one of only two pool connections per instance, so without this cap a flood of forged bearers would starve real hosts of the pool while every one of them got a 401. - The gateway cannot prove that a host owns the token it registers: any host with a session may register any well-formed token and send text to it, within its own quota. The phone drops such a push in the foreground because the fingerprint resolves to no paired host, and never routes a tap on it, but the OS banner shows while the app is backgrounded. Reaching it needs the victim's native token, which the gateway never returns and which only the phone and its host ever see.
Coalescing (gateway)
Per registrationId, hold sends for 3 s. If one event arrives, send it as-is. If N>1 arrive, send one
summary: title Orca, body <N> agents need attention (or <N> updates when no needs-input), data
carries the latest event's fields plus coalescedCount. Collapse id for a summary is
host:<hostFingerprint> so a later summary replaces it. The window is held in memory per gateway
instance, so with more than one instance a burst can produce up to one summary per instance; accepted
for this release, and the collapse id keeps the phone showing one banner. Transient provider errors
retry at most three attempts within two minutes, honoring Retry-After and FCM minimum delays. Permanent failures
are not retried. Unregister/dead-token state is re-read before every attempt. Shutdown stops admission
and drains admitted requests, pending windows, and active deliveries before closing resources;
a nine-second hard deadline remains below Cloud Run's termination grace. Delivery remains in memory.
Provider payloads
APNs (HTTP/2, api.push.apple.com or api.sandbox.push.apple.com by apnsEnvironment; JWT auth
from key id + team id + .p8, token cached and refreshed every 50 min):
- headers:
apns-topic: com.stably.orca.mobile,apns-push-type: alert,apns-priority: 10,apns-expiration: now+4h,apns-collapse-id: <notificationId truncated to 64 bytes, or host:<fp>> - body:
{"aps":{"alert":{"title","body"},"sound":"default","thread-id":"<hostFingerprint>"}, "orca":{ hostFingerprint, worktreeId, notificationId, notificationSeq, notificationEpoch, source, agentState, coalescedCount }} - Dead token: 410, or 400 with
BadDeviceToken/Unregistered/DeviceTokenNotForTopic.
FCM (V1 projects/onorca-cloud/messages:send, bearer from the runtime service account via the GCE
metadata server or GOOGLE_APPLICATION_CREDENTIALS locally):
{"message":{"token","notification":{"title","body"},"android":{"priority":"HIGH","ttl":"14400s", "collapse_key":"<sha256(collapseId) hex 32>","notification":{"channel_id":"orca-desktop","tag":"<collapseId>"}}, "data":{ all orca fields as strings }}}- Dead token:
UNREGISTERED, orINVALID_ARGUMENTwhose message names the token.
Gateway storage (Postgres in prod, SQLite in tests, same pattern as cloud/apps/relay/src/database.ts)
push_hosts(host_fingerprint pk, host_public_key, created_at, last_seen_at), written only on a verified proof and pruned after 1 h of no contact when nopush_devicesrow still names the host. Nothing reads it, and any keypair mints a host for free, so it is not allowed to accumulate.push_sessionsholds one row per host, enforced by a unique index and transaction lock. Minting a session deletes the host's earlier one, since a desktop holds a single session and only re-proves once it is gone.push_challenges(challenge_id pk, host_fingerprint, host_public_key, secret_hash, transcript, expires_at, consumed_at)push_sessions(token_hash pk, host_fingerprint, expires_at, created_at)push_devices(registration_id pk, host_fingerprint, device_id, platform, token, apns_environment, filter_json, dead_at, created_at, updated_at, unique(host_fingerprint, device_id))push_send_log(host_fingerprint, registration_id, sent_at)for quota, pruned after 25 h.
Logging: aggregate counters only. Never log tokens, titles, bodies, or raw fingerprints (log the first 4 chars of a fingerprint at most).
Gateway env
PORT, ORCA_PUSH_PUBLIC_URL, ORCA_PUSH_DATABASE_URL (absent → SQLite under ORCA_PUSH_DATA_DIR),
ORCA_PUSH_APNS_KEY (PEM text), ORCA_PUSH_APNS_KEY_ID, ORCA_PUSH_APPLE_TEAM_ID,
ORCA_PUSH_APNS_TOPIC (default com.stably.orca.mobile), ORCA_PUSH_FCM_PROJECT_ID (default
onorca-cloud), ORCA_PUSH_COALESCE_MS (default 3000), ORCA_PUSH_TRUSTED_PROXY_HOPS (default 0,
proxies appending to x-forwarded-for after the client).
Secret Manager names (already exist in onorca-cloud): orca-cloud-push-apns-key,
orca-cloud-push-apns-key-id, orca-cloud-push-apple-team-id. Runtime SA:
orca-cloud-push@onorca-cloud.iam.gserviceaccount.com (already has FCM admin + secret accessor).
Desktop (src/main, src/shared)
- Capability
NOTIFICATIONS_REMOTE_PUSH_RUNTIME_CAPABILITY = 'notifications.remote-push.v1'insrc/shared/protocol-version.ts, advertised statically. - RPC
notifications.registerPushparams{ platform, token, apnsEnvironment?, filter }(same shapes as the gatewayPOST /v1/devicesminus deviceId, which comes fromctx.pairedDeviceId). Returns{ registered: true, registrationId } | { registered: false, reason: 'gateway_unreachable' | 'gateway_rejected' | 'not_mobile' | 'registration_storage_failed' | 'throttled' }. A device may register at most 10 times per minute (throttledbeyond that, its earlier registration untouched): each call is a gateway write plus a synchronous registry write on the main thread, and a paired phone could otherwise loop it. The unregister RPC is not throttled, since with nothing registered it is a lookup and with something registered it can only run once per successful register. The params schema is strict, so a caller-supplieddeviceIdis an error, not a key silently dropped. PersistspushRegistration: { registrationId, platform, filter, registeredAt }onDeviceEntryindevice-registry.ts(new optional field, tolerated by old registries). When the gateway accepted the token but the host could not store it — the device left mobile scope mid-call (not_mobile) or the registry write threw (registration_storage_failed) — the host queues the gateway delete in the unregister outbox rather than leaking a registration nothing will ever push to. Registration, unregister, and outbox deletes are serialized per device; re-registration first settles earlier cleanup. Authentication failure never drops a durable delete. Stale send responses only clear the exact local registration observed, while provider dead-token updates match the token/platform/environment that was sent. Phones must treat anyregistered: falseas "retry later", so an unknown reason string is safe to add. - RPC
notifications.unregisterPushparams null →{ unregistered: boolean }. Removes the field and enqueues a gateway delete in a durable outbox (src/main/runtime/push/push-unregister-outbox.ts, modelled onrelay-revoke-outbox.ts). Unpair/revoke (revokeMobileDevice) enqueues the same. The drain re-reads the queue as it goes, so a delete queued mid-drain lands in the same pass, and a pass that leaves retryable items schedules an unref'd backoff retry (30 s, doubling, capped at 10 min) instead of waiting for the next launch. - Both RPCs added to
runtime-rpc-mobile-method-allowlist.ts. - Push client
src/main/runtime/push/push-gateway-client.ts: challenge/proof/session with token cache, register, delete, send. Nodefetch. Gateway URL fromprofile-cloud-auth-config.ts(pushGatewayUrl, defaulthttps://push.onorca.dev, env overrideORCA_PUSH_GATEWAY_URL). - Host proof answering: new
src/main/runtime/push/push-host-proof.ts, a copy of the relay'sanswerRelayHostChallengewith the push transcript fields. Shared code with the relay proof is welcome if it stays a pure refactor. - Dispatch hook: in
RuntimeMobileNotificationController.dispatch, after the socket fan-out, callpushDispatcher.enqueue(eventWithSeq). The dispatcher applies each device'sfilter, skipsdismissevents, mapsagentStatetoneeds-input | finished(blocked/waiting → needs-input, else finished), batches matching registrationIds intoPOST /v1/sendrequests of at most 20 registrations each (the gateway's per-request cap; extra devices get their own request rather than being dropped), and drops unchanged registrations the gateway reportsdead. Failure categories are counted without payload values and logged at most once per minute (with a final flush on shutdown). Fire-and-forget with one retry after 2 s per request; never throws into dispatch. - Add
agentStatetoMobileNotificationDispatchEventand set it insrc/main/ipc/notifications.tsfromargs.agentState. FixbuildAgentTaskCompleteNotificationOptionssoworking|running|busynever yields "finished" (title says "working" and the dispatcher treats it as not-final, i.e. no push). - Headless serve: no renderer means no
notifications:dispatch. Document indocs/reference/headless-linux-server.md; do not fix here.
Mobile (mobile/)
- Commit
google-services.json(from/tmp/orca-mobile-push/google-services.json) atmobile/and set"android": { "googleServicesFile": "./google-services.json" }inapp.json. Add"expo-notifications"topluginsso prebuild writes theaps-environmententitlement. - Token:
Notifications.getDevicePushTokenAsync();datais the APNs hex or FCM string. iOSapnsEnvironment:__DEV__ ? 'sandbox' : 'production'(dev-client builds are debug, TestFlight and App Store are release). Listen withaddPushTokenListenerand re-register on change. - Settings (
mobile/app/notifications.tsx): single "Background notifications" switch, default off, hint text exactly: "Get alerts while Orca is closed. Alerts show the same text as on your desktop. That text, your phone's push token, and opaque host and device ids pass through Orca's push service and Apple or Google. Turning this off or unpairing deletes the token." Event controls live in the shared notification-preferences section and apply to both connected and background notifications. Hide the whole section, with copy "Update your desktop app to enable background notifications", when no paired host advertisesnotifications.remote-push.v1. - Registration: on switch-on (after OS permission), and on every host reaching
connectedwhile the switch is on, callnotifications.registerPushon that host if it advertises the capability. On switch-off callnotifications.unregisterPushon every connected host and remember to retry on hosts that were offline. On host removal, best-effort unregister before deleting credentials. - Receive:
addNotificationReceivedListener(foreground) checksdata.orca.notificationId+notificationSeqagainst the host session seen set innotification-reconnect-catchup.ts; if seen, suppress viasetNotificationHandlerreturning no banner; otherwise show and mark seen. Background and killed: OS shows it. - Tap:
data.orca.hostFingerprint→ hostId by computing the same sha256/base64url/16 derivation over each stored host'spublicKeyB64; then existinggetNotificationNavigationTarget+useOpenNotificationRoute. - Reopen: existing replay catch-up runs unchanged. Dismiss events also
dismissNotificationAsyncany presented notification whosedata.orca.notificationIdmatches. - Old host without the capability: nothing changes.
Infra (cloud/infra/terraform, .github/workflows)
- Cloud Run service
orca-cloud-push, regionus-central1, project from the environment tfvars, runtime SAorca-cloud-push@<project>.iam.gserviceaccount.com(exists in prod; declare and import), the three secrets mounted as env (exist; declare and import), Cloud SQL connector to the shared instance with its own databaseorca_push, min instances 1, max 4, concurrency 80, ingress all, unauthenticated invoke. - IAM:
roles/firebasecloudmessaging.adminandroles/serviceusage.serviceUsageConsumeron the runtime SA (exist in prod; declare and import). Secret accessor per secret. - Hostname
push.onorca.dev. The DNS zone lives in the apps root instablyai/orca-cloud; add the Cloud Run domain mapping here and leave a TODO comment naming the record the other repo must add. - Workflow
.github/workflows/cloud-push-deploy.yml: gated onvars.ORCA_CLOUD_OPERATIONS_ENABLED, Workload Identity likecloud-relay-*, builds the image, deploys with--no-traffic, probes the new revision's/readyand a validate-only FCM send, then shifts 100% traffic. Uses.github/actions/cloud-sql-rollout-leasearound the schema step. - Add the new root files to
cloud/dev/contractsandcloud/dev/fixturespartitions soterraform-root-partition.test.mjsandCloud Verifypass.
Non-goals for this release
Ack gate, generic-alert mode, staging gateway, iOS Notification Service Extension, Android data-only messages, Live Activities, account-based quota tiers, dismissal via silent push.
Device delivery preferences
The desktop advertises notifications.delivery-preferences.v1. Completion detection remains
active when desktop notifications are off; semantic validity checks still precede delivery.
IPC publishes desktopAllowed: false for terminal events disabled by the desktop master or
source switch. Desktop focus and native authorization remain desktop-only delivery gates.
notifications.subscribe and notifications.getMissedSince accept optional
includeDesktopSuppressed: true. Only opted-in callers receive those events, including replay;
legacy callers keep the old filtered stream. A new phone against an older host can narrow the
available events but cannot recover events that host never published.
The phone defaults to following each host. filter.followDesktop is optional: absent retains
legacy desktop gating; explicit false permits independent event choices. The desktop persists
it with the paired registration and evaluates it for every send, so desktop preference changes
work while the phone is disconnected. This flag is host-local and is not sent to the gateway.
The phone uses the same shared event predicate for socket/replay delivery as the push dispatcher.
Optional emittedAt carries the event time for per-device five-second burst suppression after
source filtering. Desktop eligibility, source, and agent state use separate upstream cooldown
buckets so filtered events cannot suppress the next eligible event. Legacy RPC callers retain
workspace-wide burst suppression on the host.
filter.sound is also host-local. False groups that device's requests separately and adds
optional notification.sound: false to gateway sends. The gateway omits APNs aps.sound and
uses Android's orca-desktop-silent channel. Missing sound preserves existing audible delivery.
Deploy the updated gateway before distributing hosts that send the optional sound field: older
gateways strictly reject unknown notification fields. No token or database migration is needed.
The phone's master switch disables background registration as well as local scheduling. Sound and viewing preferences belong to the receiving phone. The phone suppresses a banner for its currently viewed host/workspace only while active; it never assumes desktop focus means the phone is viewing that workspace. Changes to an offline host's persisted filter take effect on reconnection. No live APNs/FCM delivery is implied by simulator notification injection.
For a phone registered for background push, socket notification delivery waits while the app is inactive. On foreground, it checks the native push tray before scheduling a local fallback, so a still-connected background socket cannot duplicate APNs/FCM delivery. Unsubscribing cancels the wait without claiming delivery. Hosts without push registration keep local delivery.
Native notification readers accept Expo's iOS request.trigger.payload as well as
request.content.data. APNs custom fields can exist only in the former; foreground deduplication,
tray replay suppression, dismissal, and tap routing all use the same reader.