mirror of
https://github.com/stablyai/orca.git
synced 2026-11-16 02:47:34 +00:00
* fix(mobile): finish Android dictation on a call, alarm or leaving the app A transient audio-focus loss (call, alarm, assistant) left the mic recording silence, and pausing the activity closed the mic only to reopen it on resume, splicing a silent gap into the dictation. Both now end the recording and emit an interruption, so dictation finishes and inserts what was heard. The dictation hook also finishes when the app goes to the background, which covers iOS and shells without this native change. * fix(mobile): keep a dictation that is waiting on the Android mic prompt * fix(mobile): keep Android recording state consistent across the focus and JS threads * refactor(mobile): name the Android pause path for what it does and stop retaking focus on resume * fix(mobile): keep what the open mic heard when leaving during a pending host start * fix(mobile): close the open mic at once when leaving during a pending host start * fix(mobile): a second page capture end waits for the stop already in flight
Orca Two Way Audio
Vendored Expo module for capturing PCM microphone audio in the Orca mobile app (iOS and Android). Orca uses it for voice dictation; the upstream playback path was removed because nothing played audio through it.
The following features are provided:
- Request audio recording permissions
- Get clean (applying Acoustic Echo Cancelling) microphone samples in PCM format (1 channel 16 bit at 16kHz)
- Provide the input volume level. Float between 0 and 1.
- [iOS only] Get microphone mode and prompt user to select a microphone mode.
Installation
npm i @orca/expo-two-way-audio
Usage
-
Request permissions for recording audio
import {useMicrophonePermissions} from "@orca/expo-two-way-audio"; const [micPermission, requestMicPermission] = useMicrophonePermissions(); console.log(micPermission); -
Initialize the module before calling any audio functionality.
useEffect(() => { const initializeAudio = async () => { await initialize(); }; initializeAudio(); }, []); -
Get microphone samples
// Set up a function to deal with microphone sample events. // In this case just print the data in the console. useExpoTwoWayAudioEventListener( "onMicrophoneData", useCallback<MicrophoneDataCallback>((event) => { console.log(`MIC DATA: ${event.data}`); }, []), ); // Unmute the microphone to get microphone data events toggleRecording(true);
Notes
Some audio features of expo-two-way-audio like Acoustic Echo Cancelling, noise reduction or microphone modes (iOS) don't work on simulator. Run the Orca mobile app on a real device to test these features.
# iOS
npx expo run:ios --device --configuration Release
# Android
npx expo run:android --device --variant release
For Android, the following permissions are needed: RECORD_AUDIO, MODIFY_AUDIO_SETTINGS. In Expo apps they can bee added in your app.json file:
expo.android.permissions: ["RECORD_AUDIO", "MODIFY_AUDIO_SETTINGS"]