A step-by-step tutorial on integrating OpenAI's Whisper speech recognition model locally into a React Native app using the whisper.rn library. Covers downloading GGML-format models from HuggingFace via Expo File System, storing them on-device, requesting microphone permissions with Expo Audio, and implementing both real-time transcription and audio file transcription. Includes a custom React hook (useWhisperModels) to manage model state, download progress, and context initialization. Works on both Android and iOS without any API costs since inference runs entirely on-device.

1h 5m watch time

Sort: