Comprehensive audio studio library for React Native and Expo with recording, analysis, visualization, and streaming capabilities across iOS, Android, and web platforms.
iOS Demo
Android Demo
Try AudioPlayground: Complete audio processing app built with this library
Try it in the Playground
**Give it a GitHub star 🌟, if you found this repo useful.**
[](https://github.com/deeeed/expo-audio-stream)
> **Note:** This package was formerly known as `@siteed/expo-audio-stream`. The name has been changed to better reflect the expanded capabilities beyond just audio streaming.
## Features
- Real-time audio streaming across iOS, Android, and web.
- Audio input device detection and selection:
- List and select from available audio input devices
- View detailed device capabilities (sample rates, channels, bit depths)
- Support for Bluetooth, USB, and wired devices
- Automatic device management with fallback options
- Intelligent detection refresh for Bluetooth devices
- Dual-stream recording capabilities:
- Simultaneous raw PCM and compressed audio recording
- Compression formats: OPUS or AAC
- Configurable bitrate for compressed audio
- Optimized storage for both high-quality and compressed formats
- Intelligent interruption handling:
- Automatic pause/resume during phone calls
- Configurable automatic resumption
- Detailed interruption event callbacks
- Configurable intervals for audio buffer receipt.
- Automated microphone permissions setup in managed Expo projects.
- Background audio recording on iOS.
- Audio features extraction during recording.
- Consistent WAV PCM recording format across all platforms.
- Keep recording active while app is in background
- Zero-latency recording with preparation API:
- Pre-initialize audio recording to eliminate startup delay
- Prepare permissions, audio buffers, and sessions in advance
- Start recording instantly when needed
- Rich notification system for recording status:
- Android: Live waveform visualization in notifications
- Android: Fully customizable notification appearance and actions
- iOS: Media player integration
- Advanced audio analysis capabilities:
- Mel spectrogram generation for machine learning and visualization
- Comprehensive audio feature extraction (MFCC, spectral features, etc.)
- Lightweight waveform preview generation
- Precision audio manipulation:
- Advanced audio splitting and trimming API
- Support for trimming multiple segments in a single operation
- Ability to keep or remove specific time ranges
- Complete ecosystem:
- Full-featured AudioPlayground application showcasing advanced API usage
- Ready-to-use UI components via [@siteed/expo-audio-ui](https://github.com/deeeed/expo-audio-stream/tree/main/packages/expo-audio-ui) package
- Visualizations, waveforms, and audio controls that can be directly incorporated into your app
## Audio Analysis Features
Extract powerful audio features for advanced audio processing and visualization:
```typescript
// Extract audio analysis with specific features enabled
const analysis = await extractAudioAnalysis({
fileUri: 'path/to/recording.wav',
features: {
energy: true, // Overall energy of the audio
rms: true, // Root mean square (amplitude)
zcr: true, // Zero-crossing rate
mfcc: true, // Mel-frequency cepstral coefficients
spectralCentroid: true, // Brightness of sound
tempo: true, // Estimated BPM
}
});
```
### Available Audio Features
- **Basic Analysis**: RMS, energy, amplitude range, zero-crossing rate
- **Spectral Features**: Spectral centroid, flatness, rolloff, bandwidth
- **Advanced Analysis**:
- MFCC (Mel-frequency cepstral coefficients)
- Chromagram (pitch class representation)
- Mel Spectrogram
- Harmonics-to-noise ratio
- Tempo estimation
- Pitch detection
### Use Cases
- Visualize audio waveforms with detailed metrics
- Implement speech recognition preprocessing
- Create music analysis applications
- Build audio fingerprinting systems
- Develop voice activity detection
## API Overview
The library provides several specialized APIs for different audio processing needs:
### Recording and Playback
- **useAudioRecorder**: Hook for recording audio with configurable quality settings
- **AudioRecorderProvider**: Context provider for sharing recording state across components
- **useSharedAudioRecorder**: Hook to access shared recording state from any component
```typescript
// Start a new recording with configuration
const { startRecording, stopRecording, isRecording, recordingUri } = useAudioRecorder({
audioQuality: 'high',
sampleRate: 44100,
numberOfChannels: 2,
bitDepth: 16,
outputFormat: 'wav',
});
// Use the prepare API for zero-latency recording
const { prepareRecording, startRecording, stopRecording } = useSharedAudioRecorder();
// First prepare the recording - this initializes all resources
await prepareRecording({
sampleRate: 44100,
channels: 2,
encoding: 'pcm_16bit'
});
// Later when needed, start instantly with no delay
await startRecording(/* same config as prepare */);
// Share recording state across components
const AudioApp = () => (
