Moonshine Streaming Tiny
Model Overview
Moonshine is a high-efficiency automatic speech recognition (ASR) model designed specifically for real-time speech recognition. Unlike Whisper, which processes audio in fixed 30-second chunks, Moonshine uses a variable-length architecture that only computes the actual duration of the speech received.
Useful Sensors developed Moonshine and released the English model as open-source. There are 2 models of different sizes and capabilities - base and tiny. The tiny version utilizes 27M parameters.
Moonshine Streaming Tiny is based on Moonshine V2, released in 2026, introduced sliding window attention in the encoder part of the model. This means we no longer need to wait for the full-length of speech to start emitting the first token, reducing the time-to-first-token (TTFT) as the encoder can now "stream" the encoding frames to the decoder.
Model Features
- Model Type: Automatic Speech Recognition
- Input: Raw waveform (1D array of floats) 16kHz mono audio up to 30 seconds
- Output: Sequence of token IDs (integers)
- Quantization: None
Recommended Platforms
- Synaptics Astra™ SL2600-Series with Torq
Metrics
| Platform | Model / Stage | Environment | Real-Time Factor (RTF) | Tokens / s | Metric Type |
|---|
| SL2610 | Moonshine Tiny Encoder | Torq v2.1.0 | 0.38 | N/A | Mean (Global average) |
| SL2610 | Moonshine Tiny Decoder | Torq v2.1.0 | 0.68 | 36.6 | Mean (Global average) |
Deployment
Compiled Models
Torq compiled model files are provided in this repository. To recompile the models, see the
Torq Documentation.
Source Models
The source model files are available at TBD.
Usage Tutorials / Example Apps
Example App GitHub Repositories
- Moonshine Streaming Example (moonshine_streaming) in Torq Examples: Basic model usage examples for Torq
License
Both the source model and the compiled model for on-device deployment are licensed under
MIT License.
Learn More
- Synaptics AI Developer Zone: Get started with documentation, tutorials and resources for your Edge AI journey.
- Astra Support Portal: Connect with our engineering team and community.
