Architecture: Decoder-only transformer with delayed-streams modeling
Parameters: ~1B (STT) + ~25M (Mimi codec encoder)
Quantization: Q4_0 (4-bit) for STT transformer, f16 for Mimi codec
Languages: English, French
Streaming latency: ~500ms text delay (6 frames at 12.5Hz)
License: CC-BY 4.0 (same as original)
Quantization
The STT transformer weights were quantized from f32 to Q4_0 using a custom GGUF packer. Dequantization happens on-GPU via WGSL compute shaders at inference time. The Mimi codec encoder is stored at f16 as it runs on CPU via WASM.
Citation
If you use this model, please cite the original authors:
This is an independent port by idle intelligence, not affiliated with or endorsed by Kyutai Labs. Transcription quality may differ from the original PyTorch implementation due to quantization.