Views
No views yet
OpenMOSS-Team/MOSS-Transcribe-preview-2B, an English speech-to-text model pairing a Qwen3-1.7B-base decoder with a Qwen3-Omni-MoE audio encoder and a gated-MLP adapter (~2.4B parameters, Apache-2.0 upstream).moss-mlx-conversion project.| Directory | Precision | Size | Notes |
|---|---|---|---|
MOSS-Transcribe-preview-2B-bf16/ | bf16 | 4.6 GB | Reference MLX-layout conversion; matched PyTorch transcript exactly on the LibriSpeech smoke fixture. |
MOSS-Transcribe-preview-2B-text-decoder-4bit-g64/ | 4-bit affine, group 64 (text decoder only) | 2.7 GB | Strongest quantized candidate in the conversion project: 2.48 RTFx on the first 20 LibriSpeech clean-test rows with no bf16 WER regression on that slice. |
MOSS-Transcribe-preview-2B-all-4bit-g64/ | 4-bit affine, group 64 (all weights) | 1.3 GB | Full-model 4-bit; retained as a size-optimal candidate. |
config.json, the Qwen ByteLevel tokenizer files, and the conversion/quantization reports produced by the converter.mlx-lm. MOSS-Transcribe is a multimodal audio-encoder + adapter + Qwen3-decoder architecture with no upstream mlx-lm model type. Load them with the conversion project's runtime:1git clone https://github.com/chikingsley/peacock-asr
2cd peacock-asr/projects/moss-mlx-conversion
3uv run moss-streaming-eval --weights <variant-dir> # streamed LibriSpeech WER evalREADME.md and docs/PROGRESS.md for the smoke test (moss-mlx-smoke), the local backend (MossTranscribeBackend.generate), and eval harness details.1@misc{moss_transcribe_2025,
2 title = {{MOSS-Transcribe-preview-2B}},
3 author = {{OpenMOSS Team}},
4 year = {2025},
5 howpublished = {\url{https://huggingface.co/OpenMOSS-Team/MOSS-Transcribe-preview-2B}}
6}