MOSS-Transcribe-Diarize 0.9B MLX INT8
Native MLX weights for offline, speaker-attributed transcription on Apple
Silicon. The Whisper encoder and VQ adaptor remain FP16; the tied Qwen3
decoder uses 8-bit affine group-64 weights.
| Property | Value |
|---|
| Source | OpenMOSS-Team/MOSS-Transcribe-Diarize |
| Source revision | e6d68cdfcddbdad1a7e8454f0cb859cad76e2502 |
| Parameters | 908,513,280 |
| Audio/VQ precision | FP16 |
| Decoder precision | INT8, affine group 64 |
| Context | 131,072 tokens |
| License | Apache-2.0 |
The model is offline, not streaming. Audio is encoded in 30-second chunks,
then all audio embeddings are concatenated into one globally contextualized
prompt. Transcript tokens are generated autoregressively after the complete
recording is available.
speech-swift
1speech transcribe meeting.wav \
2 --engine moss \
3 --backend mlx \
4 --model aufklarer/MOSS-Transcribe-Diarize-0.9B-MLX-INT8 \
5 --kv-cache fp16
--kv-cache int8 reduces long-context memory separately from decoder weight
quantization. Use FP16 cache when comparing INT5 and INT8 model quality.
INT4 KV cache is not exposed because it failed the structured-output quality
gate.
Matched INT5 / INT8 validation
Release build on an Apple M5 Pro with a FP16 KV cache. ASR uses 80 English-US
FLEURS clips (759.56 seconds); diarization uses five VoxConverse test
recordings (2,346.56 seconds), a 0.25-second collar, and 10 ms resolution.
The diarization files are from ggfox00000/dia-voxconverse-test, not the
Community-1 development slice used by the separate CoreML benchmark.
| Variant | WER | CER | ASR ×RT | Peak RSS | DER | JER | Diarization ×RT | Peak RSS |
|---|
| INT5 | 8.55% | 6.36% | 35.2× | 1,196 MiB | 28.05% | 26.56% | 15.5× | 1,281 MiB |
| INT8 | 8.27% | 5.98% | 31.6× | 1,407 MiB | 28.02% | 25.79% | 11.8× | 1,498 MiB |
INT5 is the smaller default; INT8 is the slight ASR-quality reference. The
five-file DER result supports parity, not a broad diarization-quality claim.
Exact metrics and fixture IDs are recorded in validation.json.
Export provenance
The bundle is produced by scripts/export_moss_mlx.py in speech-swift from
the immutable source revision above. export_config.json records tensor
counts, checksums, quantization verification, and the runtime contract.
No training or fine-tuning was performed.
Limitations
The upstream project reports support for 50+ languages and recordings up to
about 90 minutes, but does not publish an exhaustive language list. This
bundle's matched validation covers English only. Actual duration is constrained
by unified memory, KV-cache precision, transcript length, and the 131,072-token
combined context. Speaker IDs are anonymous per recording. Timestamps may
overlap or be malformed, and quantization can affect both word accuracy and
speaker attribution.
License
Apache License 2.0, inherited from the upstream model.