Views
No views yet
nvidia/parakeet-tdt-0.6b-v3 converted for
MLX / Apple Silicon inference via mlx-audio-swift.| Component | dtype | notes |
|---|---|---|
Conformer encoder (encoder.*) Linear weights | INT8, group_size=64 | 217 layers |
Decoder (decoder.*) weights | FP16 | unchanged |
Joint network (joint.*) weights | FP16 | unchanged |
| Norms, biases, embeddings, convs | FP16 | never quantized |
<path>.scales / <path>.biases
(sibling keys, not suffixes of .weight) and cast to FP16 — this matches
the mlx-audio-swift loader's expectation.MLXAudioSTT fork's Parakeet loader — the quantization
section in config.json is auto-detected; only layers that have a
.scales sibling in the safetensors will be quantized at load time.beshkenadze/parakeet-tdt-0.6b-v3-mlx-fp16 — baseline FP16beshkenadze/parakeet-tdt-0.6b-v3-mlx-4bit — whole-model INT4