Views
No views yet
speech-llm model type (requires the
speech-llm model-family patches, see
TigreGotico/onnx-asr PR #3).encoder.onnx (audio -> projected audio embeddings), embed_tokens.onnx,
and a merged prefill+decode decoder.onnx with a 28-layer KV cache. Prompt token ids are baked
into config.json, so no tokenizer is needed at runtime. fp32 output matches native
transformers character-for-character on FLEURS test clips (en, pt). fp32 and int8 graphs included.1import onnx_asr
2model = onnx_asr.load_model("speech-llm", "path/to/this/repo") # or quantization="int8"
3print(model.recognize("audio_16khz.wav"))