HunyuanOCR converted to
GGUF format for inference with
llama.cpp.
This is a quantization of
Tencent's HunyuanOCR — a 1B parameter OCR expert Vision-Language Model. Native support was added in llama.cpp build
b8670 (April 2026).
1# Via Hugging Face (easiest)
2llama-server -hf AnandSingh/hunyuanocr-GGUF
3
4# Or locally
5llama-server \
6 -m HunyuanOCR-Q4_K_M.gguf \
7 --mmproj mmproj-HunyuanOCR-F16.gguf
1{
2 "messages": [
3 {
4 "role": "user",
5 "content": [
6 { "type": "text", "text": "OCR" },
7 { "type": "image_url", "image_url": { "url": "data:image/jpeg;base64,..." } }
8 ]
9 }
10 ]
11}
Original model by
Tencent Hunyuan Vision Team. GGUF conversion is not affiliated with or endorsed by Tencent.
