Views
No views yet
| file | size | what it is |
|---|---|---|
PaddleOCR-VL-1.6-Q4_K_M.gguf | 286 MB | decoder |
mmproj-Q8_0.gguf | 570 MB | vision projector |
1llama-mtmd-cli -m PaddleOCR-VL-1.6-Q4_K_M.gguf --mmproj mmproj-Q8_0.gguf \
2 --image crop.png -p "OCR:" --jinja --temp 0OCR:. The model expects a crop of a single text region.llama-quantize Q4_K_M from the official F16 GGUF.
Projector: convert_hf_to_gguf.py --mmproj --outtype q8_0 from the safetensors
release (llama.cpp b10150).SiglipVisionModel; the converter's mmproj
path expects PaddleOCRVisionModel, so that field was renamed before
converting. No weights were altered.