Views
No views yet
8238b75529e98434621204024b149860b8071d33 and validated with llama.cpp build b10066 (86a9c79f8).| File | Size | Description |
|---|---|---|
Fara1.5-9B-Q4_K_M.gguf | 5.24 GiB | Recommended balance of size and quality; 5.02 BPW |
Fara1.5-9B-Q8_0.gguf | 8.87 GiB | Higher-fidelity 8-bit quantization; 8.50 BPW |
Fara1.5-9B-mmproj-F16.gguf | 0.855 GiB | F16 vision projector required for screenshot/image input with either quant |
1llama-mtmd-cli \
2 -m Fara1.5-9B-Q4_K_M.gguf \
3 --mmproj Fara1.5-9B-mmproj-F16.gguf \
4 --image screenshot.png \
5 --image-min-tokens 1024 \
6 -ngl 99 \
7 -p "Describe the next browser action."1llama-server \
2 -m Fara1.5-9B-Q4_K_M.gguf \
3 --mmproj Fara1.5-9B-mmproj-F16.gguf \
4 --image-min-tokens 1024 \
5 -ngl 99 \
6 --ctx-size 8192qwen35, 427 tensors.clip, 334 tensors.llama-quantize Q8_0 and Q4_K_M without an importance matrix.183198b9f854655de273841116135bd7d12ea763c0fab6c198fb91de3b5fe4441 Fara1.5-9B-Q8_0.gguf
28cd4370324f5477ebd48b59ad32bdc1edc19dcb8dcf21479c7bebd3ed572dc7f Fara1.5-9B-Q4_K_M.gguf
36b9299f56b6c1cc0eab1e3404664137bdde4dbd139da2ead59502d7da340547c Fara1.5-9B-mmproj-F16.gguf