Views
No views yet
qwen35)mmproj)| File | Quant | Notes |
|---|---|---|
Lumix-4B-Q3_K_M.gguf | Q3_K_M | smallest |
Lumix-4B-Q4_K_M.gguf | Q4_K_M | recommended |
Lumix-4B-Q5_K_M.gguf | Q5_K_M | |
Lumix-4B-Q6_K.gguf | Q6_K | |
Lumix-4B-Q8_0.gguf | Q8_0 | near-lossless |
Lumix-4B-f16.gguf | F16 | full precision |
Lumix-4B-mmproj.gguf | — | vision projector (pair with any quant for image input) |
1llama-cli -hf Blackfrost-AI/Lumix-4B:Q4_K_M
2# vision: also pass --mmproj Lumix-4B-mmproj.gguf and an --imageollama run hf.co/Blackfrost-AI/Lumix-4B:Q4_K_M