Views
No views yet
qwen35moe)mmproj)| File | Quant | Notes |
|---|---|---|
LUMIX-35B-Q4_K_M.gguf | Q4_K_M | recommended |
LUMIX-35B-Q5_K_M.gguf | Q5_K_M | |
LUMIX-35B-Q6_K.gguf | Q6_K | |
LUMIX-35B-Q8_0.gguf | Q8_0 | near-lossless |
LUMIX-35B-f16.gguf | F16 | full precision |
Lumix-35B-mmproj.gguf | — | vision projector (pair with any quant for image input) |
1llama-cli -hf Blackfrost-AI/Lumix-35B:Q4_K_M
2# vision: also pass --mmproj Lumix-35B-mmproj.gguf and an --imageollama run hf.co/Blackfrost-AI/Lumix-35B:Q4_K_M