Views
No views yet
| File | Quant | Size | Use Case |
|---|---|---|---|
Ministral-8B-Instruct-Q8_0.gguf | Q8_0 | ~8.5GB | Maximum quality |
Ministral-8B-Instruct-Q6_K.gguf | Q6_K | ~6.6GB | Near-lossless |
Ministral-8B-Instruct-Q5_K_M.gguf | Q5_K_M | ~5.7GB | High quality |
Ministral-8B-Instruct-Q4_K_M.gguf | Q4_K_M | ~4.9GB | Recommended default |
Ministral-8B-Instruct-Q3_K_M.gguf | Q3_K_M | ~3.9GB | Low VRAM |
Ministral-8B-Instruct-IQ4_XS.gguf | IQ4_XS | ~4.3GB | Imatrix 4-bit |
Ministral-8B-Instruct-IQ3_XXS.gguf | IQ3_XXS | ~3.2GB | Imatrix 3-bit |
Ministral-8B-Instruct-IQ2_M.gguf | IQ2_M | ~2.8GB | Imatrix 2-bit |
Ministral-8B-Instruct-IQ1_S.gguf | IQ1_S | ~2.0GB | Extreme compression |
Ministral-8B-Instruct-fp16.gguf | FP16 | ~16.0GB | Full precision |
imatrix.dat | — | — | Importance matrix |
1./llama-cli -m Ministral-8B-Instruct-Q4_K_M.gguf \
2 --ctx-size 8192 -n 512 \
3 -p "[INST] Hello! [/INST]"
4
5ollama run hf.co/DuoNeural/Ministral-8B-Instruct-GGUF:Q4_K_M| Platform | Link |
|---|---|
| HuggingFace | huggingface.co/DuoNeural |
| Website | duoneural.com |
| GitHub | github.com/DuoNeural |
| X / Twitter | @DuoNeural |
| duoneural@proton.me | |
| Newsletter | duoneural.beehiiv.com |
| Support | buymeacoffee.com/duoneural |