Views
No views yet
Join the Discord for updates, roadmaps, projects, or just to chat.
HuggingFace's "Hardware Compatibility" widget doesn't recognize K_P quants — it may show fewer files than actually exist. Click "View +X variants" or go to Files and versions to see all available downloads.
| File | Quant | BPW | Size |
|---|---|---|---|
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf | Q8_K_P | 9.4 | 7.6 GB |
| — | Q8_0 | 8.5 | — |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q6_K_P.gguf | Q6_K_P | 7.0 | 5.9 GB |
| — | Q6_K | 6.6 | — |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q5_K_P.gguf | Q5_K_P | 6.1 | 5.5 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q5_K_M.gguf | Q5_K_M | 5.7 | 5.4 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf | Q4_K_P | 5.2 | 5.1 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf | Q4_K_M | 4.8 | 5.0 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf | IQ4_XS | 4.3 | 4.8 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q3_K_P.gguf | Q3_K_P | 4.1 | 4.6 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q3_K_M.gguf | Q3_K_M | 3.9 | 4.6 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf | IQ3_M | 3.7 | 4.4 GB |
| Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf | Q2_K_P | 3.5 | 4.2 GB |
| mmproj-Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-f16.gguf | mmproj (f16) | — | 945 MB |
temperature=1.0, top_p=0.95, top_k=64--jinja flag with llama.cpp for proper chat template handlingmmproj file alongside the main GGUF1# Text only
2llama-cli -m Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
3 --jinja -c 8192 -ngl 99
4
5# With vision/audio
6llama-cli -m Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
7 --mmproj mmproj-Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-f16.gguf \
8 --jinja -c 8192 -ngl 99