Views
No views yet
Join the Discord for updates, roadmaps, projects, or just to chat.
HuggingFace's "Hardware Compatibility" widget doesn't recognize K_P quants — it may show fewer files than actually exist. Click "View +X variants" or go to Files and versions to see all available downloads.
| File | Quant | BPW | Size |
|---|---|---|---|
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf | Q8_K_P | 10.06 | 44 GB |
| — | Q8_0 | 8.5 | — |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q6_K_P.gguf | Q6_K_P | 7.07 | 31 GB |
| — | Q6_K | 6.6 | — |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q5_K_P.gguf | Q5_K_P | 6.47 | 28 GB |
| — | Q5_K_M | 5.7 | — |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf | Q4_K_P | 5.40 | 23 GB |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf | Q4_K_M | 4.88 | 21 GB |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ4_NL.gguf | IQ4_NL | 4.56 | 20 GB |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ4_XS.gguf | IQ4_XS | 4.32 | 19 GB |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q3_K_P.gguf | Q3_K_P | 4.39 | 19 GB |
| — | Q3_K_M | 3.9 | — |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ3_M.gguf | IQ3_M | 3.56 | 15 GB |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q2_K_P.gguf | Q2_K_P | 3.46 | 15 GB |
| Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-IQ2_M.gguf | IQ2_M | 2.69 | 11 GB |
| mmproj-Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-f16.gguf | mmproj (f16) | — | 899 MB |
temperature=1.0, top_p=0.95, top_k=20, min_p=0, presence_penalty=1.5temperature=0.6, top_p=0.95, top_k=20, min_p=0, presence_penalty=0temperature=0.7, top_p=0.8, top_k=20, min_p=0, presence_penalty=1.5temperature=1.0, top_p=1.0, top_k=40, min_p=0, presence_penalty=2.0--jinja flag with llama.cpp for proper chat template handlingmmproj file alongside the main GGUF1llama-cli -m Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf \
2 --mmproj mmproj-Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-f16.gguf \
3 --jinja -c 131072 -ngl 99