Views
No views yet
Join the Discord for updates, roadmaps, projects, or just to chat.
| File | Quant | Size |
|---|---|---|
| Qwen3-4B-2507-Instruct-Uncensored-HauhauCS-Aggressive-FP16.gguf | FP16 | 7.5 GB |
| Qwen3-4B-2507-Instruct-Uncensored-HauhauCS-Aggressive-Q8_0.gguf | Q8_0 | 4.0 GB |
| Qwen3-4B-2507-Instruct-Uncensored-HauhauCS-Aggressive-Q6_K.gguf | Q6_K | 3.1 GB |
| Qwen3-4B-2507-Instruct-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf | Q4_K_M | 2.4 GB |
temperature=0.6top_p=0.95top_k=20min_p=0/no_think at the end of your prompt, ortemperature=0.7top_p=0.8top_k=20min_p=0--jinja flag for proper chat template handling<think>...</think> tags before responses1# llama.cpp example
2./llama-cli -m Qwen3-4B-2507-Instruct-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
3 -p "Hello" --jinja -c 8192