Views
No views yet
Join the Discord for updates, roadmaps, projects, or just to chat.
temperature=1.0, top_p=0.95, top_k=20, min_p=0, presence_penalty=1.5temperature=0.6, top_p=0.95, top_k=20, min_p=0, presence_penalty=0temperature=0.7, top_p=0.8, top_k=20, min_p=0, presence_penalty=1.5temperature=1.0, top_p=1.0, top_k=40, min_p=0, presence_penalty=2.0--jinja flag with llama.cpp for proper chat template handlingmmproj file alongside the main GGUF1# Text only
2llama-cli -m Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
3 --jinja -c 131072 -ngl 99
4
5# With vision
6llama-cli -m Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-Q4_K_M.gguf \
7 --mmproj mmproj-Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-f16.gguf \
8 --jinja -c 131072 -ngl 99256x2.6B in the params column instead of 35B-A3B — this is a cosmetic metadata quirk, the model runs correctly.