Views
No views yet
temperature=1.0, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0temperature=0.7, top_p=0.80, top_k=20, min_p=0.0, presence_penalty=1.5, repetition_penalty=1.0temperature=0.6 with presence_penalty=1.5. Slightly lower temp keeps tool-call formatting tight; presence 1.5 keeps thinking from spiraling in long agent loops.--jinja with llama.cpp for proper chat template handlingmmproj file alongside the main GGUFrope_parameters if you actually need >262K contextHeads up: Qwen3.6 does not support the/thinkand/no_thinksoft switches that Qwen3 had. You must use the chat-template kwarg below.
enable_thinking to false in the template kwargs1llama-server -m Qwen3.6-27B-Uncensored-HauhauCS-Balanced-Q4_K_P.gguf \
2 --mmproj mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Balanced-f16.gguf \
3 --jinja -c 131072 -ngl 99 \
4 --chat-template-kwargs '{"enable_thinking": false}'1{
2 "model": "qwen3.6-27b",
3 "messages": [{"role": "user", "content": "..."}],
4 "chat_template_kwargs": {"enable_thinking": false}
5}openai SDK:1client.chat.completions.create(
2 model="qwen3.6-27b",
3 messages=[{"role": "user", "content": "..."}],
4 extra_body={"chat_template_kwargs": {"enable_thinking": False}},
5){"chat_template_kwargs": {"preserve_thinking": true}}1llama-cli -m Qwen3.6-27B-Uncensored-HauhauCS-Balanced-Q4_K_P.gguf \
2 --mmproj mmproj-Qwen3.6-27B-Uncensored-HauhauCS-Balanced-f16.gguf \
3 --jinja -c 131072 -ngl 99