Views
No views yet
| Feature | Value |
|---|---|
| Parameters | 9 billion |
| Context length | 256k tokens (default) |
| Quantization | Use at least q4ks or IQ3S |
| Repetition penalty | Keep it at 1.0 (off) |
| Modes | Thinking (default) or Instruct (no‑thinking) |
temperature=1.0, top_p=0.95, top_k=20."chat_template_kwargs": {"enable_thinking": False}.1from openai import OpenAI
2client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
3
4response = client.chat.completions.create(
5 model="Qwen/Qwen3.5-9B",
6 messages=[{"role": "user", "content": "Explain quantum computing simply"}],
7 temperature=1.0,
8 top_p=0.95,
9 extra_body={"top_k": 20}
10)
11print(response.choices[0].message.content)