Views
No views yet
tokenizer.json so the volume is self-contained.qwen3.6-27b-gguf: the GGUF carries the
model's trained multi-token-prediction head (one extra layer), and llm-chat's
"draft": "mtp" setting uses it for speculative decoding - the head proposes
the next few tokens at near-zero cost and the trunk verifies them in one pass.
Output is byte-for-byte the trunk's own (exact-match verification); the head
only changes speed. No separate draft model, no second weights allocation -
prefer this volume over the plain 27b + a draft-model pairing.mmproj files and no tokenizer.json.
This volume carries ONLY the one served quant plus the tokenizer (same
rationale as the sibling volumes).| File | Upstream | Revision | sha256 |
|---|---|---|---|
Qwen3.6-27B-UD-Q4_K_XL.gguf | unsloth/Qwen3.6-27B-MTP-GGUF | 5cb35eb3dcbf52dbce5f87dbc64df6aaffadcace | 4085665ee36d82a672a238a43f0e5643f2f0e39f2d7bd5d373f0ef10ecf53095 |
tokenizer.json | Qwen/Qwen3.6-27B | (byte-identical family copy) | 5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42 |
qwen3.6-27b-gguf / qwen3.5-9b-gguf /
qwen3.5-122b-gguf / qwen3.5-0.8b-gguf copies (vocab 248320,
<|im_end|> 248046 / <|endoftext|> 248044).qwen35, hybrid-SSM trunk + 1 dense-attention MTP
layer): 64 trunk layers, full_attention_interval 4 (16 trunk KV layers), 4 KV
heads, head_dim 256. For VRAM budgeting count the MTP head as one more
full-attention KV layer (17 total) - its context is created lazily when a
speculative session first opens.LICENSE is the Apache-2.0 text; both upstreams are Apache-2.0./models/qwen3.6-27b-mtp-gguf.