You can deploy this model and start earning money today!

tomngdev/
MTP-Qwen3.6-35B-A3B-GGUF

Name: MTP-Qwen3.6-35B-A3B-GGUF
Availability: InStock

Views

No views yet

MTP-Qwen3.6-35B-A3B-GGUF

This repository contains MTP GGUF files only for Qwen/Qwen3.6-35B-A3B.

It does not include the full base model. These files are intended to be used as the MTP / speculative decoding component together with the matching full model GGUF.

Q4_K_M and Q8_0 quants used unsloth/Qwen3.6-35B-A3B-MTP-GGUF for recipe.

Files

File	Quant	Size
`mtp-BF16.gguf`	BF16	3.48 GiB
`mtp-F16.gguf`	F16	3.48 GiB
`mtp-Q8_0.gguf`	Q8_0	1.85 GiB
`mtp-Q4_K_M.gguf` (Recommended)	Q4_K_M	1.51 GiB

Usage

Example with llama-server:

bash

llama-server \
  -m /path/to/Qwen3.6-35B-A3B.gguf \
  -md /path/to/mtp-Q4_K_M.gguf \
  --spec-type draft-mtp \
  --spec-draft-n-max 2

Notes

These files are not usable standalone.
Use only with the matching base model.
License follows the original base model license.

tomngdev/MTP-Qwen3.6-35B-A3B-GGUF

MTP-Qwen3.6-35B-A3B-GGUF

Files

Usage

Notes

tomngdev/
MTP-Qwen3.6-35B-A3B-GGUF