You can deploy this model and start earning money today!

Radamanthys11/
Qwen3.5-122B-A10B-DFlash-GGUF

Name: Qwen3.5-122B-A10B-DFlash-GGUF
Availability: InStock

z-lab/Qwen3.5-122B-A10B-DFlash

quantized

endpoints_compatible

conversational

Views

No views yet

Qwen 3.5 122B A10B DFlash GGUF

GGUF made to use in ikawrakow/ik_llama.cpp, currently for PR #1970. The small quantizations delivered here are made for test purposes; feel free to create your own quantization.

Derived from the safetensors DFlash draft model z-lab/Qwen3.5-122B-A10B-DFlash.

Compatible target model

Qwen_Qwen3.5-122B-A10B.gguf - Mainly tested with IQ3_M.

Files

File	Quant	Size
`qwen35-122b-a10b-dflash-F16.gguf`	F16	983 MB
`qwen35-122b-a10b-dflash-Q8_0.gguf`	Q8_0	527 MB
`qwen35-122b-a10b-dflash-Q4_K_M.gguf`	Q4_K_M	299 MB

Usage

bash

./build/bin/llama-server \
  --model <target.gguf> \
  --model-draft <draft.gguf> \
  --spec-type dflash:n_max=<N>,cross_ctx=<N> ...

Notes

This repo contains DFlash draft models, not a standalone instruct model.
Use it with the matching target family listed above.
Q4_K_M and Q8_0 are small test-oriented quants; create your own quant if you need a different tradeoff.

Radamanthys11/Qwen3.5-122B-A10B-DFlash-GGUF