Views
No views yet
--spec-type draft-dflash, merged in #22105).--target-model-dir pointing at the Qwopus tokenizer. Qwopus extends the Qwen3.5 tokenizer with 7 added tokens (ids 248070 to 248076), so drafts converted against the base Qwen3.5-9B tokenizer do not pass the vocab compatibility check for this target. The draft GGUF carries no token embeddings or lm_head; llama.cpp shares the target model's at runtime, so the draft matches whatever Qwopus quant you serve.1llama-server \
2 -hf Jackrong/Qwopus3.5-9B-Coder-GGUF:Q3_K_M \
3 -hfd GauravGosain/Qwopus3.5-9B-Coder-DFlash-GGUF:Q4_K_M \
4 --no-mmproj \
5 --spec-type draft-dflash --spec-draft-n-max 15 \
6 -fa on --jinja -c 4096 -ctk q8_0 -ctv q8_0 -ctxcp 2 -fitt 256-hf and -hfd together (local -m plus -hfd currently fails to resolve the draft) and keep --no-mmproj (the target repo ships a 921 MB vision projector).-ctxcp low because each context checkpoint stores the full recurrent state (about 100 MB).| file | size | note |
|---|---|---|
| Qwopus3.5-9B-Coder-DFlash-Q4_K_M.gguf | 766 MB | recommended |
| Qwopus3.5-9B-Coder-DFlash-Q8_0.gguf | 1.4 GB | measured identical speed to Q4_K_M |
| Qwopus3.5-9B-Coder-DFlash-bf16.gguf | 2.6 GB | for requantizing |
| workload | baseline | DFlash | speedup | acceptance |
|---|---|---|---|---|
| code editing (rename a field, echo the file) | 62 tok/s | 304 tok/s | 4.9x | 0.84 |
| fresh code generation | 58 tok/s | 145 tok/s | 2.5x | 0.34 |
-fitt 256); if the target spills layers to CPU, speculation goes net-negative.--draft-quant w4 --block-tokens 8. Setup scripts in the GitHub repo.