Views
No views yet
RespectMathias/llama.cpp. It is loaded as a DFlash GGUF because llama.cpp implements DSpark as DFlash plus Markov and confidence heads. Select DSpark proposal behavior with --spec-type draft-dspark.| Quantization | Size |
|---|---|
| BF16 | 982.91 MiB |
| Q8_0 | 523.88 MiB |
| Q6_K | 405.30 MiB |
| Q5_K_M | 349.84 MiB |
| Q4_K_M | 297.63 MiB |
| Q3_K_M | 253.57 MiB |
| Q2_K | 204.00 MiB |
Q8_0 or Q6_K is recommended for draft quality. Lower-bit draft quantization can reduce speculative acceptance enough to offset memory savings.1llama-server \
2 -m Laguna-XS-2.1-MXFP4_MOE.gguf \
3 -md Laguna-XS-2.1-DSpark-Q8_0.gguf \
4 --spec-type draft-dspark \
5 --spec-draft-n-max 151python convert_hf_to_gguf.py RespectMathias/Laguna-XS-2.1-DSpark \
2 --target-model-dir poolside/Laguna-XS-2.1 \
3 --outtype bf16 \
4 --outfile Laguna-XS-2.1-DSpark-BF16.ggufllama-quantize.draft-dspark: model loading, fused QKV, auxiliary feature norms, causal draft attention, Laguna SWA RoPE, Markov head, and token acceptance all executed successfully.