Views
No views yet
LiquidAI/LFM2.5-1.2B-Instruct-DSpark for llama.cpp (DSpark speculative decoding is in mainline, ggml-org/llama.cpp #25173).| file | quant | size | notes |
|---|---|---|---|
LFM2.5-1.2B-Instruct-DSpark-F16.gguf | F16 | 594 MB | best accept length, recommended when memory allows |
LFM2.5-1.2B-Instruct-DSpark-Q8_0.gguf | Q8_0 | 315 MB | accept length −2% vs F16 |
LFM2.5-1.2B-Instruct-DSpark-Q4_K_M.gguf | Q4_K_M | 174 MB | accept length −3% vs F16, smallest recommended — sub-4-bit draft quants measurably hurt both accept length and throughput |
1llama-server -m LFM2.5-1.2B-Instruct-F16.gguf \
2 -md LFM2.5-1.2B-Instruct-DSpark-F16.gguf \
3 --spec-type draft-dspark --spec-draft-n-max 10 --spec-draft-n-min 0 \
4 -fa on -ngl 99timings report draft_n / draft_n_accepted.| Draft (GGUF) | Target (GGUF) |
|---|---|
| LFM2.5-1.2B-Instruct-DSpark-GGUF | LFM2.5-1.2B-Instruct-GGUF |
| LFM2.5-2.6B-DSpark-GGUF | LFM2.5-2.6B-GGUF |
| LFM2.5-8B-A1B-DSpark-GGUF | LFM2.5-8B-A1B-GGUF |
LiquidAI/LFM2.5-1.2B-Instruct-DSpark for acceptance-length tables (H100 and Apple silicon) and target benchmarks.1@article{liquidAI202626B,
2 author = {Liquid AI},
3 title = {LFM2.5-2.6B: Agents Everywhere},
4 journal = {Liquid AI Blog},
5 year = {2026},
6 note = {www.liquid.ai/blog/lfm2-5-2-6b},
7}1@article{liquidAI2026dspark,
2 author = {Liquid AI},
3 title = {LFM2.5-DSpark: Up to 3.2x Faster Inference from H100 to MacBook},
4 journal = {Liquid AI Blog},
5 year = {2026},
6 note = {www.liquid.ai/blog/lfm2.5-dspark},
7}