dspark-gemma4-12b-block7-Q4_0-GGUF – AI Model by ankk98 | AlphaNeural AI

You can deploy this model and start earning money today!

ankk98/
dspark-gemma4-12b-block7-Q4_0-GGUF

like

0

speculative-decoding

deepseek-ai/dspark_gemma4_12b_block7

endpoints_compatible

Views

No views yet

DSpark Gemma4 12B draft (Q4_0 GGUF)

4-bit (pure Q4_0) GGUF draft for DSpark speculative decoding with [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it).

Converted with llama.cpp ft-dspark from [deepseek-ai/dspark_gemma4_12b_block7](https://huggingface.co/deepseek-ai/dspark_gemma4_12b_block7).

Files

File	Description
`dspark_gemma4_12b_q4pure.gguf`	Draft model (~1.9 GB), `LLM_ARCH_DSPARK`

Requirements

llama.cpp built from ft-dspark (or a release that includes draft-dspark)
A separate target Gemma4 12B GGUF (not included here)

Usage

sh

llama-cli \
  -m /path/to/gemma-4-12B-it-Q4_0.gguf \
  -md ./dspark_gemma4_12b_q4pure.gguf \
  --spec-type draft-dspark \
  --spec-draft-n-max 4 \
  -c 512 -ngl 99 -ngld 99 \
  -p "Your prompt" -n 128 --temp 0