You can deploy this model and start earning money today!

Mia-AiLab/
Gemmable-4-12B-MTP-GGUF

Name: Gemmable-4-12B-MTP-GGUF
Availability: InStock

Views

No views yet

Gemmable 4 12B

Gemmable 4 12B is a GGUF export of Gemma 4 12B fine-tuned on Fable-5 style reasoning and assistant traces.

Follow Mia on X

Highlights

Base model: google/gemma-4-12B
Format: GGUF
Training style: Fable-5 style reasoning and assistant traces
Distribution: fp16 GGUF plus matching assistant GGUFs for each quant
Intended use: local inference, coding, reasoning, and assistant workflows

How to use

llama.cpp

Standard load:

llama-server -m "gemmable-4-12b-fp16.gguf"

Speculative / draft-MTP load:

bash

llama-server -m "gemmable-4-12b-Q4_K_M.gguf" \
  --spec-draft-model "gemmable-4-12b-Q4_K_M-mtp.gguf" \
  --spec-type draft-mtp \
  --spec-draft-n-max 4

Use the matching fp16 or quantized main file with its -mtp companion.

LM Studio

Search this repo, download target + mtp file.
Load target.
Load settings → Speculative Decoding → select mtp file file.

(Requires LM Studio with am17an's PR merged or custom llama.cpp runtime. As of 2026-05, mainline LM Studio runtime doesn't yet have draft-mtp for Gemma-4 — track upstream merge.)

GGUF / local inference notes

gemmable-4-12b-fp16.gguf is the standard fp16 main model.
gemmable-4-12b-fp16-mtp.gguf is the matching fp16 assistant / draft file.
Quantized pairs follow the same pattern, for example gemmable-4-12b-Q4_K_M.gguf and gemmable-4-12b-Q4_K_M-mtp.gguf.
Keep the paired files in the same Hugging Face repository if you upload them.

Limitations

Output quality depends on the prompt and runtime settings.
MTP / speculative support depends on the client application.
This is not a raw base checkpoint; it is a fine-tuned export.

Naming

Gemmable = Gemma + Fable-style tuning.

Mia-AiLab/Gemmable-4-12B-MTP-GGUF