This page contains quantized GGUF files for the model
sam-paech/gemma-3-12b-it-dm-001.
Quants are made with imatrix calibration using Bartowski's public
imatrix dataset.
The graph below gives a good idea on how these quants should perform. Data is grabbed from the llama.cpp page on
perplexity.
image/png
