SEBK4C/

gemma4-serving-bench-data

Test data, charts, and the running research log from an autonomous research loop characterizing and tuning a Gemma 4 12B QAT-Q4_0 model served via llama.cpp/llamafile on a single RTX 3080 Ti. Every ~30 min the loop summarizes findings, proposes a goal, tests it end-to-end, documents success or failure, and publishes here + to GitHub.

Model under test: gemma-4-12b-it-qat-q4_0.gguf (Google, June 2026), 128K ctx, f16 KV, MTP… See the full description on the dataset page: https://huggingface.co/datasets/SEBK4C/gemma4-serving-bench-data.