A Gemma4-26B-A4B-based pocket model that loads in any app today — Ollama, LM Studio, PocketPal — with no bleeding-edge runtime needed. Korean-tuned, GPU-optional.
POCKET-26B takes Google's Gemma4-26B-A4B (25.2B total, ~4B active MoE, Apache-2.0) and re-quantizes it with our proprietary Korean-tuned quantization — unpruned, so quality holds. Unlike our Qwen-based POCKET (which needs a very recent llama.cpp build for its qwen35moe architecture), Gemma4 loads in every mainstream runtime today: Ollama, LM Studio, PocketPal, koboldcpp, and the browser.
Single greedy pass, 198 items → ±~3 pp noise. Our proprietary Korean-tuned quantization is statistically lossless vs the base.
Files in this repo
File
Size
Runs on
Best for
POCKET-26B-Q4_K_M.gguf
17 GB
PC / high-RAM
top quality
POCKET-26B-Q2_K.gguf ⭐
11 GB
12 GB phone / PC / browser
universal daily driver
Our mixed-precision quantization keeps the most quality-critical weights at higher precision — that is why Q2_K holds 67.2% while a plain uniform Q2 collapses to ~44%.
No fork, no bleeding-edge build — Gemma4 support has shipped in every mainstream runtime since April 2026.
Lineage (honest)
Based on google/gemma-4-26B-A4B-it (Apache-2.0). We do not re-host it unchanged — we add our proprietary Korean-tuned quantization (VIDRAFT). We deliberately do not prune it: Gemma4's low-bit robustness collapses under pruning (measured), so we keep all 128 experts and win on quality + universal compatibility instead.
Limitations
For 8 GB phones (~5 GB budget), use POCKET-KR-GGUF (5.1 GB) — Gemma4 cannot be shrunk that far without collapse.
On-device iPhone/Mac throughput not yet measured by us — community reports welcome.
