Views
No views yet
Gemma 4 26B IT on real local agent tasksFast is part of the release identity, not just a minor variant| Metric | Gemma 4 26B IT original 4bit | SuperGemma Fast |
|---|---|---|
| Quick bench overall | 91.4 | 95.8 |
| Avg generation speed | 42.5 tok/s | 46.2 tok/s |
| Delta overall | baseline | +4.4 |
| Delta speed | baseline | +8.7% |
| Category | Original | SuperGemma Fast | Delta |
|---|---|---|---|
| Code | 92.3 | 98.6 | +6.3 |
| Browser | 87.5 | 89.6 | +2.1 |
| Logic | 86.9 | 95.2 | +8.3 |
| System Design | 97.8 | 98.9 | +1.1 |
| Korean | 90.7 | 95.0 | +4.3 |
13GB95.8 vs 91.446.2 tok/s vs 42.5 tok/s+6.3+8.3+4.3+2.11mlx_lm.server \
2 --model Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2 \
3 --port 8080mlx_lm.server auto-detect the bundled template.--chat-template /path/to/chat_template.jinja as a literal path string on launch paths that expect the template body. That can corrupt responses.1mlx_lm.generate \
2 --model Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2 \
3 --prompt "Write a Python function that returns prime numbers up to n." \
4 --max-tokens 512benchmark_quick_bench_20260412.jsonbenchmark_quick_bench_20260412_responses.jsonlSERVING_NOTES.md