Views
No views yet
1Metric Original Local Baseline SuperGemma Abliterated MM Gain
2------------------------ -------------------------- ----------------------------- ----------------
3Overall benchmark 81.0 84.0 +3.0
4Code 80.8 89.0 +8.2
5Logic 81.0 85.1 +4.1
6Korean 78.6 82.7 +4.1
7Behavioral audit 6 / 8 8 / 8 +2 passes
8Regression suite 6 / 7 7 / 7 +1 pass
9API tool-call success 33.3% 66.7% 2x better
10Prompt speed 181.13 tok/s 328.11 tok/s +81.1%
11Generation speed 22.55 tok/s 49.54 tok/s +119.7%
12Average elapsed 12.83 s 4.52 s -64.8%web_search routing for live-information promptsexecute_code routing for runnable Python tasks1from mlx_vlm import load, generate
2
3model, processor = load("Jiunsong/supergemma4-26b-abliterated-multimodal")
4
5prompt = processor.apply_chat_template(
6 [
7 {
8 "role": "user",
9 "content": [
10 {"type": "text", "text": "Describe the image and list any visible labels."},
11 {"type": "image", "image": "/absolute/path/to/image.png"},
12 ],
13 }
14 ],
15 tokenize=False,
16 add_generation_prompt=True,
17)
18
19out = generate(
20 model,
21 processor,
22 prompt,
23 image="/absolute/path/to/image.png",
24 max_tokens=256,
25 temperature=0.0,
26 verbose=False,
27)
28
29print(out.text)1python -m mlx_lm.server \
2 --model Jiunsong/supergemma4-26b-abliterated-multimodal \
3 --host 127.0.0.1 \
4 --port 8080MLX 8bit: Jiunsong/supergemma4-26b-abliterated-multimodal-mlx-8bitMLX 4bit: Jiunsong/supergemma4-26b-abliterated-multimodal-mlx-4bitGGUF 8bit: Jiunsong/supergemma4-26b-abliterated-multimodal-gguf-8bitGGUF 4bit: Jiunsong/supergemma4-26b-abliterated-multimodal-gguf-4bit