Views
No views yet

v14 branch used for the 4-bit release.Qwen/Qwen3.5-9Bv14 broad-benchmark daily-driver| Eval | Base Qwen3.5-9B-MLX-4bit | Qwenjamin Franklin |
|---|---|---|
workbench_local_agent_smoke | 63/100 | 72/100 |
full40 | 309/400 | 325/400 |
json_hard | 15/30 | 30/30 |
parser_gate | 2/3, 1/3, 1/3 | 3/3, 3/3, 3/3 |
code_smoke | 95/120 | 95/120 |
false_smoke | 102/110 | 110/110 |
tool_schema_canary | 50/175 | 106/175 |
no_tool_leakage | 99/100 | 100/100 |
1python -m mlx_lm generate \
2 --model stamsam/Qwenjamin_Franklin \
3 --prompt "Write one complete TypeScript module and return only code." \
4 --max-tokens 512 \
5 --temp 0.0