Views
No views yet
1 arc arc/e boolq hswag obkqa piqa wino
2mxfp8 0.417,0.458,0.623,0.634,0.338,0.737,0.639
3q8-hi 0.413,0.455,0.622,0.642,0.346,0.746,0.654
4q8 0.418,0.455,0.622,0.643,0.342,0.748,0.659
5q6-hi 0.415,0.454,0.622,0.640,0.354,0.749,0.651
6q6 0.418,0.457,0.622,0.640,0.348,0.748,0.650
7mxfp4 0.419,0.472,0.622,0.634,0.352,0.739,0.644
8
9Qwen3.5-9B-Instruct
10mxfp8 0.571,0.719,0.895,0.683,0.426,0.770,0.671
11q8-hi 0.561,0.708,0.892,0.690,0.448,0.764,0.685
12q8 0.564,0.713,0.892,0.690,0.442,0.766,0.687
13q6-hi 0.550,0.713,0.892,0.689,0.442,0.762,0.690
14q6 0.545,0.705,0.891,0.689,0.432,0.766,0.691
15mxfp4 0.572,0.723,0.884,0.679,0.422,0.774,0.680
16
17Quant Perplexity Peak memory
18mxfp8 4.523 ± 0.031 14.69 GB
19mxfp4 4.839 ± 0.034 10.21 GBnightmedia/Qwen3.5-9B-Text
mxfp8 0.419,0.460,0.623,0.634,0.338,0.738,0.639
DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT
mxfp8 0.574,0.729,0.882,0.711,0.422,0.775,0.691
mxfp8 4.308 ± 0.029
mxfp4 4.458 ± 0.030
DavidAU/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED
mxfp8 0.574,0.755,0.869,0.714,0.410,0.780,0.691
mxfp4 0.545,0.724,0.878,0.708,0.402,0.771,0.680
mxfp8 4.380 ± 0.029
DavidAU/Qwen3.5-9B-Claude-Pro-Auto-Variable-INSTRUCT
mxfp8 0.610,0.816,0.885,0.665,0.456,0.768,0.676
Qwen3.5-9B-Claude-Opus-Sonnet-Pro-Auto-Variable-HERETIC-UNCENSORED-INSTRUCT
mxfp8 0.624,0.820,0.886,0.663,0.442,0.763,0.681
DavidAU/Qwen3.5-9B-Polaris-HighIQ-INSTRUCT
mxfp8 0.624,0.828,0.891,0.656,0.442,0.768,0.680pip install mlx-lm1from mlx_lm import load, generate
2
3model, tokenizer = load("Qwen3.5-9B-mxfp8-mlx")
4
5prompt = "hello"
6
7if tokenizer.chat_template is not None:
8 messages = [{"role": "user", "content": prompt}]
9 prompt = tokenizer.apply_chat_template(
10 messages, add_generation_prompt=True, return_dict=False,
11 )
12
13response = generate(model, tokenizer, prompt=prompt, verbose=True)