Views
No views yet

'Beam me up': Zeiss ZF-100-T/Nikon D300
1 arc arc/e boolq hswag obkqa piqa wino
2bf16 0.678,0.852,0.911
3mxfp8 0.690,0.867,0.909
4qx86-hi 0.663,0.832,0.911
5qx64-hi 0.685,0.855,0.903
6mxfp4 0.679,0.858,0.911
7
8Quant Perplexity Peak Memory Tokens/sec
9bf16 4.017 ± 0.026 60.75 GB 262
10mxfp8 4.026 ± 0.026 34.74 GB 178
11qx86-hi 3.917 ± 0.025 32.36 GB 180
12qx64-hi 4.036 ± 0.026 25.64 GB 218
13mxfp4 4.102 ± 0.027 21.30 GB 2211 arc arc/e boolq hswag obkqa piqa wino
2bf16 0.683,0.858,0.910,0.797,0.494,0.820,0.755
3mxfp8 0.695,0.869,0.910,0.791,0.504,0.824,0.760
4qx64-hi 0.688,0.859,0.903
5
6Quant Perplexity Peak Memory Tokens/sec
7mxfp8 4.006 ± 0.026 34.74 GB 187
8qx64-hi 4.098 ± 0.027 25.64 GB 2081 arc arc/e boolq hswag obkqa piqa wino
2mxfp8 0.672,0.845,0.909
3qx64-hi 0.685,0.851,0.9031 arc arc/e boolq hswag obkqa piqa wino
2Qwen3.6-27B-Instruct
3mxfp8 0.647,0.803,0.910,0.773,0.450,0.806,0.742
4qx86-hi 0.637,0.798,0.911,0.775,0.442,0.807,0.737System: You are a coding assistant. <|think_off|>
User: What's 2+2?System: You are a coding assistant. <|think_on|>
User: Implement a red-black tree in Rust.preserve_thinking flag:1models:
2 - model: Qwen/Qwen3.6-27B
3 parameters:
4 weight: 1.4
5 - model: nightmedia/Qwen3.5-27B-Engineer-Deckard-Claude-TNG-C
6 parameters:
7 weight: 0.6
8merge_method: nuslerp
9dtype: bfloat16
10name: Qwen3.6-27B-Deckard-Claude-DS9
11
12models:
13 - model: nightmedia/Qwen3.6-27B-Claude-4.6-OS
14 parameters:
15 weight: 1.4
16 - model: nightmedia/Qwen3.6-27B-Deckard-Claude-DS9
17 parameters:
18 weight: 0.6
19merge_method: nuslerp
20dtype: bfloat16
21name: Qwen3.6-27B-Architect-DS9pip install mlx-lm1from mlx_lm import load, generate
2
3model, tokenizer = load("Qwen3.6-27B-DS9-1M-qx86-hi-mlx")
4
5prompt = "hello"
6
7if tokenizer.chat_template is not None:
8 messages = [{"role": "user", "content": prompt}]
9 prompt = tokenizer.apply_chat_template(
10 messages, add_generation_prompt=True, return_dict=False,
11 )
12
13response = generate(model, tokenizer, prompt=prompt, verbose=True)