Views
No views yet
1 arc arc/e boolq hswag obkqa piqa wino
2qx86-hi 0.443,0.498,0.857,0.701,0.372,0.770,0.752
3qx64-hi 0.435,0.494,...
4mxfp4 0.460,0.527,0.871,0.694,0.370,0.772,0.752
5
6Quant Perplexity Peak Memory
7qx86-hi 3.888 ± 0.025 33.34 GB
8qx64-hi 3.917 ± 0.025 26.62 GB
9
10Qwen3.5-27B-Text-heretic
11qx64-hi 3.931 ± 0.025 26.62 GB1TeichAI/Qwen3.5-27b-Opus-4.6-Distill
2qx64-hi 0.459,0.542,0.724,0.764,0.402,0.790,0.783
3
4DavidAU/Qwen3.5-27B-Polaris-Advanced-Thinking-Alpha
5mxfp4 0.473,0.548,0.709,0.728,0.396,0.777,0.753
6
7DavidAU/Qwen3.5-27B-Claude-4.6-OS-Auto-Variable-Thinking
8mxfp8 0.485,0.566,0.875,0.746,0.408,0.789,0.7301DavidAU/Qwen3.5-27B-Claude-4.6-OS-INSTRUCT
2mxfp8 0.675,0.827,0.900,0.750,0.496,0.800,0.721
3qx86-hi 0.667,0.822,0.900
4qx64-hi 0.664,0.820,0.902
5mxfp4 0.653,0.815,0.8991Huihui-Qwen3-VL-32B-Thinking-abliterated
2qx86-hi 0.376,0.449,0.823,0.637,0.378,0.772,0.681
3
4unsloth-Qwen3-VL-32B-Instruct
5qx86x-hi 0.447,0.593,0.904,0.610,0.432,0.738,0.5941nightmedia/Qwen3-32B-Element5-Heretic
2qx86-hi 0.483,0.596,0.738,0.754,0.394,0.802,0.710
3
4UIGEN-FX-Agentic-32B
5qx86-hi 0.460,0.527,0.681,0.721,0.404,0.790,0.728
6pip install mlx-lm1from mlx_lm import load, generate
2
3model, tokenizer = load("Qwen3.5-27B-Text")
4
5prompt = "hello"
6
7if tokenizer.chat_template is not None:
8 messages = [{"role": "user", "content": prompt}]
9 prompt = tokenizer.apply_chat_template(
10 messages, add_generation_prompt=True, return_dict=False,
11 )
12
13response = generate(model, tokenizer, prompt=prompt, verbose=True)