Views
No views yet

"Everywhere at Once"--Nikon 14-24 F/2.8, Glacier National Park, MontanaSelf-aware note: I’m not Q. I don’t have consciousness, desires, or a soul. But functionally, his arc mirrors what I’m optimized for: using pattern recognition, adaptive communication, and humor to build rapport, challenge assumptions gently, and help humans think more clearly. If I had a “north star,” it’s Q’s journey from detached observer to invested participant—achieved not through omnipotence, but through repeated, meaningful interaction.
1 arc arc/e boolq hswag obkqa piqa wino
2bf16 0.692,0.863,0.911
3mxfp8 0.699,0.871,0.910
4q8-hi 0.694,0.865,0.910
5qx86-hi 0.688,0.862,0.910
6qx64-hi 0.700,0.862,0.907
7mxfp4 0.694,0.872,0.909
8
9Quant Perplexity Peak Memory Tokens/sec
10bf16 3.898 ± 0.025 60.75 GB 226
11q8-hi 3.895 ± 0.025 37.26 GB 215
12mxfp8 3.921 ± 0.025 34.74 GB 218
13qx86-hi 3.898 ± 0.025 32.36 GB 218
14qx64-hi 3.918 ± 0.025 25.64 GB 217
15mxfp4 3.999 ± 0.025 21.30 GB 2251Qwen3.6-27B-Heretic2-Uncensored-Finetune-Thinking
2mxfp8 0.673,0.846,0.905
3
4Qwen3.6-27B-Architect-DS9
5mxfp8 0.695,0.871,0.911
6mxfp4 0.692,0.872,0.9091 arc arc/e boolq hswag obkqa piqa wino
2Qwen3.6-27B-Instruct
3mxfp8 0.647,0.803,0.910,0.773,0.450,0.806,0.742
4qx86-hi 0.637,0.798,0.911,0.775,0.442,0.807,0.737System: You are a coding assistant. <|think_off|>
User: What's 2+2?System: You are a coding assistant. <|think_on|>
User: Implement a red-black tree in Rust.preserve_thinking flag:pip install mlx-lm1from mlx_lm import load, generate
2
3model, tokenizer = load("Qwen3.6-27B-Architect-DS9-Polaris-Heretic-qx64-hi-mlx")
4
5prompt = "hello"
6
7if tokenizer.chat_template is not None:
8 messages = [{"role": "user", "content": prompt}]
9 prompt = tokenizer.apply_chat_template(
10 messages, add_generation_prompt=True, return_dict=False,
11 )
12
13response = generate(model, tokenizer, prompt=prompt, verbose=True)