Views
No views yet
jedisct1/Qwen3.6-27B-rust-v1-MTP-4bit.mlx for the native-MTP 4-bit OptIQ sibling.jedisct1/Qwen3.6-27B-rust-v1-MTP-8bit.mlx for the native-MTP 8-bit sibling.jedisct1/Qwen3.6-27B-rust-v1-bf16.mlx if your runtime does not support native MTP weights.pip install mlx-lm1from mlx_lm import load, generate
2
3model, tokenizer = load("jedisct1/Qwen3.6-27B-rust-v1-MTP-bf16.mlx")
4
5messages = [
6 {"role": "system", "content": "You are an expert Rust developer."},
7 {"role": "user", "content": "Generate a focused patch that replaces unwrap() calls in parse_config() with proper error propagation."},
8]
9prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
10response = generate(model, tokenizer, prompt=prompt, max_tokens=500)
11print(response)