Views
No views yet
Built with mlx-optiq, the MLX-native toolkit to quantize, fine-tune, and serve LLMs locally on Apple Silicon, no PyTorch and no cloud. All OptiQ quants · Docs · Qwen3.5 family
| Property | Value |
|---|---|
| Base | badtheorylabs/BTL-4 |
| Architecture | qwen3_5_moe — sparse mixture-of-experts |
| Method | OptiQ mixed-precision, per-layer bit allocation reused from the base family |
| On disk | 22.2 GB (bf16: 70.2 GB) |
1pip install mlx-optiq
2optiq serve --model mlx-community/BTL-4-OptiQ-4bit1from mlx_lm import load, generate
2
3model, tokenizer = load("mlx-community/BTL-4-OptiQ-4bit")
4prompt = tokenizer.apply_chat_template(
5 [{"role": "user", "content": "List the files in the current directory."}],
6 add_generation_prompt=True, tokenize=False,
7)
8print(generate(model, tokenizer, prompt=prompt, max_tokens=512))