Views
No views yet
mlx-vlm 0.6.3. Full multimodal: vision encoder + language model, no precision loss.
For Apple Silicon. Runs in mlx-vlm or any MLX app.qwen3_5_moe loader expects
them fused/batched. A sanitize monkeypatch was required to stack the experts before conversion;
without it the conversion failed.1uvx --from mlx-vlm mlx_vlm.generate \
2 --model mlx-community/Ornith-1.0-35B-bf16 --image image.png \
3 --prompt "Describe this image." --max-tokens 5121from mlx_vlm import load, generate
2model, processor = load("mlx-community/Ornith-1.0-35B-bf16")17 * 24 solved as 408), no repetition loop. 69 tok/s
generation, peak 72 GB on a Macbook Pro M5 Max 128GB 40 GPU.