Huihui-Qwen3.6-27B-abliterated-mlx-nvfp4

Overview

• Format: MLX-VLM
• Precision: nvfp4
• Size: 15G
• q_mode: nvfp4
• q_bits: 4
• Source model type: Qwen3_5ForConditionalGeneration
• Source pipeline: image-text-to-text
• Intended runtime: mlx-vlm, LM Studio

Validation

• text generation smoke test: passed
• image generation path smoke test: passed

Quantization

• Quantization mode: nvfp4
• Quantization bits: 4

Test Results (2026-04-23)

• Both text and image tests completed successfully.
• This build gives the lowest peak memory and the highest measured generation speed among the three local variants.
• The current mlx_vlm runtime still emits <think> content even with --processor-kwargs '{"enable_thinking": false}'.