You can deploy this model and start earning money today!

pj-s/
Qwen3.5-REAP-212B-A17B-mxfp8

Name: Qwen3.5-REAP-212B-A17B-mxfp8
Availability: InStock

OpenMOSE/Qwen3.5-REAP-212B-A17B

quantized

apache-2.0

Views

No views yet

pj-s/Qwen3.5-REAP-212B-A17B-mxfp8

An Apple Silicon MLX Vision–Language MoE model created by applying 8-bit quantized mlx conversion to OpenMOSE/Qwen3.5-REAP-212B-A17B Router-weighted Expert Activation Pruning (REAP) model based on Qwen3.5-397B-A17B.

LLM runs on Mac Studio M3 Ultra+ with 256GB or 512GB unified memory.

mlx_lm.server --model pj-s/Qwen3.5-REAP-212B-A17B-mxfp8

Mac Ultra 256GB Hardware Optimization Command Reminder

Run this in terminal first to unlock memory restrictions:

sudo sysctl iogpu.wired_mem_breakpoint_cap=245760

(Or 250000 to be extreme), close any unused apps before launch.

MLX conversion and quantization settings used

bash

mlx_vlm.convert \
  --hf-path /localpath/models/OpenMOSE/Qwen3.5-REAP-212B-A17B \
  --mlx-path /localpath/models/pj-s/Qwen3.5-REAP-212B-A17B-mxfp8 \
  --quantize \       
  --q-bits 8 \                                                                                               
  --q-group-size 32 \                                                            
  --q-mode mxfp8                  