Views
No views yet
mlx-gen
(the sdxl generator). Each tier is a self-contained diffusers turnkey snapshot (U-Net + both
CLIP text encoders + VAE + tokenizers + scheduler + model_index.json) that loads directly — no
in-app quantization pass, no dense transient.| dir | precision | what's quantized |
|---|---|---|
q4/ (default) | group-wise affine Q4, group size 64 | U-Net Linears + both CLIP encoders |
q8/ | group-wise affine Q8, group size 64 | U-Net Linears + both CLIP encoders |
bf16/ | dense (full-precision master) | nothing — verbatim source mirror |
mlx-gen's load-time nn.quantize (bf16 cast, group 64), so a
tier loaded here matches an in-app-quantized dense checkpoint bit-for-bit.1use mlx_gen::{LoadSpec, WeightsSource, Quant};
2let spec = LoadSpec::new(WeightsSource::Dir("…/realvisxl-mlx/q4".into())).with_quant(Quant::Q4);
3let g = mlx_gen::load("sdxl", &spec)?;LICENSE.