Native MLX MXFP8 quantization of google/diffusiongemma-26B-A4B-it — a block-diffusion language model (NOT autoregressive): text generates as 256-token canvases refined by iterative denoising. 30-layer Gemma-4-style MoE, 128 experts top-8, 26B total / ~4B active parameters.

Runs natively in Osaurus on Apple Silicon via the vmlx-swift block-diffusion engine.

All diffusion sampling parameters live in generation_config.json and are honored by the runtime: max_denoising_steps=48, entropy bound 0.1, temperature schedule 0.8→0.4, stability 1, confidence 0.005, eos_token_id=[1, 106, 50], pad 0. Wire temperature/top_p are ignored by design — the denoising schedule is bundle-owned. Speed/quality is controlled by the denoising-step budget (Osaurus exposes this as a server setting, default 16 ≈ 2× faster than the bundle default and verified coherent; below 12 quality degrades).

The chat template (chat_template.jinja) ships in this repo, including tool-call and thinking-channel rendering.

Very terse prompts under greedy denoising can occasionally converge to an empty (EOS-first) canvas — inherent to the reference sampling algorithm with random canvas initialization; retry or rephrase.