Parameter count: approximately 31.27B logical target parameters (31B
class). 6-bit is the target quantization precision, not a 6B model-size
claim. The separately packaged assistant is an acceleration component and is
not included in the target count.
This is a self-contained MLX model package for Apple Silicon. It combines
the Gemma 4 31B instruction-tuned target with its exact paired Google assistant
model for AX Engine multi-token prediction (MTP) / speculative decoding.
The target model verifies every drafted token. The assistant improves decode
speed without replacing the target model or changing its output distribution.
This repository does not contain PyTorch or GGUF target weights.
The target weight shards and assistant weights are byte-identical to the pinned
upstream revisions. AX Engine adds native manifests, an assistant pairing
contract, an AX-compatible assistant configuration, and a target-tokenizer copy
inside assistant/.
Gemma assistant MTP is enabled by default. AX Engine reads
ax_gemma4_assistant_mtp.json, loads the compact drafter from assistant/, and
uses the 31B target to verify proposals. Do not load assistant/ by itself as a
general-purpose chat model.
The target weights can also be used for direct MLX generation, but the nested
assistant acceleration and pairing contract are AX Engine-specific.
