You can deploy this model and start earning money today!

AutomatosX/
AX-Qwen3.6-27B-MLX-OptiQ-4bit-MTP

Name: AX-Qwen3.6-27B-MLX-OptiQ-4bit-MTP
Availability: InStock

Views

No views yet

AX Qwen3.6 27B MLX OptiQ 4-bit MTP

Parameter count: approximately 27.36B logical target parameters (27B class). 4-bit is the target quantization precision, not a 4B model-size claim. The separately packaged MTP sidecar is not included in the target count.

This is a self-contained MLX package for Apple Silicon. It combines the pinned upstream OptiQ mixed-precision target with an AX Engine-compatible multi-token-prediction (MTP) sidecar.

Try this model locally with AX Engine.

Attribution and changes

AutomatosX did not train Qwen3.6-27B or create its OptiQ quantization. The target model comes from mlx-community/Qwen3.6-27B-OptiQ-4bit at revision ae732c7dcf5120c4038eaacfa89c97d8b4a7ed21.

AutomatosX used AX Engine's prepare_mtp_sidecar.py flow to extract the MTP head from Qwen/Qwen3.6-27B at revision 6a9e13bd6fc8f0983b9b99948120bc37f49c13e9, apply the required RMSNorm-delta normalization, quantize projections to 4-bit with group size 64, patch the runtime config, and generate the AX manifests. The upstream OptiQ card is preserved as UPSTREAM_README.md.

No new training or benchmark results are claimed by AutomatosX.

Package details

Property	Value
Target format	MLX Safetensors
Target quantization	OptiQ mixed 4/8-bit, group size 64
OptiQ allocation	276 components at 4-bit; 220 at 8-bit
Achieved target BPW	4.7687
Vision tower	Bundled BF16 sidecar
AX MTP sidecar	15 logical tensors; 4-bit projections
Maximum draft depth	3
Configured context	262,144 tokens
Intended hardware	Apple Silicon

The package retains the upstream optiq/mtp.safetensors file and adds the AX-prepared root mtp.safetensors. AX Engine uses the root sidecar through the mlx_lm_extra_tensors config entry.

Download and serve

bash

hf download AutomatosX/AX-Qwen3.6-27B-MLX-OptiQ-4bit-MTP \
  --local-dir ./AX-Qwen3.6-27B-MLX-OptiQ-4bit-MTP

ax-engine doctor \
  --mlx-model-artifacts-dir ./AX-Qwen3.6-27B-MLX-OptiQ-4bit-MTP

ax-engine serve ./AX-Qwen3.6-27B-MLX-OptiQ-4bit-MTP --port 31418

The download is approximately 19 GB. The server exposes an OpenAI-compatible API. Consult the AX Engine repository for installation and API examples.

AX-specific files

mtp.safetensors: AX-prepared MTP sidecar
mtplx_runtime.json: draft-depth and sampler guidance
ax_mtp_sidecar_manifest.json: sanitized, revision-pinned provenance
model-manifest.json: AX native target manifest
config.json: upstream target config with the AX sidecar registration

Validation

Validated on macOS arm64 with AX Engine 6.9.0 on 2026-07-20:

AX artifact doctor: ready, with no model issues
Safetensors headers, data bounds, and index mappings: passed
MTP tensor-layout exactness baseline: maximum absolute difference 0.0 at context length 2,048
Source and destination revisions are immutable and recorded in the provenance manifest

Quantization can change model quality, and speculative-decoding acceptance depends on the workload. Evaluate this package on your own tasks.

License

Apache License 2.0. See LICENSE, the original Qwen model card, and the pinned upstream OptiQ card for limitations and responsible-use guidance.