This build tracks the BF16 artifact lineage from llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-GGUF. oMLX oQ quantization operates on MLX/safetensors checkpoints rather than GGUF files, so this build uses the corresponding BF16 safetensors checkpoint from llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved and excludes the existing GGUF quantizations.

Variant

Quantization: oQ8
Variant: Text Only
MTP tensors: stripped
Text-only: true
Approximate target density: 8.63 bpw.
The vision/audio-side weights are removed from the output config and shards.

Usage

omlx serve dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Text-Only-oQ8-MLX

or with mlx-lm:

python

from mlx_lm import generate, load

model, tokenizer = load("dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Text-Only-oQ8-MLX")
print(generate(model, tokenizer, "Hello", max_tokens=64))

Validation

Local validation completed with the bundled oMLX runtime:

text

loader: mlx_lm.load
generation smoke test: passed
prompt: Hello
max tokens: 4
peak memory: 26.798 GB

Source

BF16 source checkpoint: llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved
BF16 GGUF reference: llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-GGUF
Quantization tool: oMLX oQ

Upstream model card license tag: apache-2.0.