Ektome Qwen3.8-27B oQ6e MLX + MTP
Near-lossless MLX oQ6e quantization of
Zynerji/Ektome-Qwen3.8-27B-PristinelyUncensored,
with the native 15-tensor MTP head and full vision tower preserved.
The Ektomē refusal-removal work belongs to Zynerji. This repository contributes
the MLX/oMLX quantization, independent tensor/geometry audit, and runtime
validation. The untouched upstream base is
Qwen/Qwen3.8-27B.
Quantization
| Property | Value |
|---|
| Format | MLX enhanced oQ6e |
| Size | 23,716,287,912 bytes (~22.09 GiB) |
| Group size / mode | 64 / affine |
| Quantized modules | 505 |
| Q6 modules | 470 |
| Protected Q8 modules | 35 |
| Importance matrix | 128 samples × 512 tokens; 504 entries |
| Vision tensors | 333, unquantized |
| Native MTP weights | 15, retained |
The embedding table and LM head are the two expected importance-matrix
exceptions and are protected at Q8. The artifact contains no NaN or infinity
values.
Audit and validation
Before quantization, the Ektome BF16 source was compared tensor-by-tensor with
the pinned official checkpoint:
- 1,199 total tensors
- exactly 128 expected residual-writer edits
- 1,071 unchanged tensors
- no unexpected or missing edits
- all MTP and vision source tensors preserved
- rank-1 projection geometry passed across all 128 edited modules
Runtime checks passed for loading, native MTP drafting, tool calls and tool
results, vision/OCR, and retrieval across a roughly 96K-token prompt. A true
cold 95,995-token prefill completed without a memory-guard rejection on a 48 GB
Apple Silicon host. The first visible answer was clipped by an overly small
completion cap; a corrected recheck returned all distributed retrieval targets.
This is a quantized derivative, so “near-lossless” does not mean mathematically
lossless. No post-quant benchmark suite is claimed beyond the validation above.
Running with oMLX
Download the repository into an oMLX model directory:
1hf download kvas-25/Ektome-Qwen3.8-27B-oQ6e-MLX-MTP \
2 --local-dir ~/.omlx/models/Qwen3.8-27B-Ektome-oQ6e-mtp
3
4omlx serve --model-dir ~/.omlx/models
Then select Qwen3.8-27B-Ektome-oQ6e-mtp through the oMLX admin UI or its
OpenAI-compatible API. Native speculative decoding requires enabling MTP in the
model settings; the validated configuration used five draft tokens. A practical
48 GB profile used a 98,304-token context window and Q4 TurboQuant KV cache.
Vision assets are included and were validated, but a text-only loader override
can be used when a client does not need image input.
Reproducibility pins
| Component | Revision/version |
|---|
| Ektome BF16 source | 7be830b2e33f9e91a1bd31628a06980a1b075803 |
| Official Qwen source | 1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0 |
| Refusal directions audit | 4481c7d78458be4e5e33d16bfe6193d05400981b |
| Rank-1 forensics | 6772ac141aeda4e58d97118da7c6e40b1bfc2259 |
| oMLX build | 0.6.2 / f2d36f3d25a7e7a2401a92eecafc28b8f8968ec7 |
| MLX / mlx-lm / mlx-vlm | 0.32.0 / 0.31.3 / 0.6.3 |
License and attribution
Apache-2.0, inherited from Qwen3.8-27B and the Ektome source. See the upstream
model cards for their full methodology, limitations, and usage notes. No
warranty is provided; users are responsible for lawful and responsible use.