You can deploy this model and start earning money today!

bearzi/
Qwen-3.6-27B-JANG_6M

Name: Qwen-3.6-27B-JANG_6M
Availability: InStock

Views

No views yet

qwen3.6-27b-JANG_6M

JANG adaptive mixed-precision MLX quantization produced via vmlx / jang-tools.

Quantization: 6.22b avg, profile JANG_6M, method mse, calibration weights
Profile: JANG_6M
Format: JANG v2 MLX safetensors
Compatible with: vmlx, MLX Studio, oMLX (with JANG patch)

Usage

vmlx (recommended)

bash

pip install 'vmlx[jang]'
vmlx serve bearzi/qwen3.6-27b-JANG_6M

Python

python

from jang_tools.loader import load_jang_model
from mlx_lm import generate

model, tokenizer = load_jang_model("bearzi/qwen3.6-27b-JANG_6M")
messages = [{"role": "user", "content": "Hello"}]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
print(generate(model, tokenizer, prompt=prompt, max_tokens=512, verbose=True))

About JANG

JANG (Jang Adaptive N-bit Grading) assigns different bit widths to different layer types — attention layers get more bits, MLP/expert layers compress harder. This preserves model coherence at aggressive compression levels where uniform quantization breaks down.

See JANG documentation and scores at jangq.ai.

Comparative benchmarks and feedback welcome — please open a discussion.

bearzi/Qwen-3.6-27B-JANG_6M