Component	Bits	Rationale
Routed experts (384 SwitchLinear)	4-bit	Only 8/384 fire per token — very tolerant of low-bit
Shared expert (always active)	6-bit	Every-token path, needs precision
MLA value projections (v_a/v_b)	8-bit	Most sensitive attention weights
MLA other projections (q_a/q_b/kv_a/kv_b/o)	6-bit	Latent compression layer
lm_head + embed_tokens	8-bit	Output quality
First/last 3 decoder layers	6-bit	Boundary layer sensitivity
Gate/router	unquantized	Tiny params, routing-critical
Vision encoder	unquantized	Preserved via mlx-vlm

Effective average: ~4.5 bpw — near-6-bit quality at near-4-bit size.

Model Details

Base model: Kimi-K2.6 (1T params, 32B active, 384 experts)
Architecture: MoE + MLA (kimi_k25)
Context: 256K tokens
Modality: Vision + Language (VLM)
Converted with: mlx-vlm 0.4.2

Usage

Weights uploading — conversion in progress.