These GGUF files are quantized using
APEX, a novel MoE-aware mixed-precision quantization technique that outperforms standard quantization methods while being significantly smaller.
APEX beats Q8_0 perplexity at half the size — and even beats F16.
APEX classifies every tensor by its role — routed expert, shared expert, or attention — and applies a layer-wise precision gradient, giving the most sensitive edge layers higher precision and compressing the redundant middle layers more aggressively. Ling-3.0-tiny's 128 routed experts (only 8 active per token) make it an ideal candidate.
