Ling-3.0-flash is inclusionAI's next-generation native hybrid reasoning model: 124B total / 5.1B active (~12.4% of their previous 1T-class flagship). It uses a native hybrid-linear stack from pretraining — 5:1 Kimi Delta Attention (KDA) + gated MLA, 1/64 sparse MoE, 512 routed experts (top-8) + 1 shared expert, 2 dense layers, and a trained MTP head. Official context schedule is 8K → 32K → 256K. Thinking is on by default in the official card.

This community package is not an official inclusionAI release. It applies two extra steps on top of the official weights:

License: MIT (same family as the official model). Follow inclusionAI terms and local law.

After merging abliterix v6 trial 21, this model shows a much lower refusal rate and can differ from official Ling-3.0-flash. Evaluate compliance and safety for your use case; control access and audit as needed.

Implementation sketch: LoRA merge W += (B @ A) * (alpha / r) with MPOA full-norm rank 3 on o_proj + down_proj. Adapter path: Ling-3.0-flash-LoRA-Trial21-Refusals17-KL0.093.

Coding / agent ability is largely retained on Compact smoke; refusal and alignment behavior are changed. Official SWE / Tau / MCP tables were not re-run for this derivative.

These files use APEX-style MoE-aware mixed precision: precision follows tensor role + layer position (higher on edges, more aggressive in the middle).

This package is not I-tier (no imatrix). Common settings: 43 GGUF blocks (42 backbone + MTP blk.42); first 2 layers dense; routers ffn_gate_inp=Q8_0; MTP + nextn.eh_proj forced Q8_0; KDA/MLA tensor names as in llama.cpp bailingmoe3.

How to choose: start with Balanced if you have the RAM. Use Compact on 128 GB UMA (this is what we smoke-tested). Quality if you want IQ mid-experts and a smaller file than Balanced. Skip BF16 unless you are converting again.

These GGUFs are general.architecture = bailingmoe3. BailingMoE3 support (PR #26608) was merged into llama.cpp master on 2026-08-17 — the first release containing it is b10470. Use llama.cpp b10470 or newer (any release or master build from that date onward) to load these files directly. If you see unknown model architecture: 'bailingmoe3', your build is older than that — update. Do not mix with unofficial bailing-hybrid forks — the tensor names do not match.

Example (Compact, thinking off)