Method: one-shot REAP (Router-weighted Expert Activation Pruning) - experts scored by router-gate-value × output-L2-norm over calibration data, lowest-scoring deleted. No fine-tuning, no recovery training.

Calibration: 1M tokens, 50/25/25 ultrachat / wikitext / code

🎉 bailingmoe3 is supported in stock llama.cpp since PR #26608 (merged 2026-08-17, commit 3733366720). Any build from that commit onward loads these files directly.

🔔 2026-08-21: added reasoning_effort support (low = thinking off, high = on, default same). If you want reasoning_effort," re-download or override with chat_template.jinja.

Serving with experts in CPU RAM (attention on GPU, experts streamed from RAM):

llama-server -m Ling-3.0-flash-REAP320-79B-A5B-MXFP4.gguf   -ngl 99 -ot "ffn_.*_exps\.weight=CPU" --no-mmap -c 65536 --flash-attn on --jinja

⚠️ Thinking model occasionally stops after thinking with empty content (reasoning lands in reasoning_content); serve with --reasoning-format none if your client only reads content.

Quants in this repo (all cut from a full-precision master): MXFP4, Q4_K_M, Q2_K

MXFP4 (experts MXFP4 / rest Q8_0) is the pick for CPU-offload serving.

bloomer010/Ling-3.0-flash-REAP320-81B-A5B-GGUF

Ling-3.0-flash REAP320 (81B total / 5.1B active) - GGUF

bloomer010/
Ling-3.0-flash-REAP320-81B-A5B-GGUF