A field-tested, agent-ready playbook for producing
ROCmFPX hybrid GGUF quantizations
(
q4_0_rocmfp4_fast /
q8_0_rocmfpx) with the
ROCmFPX fork of llama.cpp — fully CPU-only,
from either pre-quantized GGUF repos (e.g. Unsloth BF16) or raw HF safetensors.
The complete guide is in
rocmfpx-quantization-guide.md.
Hand this repo (or just that file) to a coding agent together with a Hugging Face link and a
recipe, and it can reproduce every step below.
Timings on a 64-core CPU box: 118B MoE ≈ 8 min, 27B dense ≈ 1 min, 26B MoE ≈ 3 min.
