Views
No views yet
hf://huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF/DeepSeek-V4-Flash-Q4-mxfp4-0731.gguf
to native safetensors format, with the DSpark 3-stage speculative drafter head
included on top.huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF
→ DeepSeek-V4-Flash-Q4-mxfp4-0731.gguf (Q4-MXFP4 quant, abliterated),
converted to safetensors shards.model-00001..00045-of-00048.safetensors
(routed experts as native packed FP4, other quantized matrices as 128x128
E4M3/E8M0 block FP8).model-00046..00048-of-00048.safetensors
(mtp.0 -> 46, mtp.1 -> 47, mtp.2 -> 48), mirroring the official repo's
placement. Routed experts retain source MXFP4 values losslessly; other
matrices use block FP8. The drafter weights are an additional inclusion,
sourced from a separate DeepSeek-V4-Flash-DSpark draft GGUF (see
conversion_manifest.json); they are not part of the huihui-ai GGUF.config.json is the official DSpark config verbatim, laid out to load
exactly like deepseek-ai/DeepSeek-V4-Flash-DSpark.inference/config.json carries the official loader's n_mtp_layers: 3.conversion_manifest.json for provenance.