This is an 8-bit mixed-precision quantization of Deepseek V4 Flash, using oQ (oMLX v0.5.1). This quant should in theory be lossless, due to Deepseek V4 Flash's native FP4/FP8 architecture. Fits within 192GB of unified memory. MTP weights are preserved (use oMLX Lightning MTP).

I run this quant every day on an oMLX server for use with Openclaw. It performs well at multi-turn tool calling and coding tasks (just make sure to set blockstreamingdefault to "on" in Openclaw or else multi-turn tool calling will fail).

oMLX's highly efficient caching makes this version, in my experience, signficantly faster than ds4.c. The MLX architecture and MTP also lead to slight speed gains in prompt processing and decode.