You can deploy this model and start earning money today!

majentik/
MiniCPM5-1B-TurboQuant-GGUF-Q4_K_M

Name: MiniCPM5-1B-TurboQuant-GGUF-Q4_K_M
Availability: InStock

Views

No views yet

[!TIP] KV-cache quantization (upstream, no fork needed): llama.cpp/Ollama cover this natively — -ctk q8_0 -ctv q8_0 (~half KV memory, negligible quality loss) or -ctk q4_0 -ctv q4_0 (~quarter memory, small quality cost). In Ollama: OLLAMA_KV_CACHE_TYPE=q8_0 with OLLAMA_FLASH_ATTENTION=1.

MiniCPM5-1B — TurboQuant GGUF Q4_K_M

openbmb/MiniCPM5-1B quantized pack, published as MiniCPM5-1B-TurboQuant-GGUF-Q4_K_M.

Method

llama.cpp Q4_K_M quantization.

Release line

Released under the TurboQuant line. RotorQuant and TurboQuant are this project's release labels for this pack, not distinct quantization algorithms — both brand repos carry byte-identical weights. No brand-specific speedup is claimed or measured.

Modality

pipeline_tag: text-generation. This is a llama.cpp GGUF conversion of the text tower; no modality beyond pipeline_tag above is claimed or included.

License

This pack is a derivative of openbmb/MiniCPM5-1B; all credit for the original model, training, and weights belongs to the upstream authors. This repo republishes a quantized conversion of those weights only.

Governed by the apache-2.0. See the upstream repo and the linked license for the full terms — no license text is reproduced here.

majentik/MiniCPM5-1B-TurboQuant-GGUF-Q4_K_M