You can deploy this model and start earning money today!

marinarosa/
MiniCPM5-1B-PTBR-v3-GGUF

Name: MiniCPM5-1B-PTBR-v3-GGUF
Availability: InStock

Views

No views yet

MiniCPM5-1B PT-BR v3 GGUF (Q4_K_M)

GGUF quantization of marinarosa/MiniCPM5-1B-PTBR-v3 for local inference with llama.cpp.

python

from llama_cpp import Llama

llm = Llama(
    model_path="MiniCPM5-1B-PTBR-v3-Q4_K_M.gguf",
    n_ctx=8192,
)