Views
No views yet
| File | Quant | Size | Use |
|---|---|---|---|
minicpm4-8b-paperprof-Q4_K_M.gguf | Q4_K_M | ~4.9 GB | recommended, used by the Space |
minicpm4-8b-paperprof-f16.gguf | F16 | ~16 GB | full precision reference |
llama-cli -hf build-small-hackathon/MiniCPM4-8B-PaperProf-GGUF -p "your prompt"1from llama_cpp import Llama
2llm = Llama.from_pretrained("build-small-hackathon/MiniCPM4-8B-PaperProf-GGUF", filename="*Q4_K_M.gguf", n_gpu_layers=-1)