Views
No views yet
Shinzmann/naija-petro (the 32B variant) for inference with llama.cpp, Ollama, LM Studio, and compatible runtimes.| File suffix | Method | Notes |
|---|---|---|
Q4_K_M | 4-bit (k-quant, medium) | Smallest; recommended default for 32B on limited RAM/VRAM |
Q5_K_M | 5-bit (k-quant, medium) | Higher quality, larger |
Q8_0 | 8-bit | Near-lossless; largest and slowest |
32B GGUF files are large. Q4_K_M is the practical choice for most machines; ensure you have enough RAM/VRAM + disk for the chosen quant.
ollama run hf.co/Shinzmann/naija-petro-GGUF:Q4_K_M1./llama-cli -hf Shinzmann/naija-petro-GGUF:Q4_K_M \
2 -p "What are the screening criteria for CO2 EOR?" -c 4096