Views
No views yet
llama.cpp and ecosystem)| File | Size | Description |
|---|---|---|
| LocoTrainer-4B-Q4_K_M.gguf | ~2.5 GB | 4-bit Medium. Best balance of speed and quality for general use. |
| LocoTrainer-4B-Q5_K_M.gguf | ~2.8 GB | 5-bit Medium. High quality with a slightly larger footprint. |
| LocoTrainer-4B-Q6_K.gguf | ~3.2 GB | 6-bit. Near-lossless quantization. |
| LocoTrainer-4B-Q8_0.gguf | ~4.2 GB | 8-bit. Maximum fidelity, equivalent to original weights. |
llama-cli:./llama-cli -m LocoTrainer-4B-Q4_K_M.gguf -p "What is the capital of France?" -n 128