Views
No views yet
| File | Format | Size |
|---|---|---|
| apertus-8b-soc-f16.gguf | FP16 | ~16 GB |
| apertus-8b-soc-q8_0.gguf | Q8_0 | ~8 GB |
| apertus-8b-soc-q5_k_m.gguf | Q5_K_M | ~5 GB |
| apertus-8b-soc-q4_k_m.gguf | Q4_K_M | ~4 GB |
1hf download Colby/apertus-8b-soc-gguf apertus-8b-soc-q4_k_m.gguf
2ollama create apertus-soc:8b -f Modelfile # FROM ./apertus-8b-soc-q4_k_m.gguf
3ollama run apertus-soc:8b