File	Quant	Size	Description	Use Case
Apertus-8B-tulu-xlam-sft-f16.gguf	F16	~1GB	Full precision	Best quality, slower
Apertus-8B-tulu-xlam-sft-q8_0.gguf	Q8_0	~500MB	8-bit	High quality
Apertus-8B-tulu-xlam-sft-q5_k_m.gguf	Q5_K_M	~350MB	5-bit medium	Good quality, smaller
Apertus-8B-tulu-xlam-sft-q4_k_m.gguf	Q4_K_M	~300MB	4-bit medium	Recommended - good balance

Usage

With llama.cpp

bash

# Download model
huggingface-cli download Colby/Apertus-8B-tulu-xlam-sft-gguf Apertus-8B-tulu-xlam-sft-q4_k_m.gguf

# Run with llama.cpp
./llama-cli -m Apertus-8B-tulu-xlam-sft-q4_k_m.gguf -p "Your prompt here"

With Ollama

Create a Modelfile:

FROM ./Apertus-8B-tulu-xlam-sft-q4_k_m.gguf

Create the model:

bash

ollama create my-model -f Modelfile
ollama run my-model

With LM Studio

Download the .gguf file
Import into LM Studio
Start chatting!

License

Inherits the license from the base model: swiss-ai/Apertus-8B-2509

Citation

bibtex

@misc{Apertus_8B_tulu_xlam_sft_gguf,
  author = {Colby},
  title = {Apertus-8B-tulu-xlam-sft-gguf},
  year = {2025},
  publisher = {Hugging Face},
  url = {https://huggingface.co/Colby/Apertus-8B-tulu-xlam-sft-gguf}
}

Converted to GGUF format using llama.cpp