You can deploy this model and start earning money today!

YannickLetrefle/
Apertus_8B-16bit_gguf

Name: Apertus_8B-16bit_gguf
Availability: InStock

Views

No views yet

This is a gguf version of Apertus-8B

To use it, please :

clone the llama.cpp repository: https://github.com/ggml-org/llama.cpp
add Apertus-8B-Instruct.jinja inside the folder llama.cpp\models\templates
go to llama.cpp\build\bin
run the following command: llama-cli -m <path_to_model> --chat-template-file ../../models/templates/Apertus-8B-Instruct.jinja -i --color -n 512 -c 4096 --jinja

I used WSL to have it running.

YannickLetrefle/Apertus_8B-16bit_gguf