You can deploy this model and start earning money today!

beyond-logic-labs/
Llama-3.1-8B-Instruct-GGUF

Name: Llama-3.1-8B-Instruct-GGUF
Availability: InStock

Views

No views yet

Llama 3.1 8B Instruct - GGUF

GGUF quantized version of Meta's Llama 3.1 8B Instruct for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible inference engines.

Filename	Quant	Size	Description
`Llama-3.1-8B-Instruct-Q6_K.gguf`	Q6_K	~6.8 GB	High quality, recommended for most use cases

ollama run hf.co/beyond-logic-labs/Llama-3.1-8B-Instruct-GGUF:Q6_K

Download the GGUF file and load it directly in LM Studio.

./llama-cli -m Llama-3.1-8B-Instruct-Q6_K.gguf -p "You are a helpful assistant." -cnv

We build AI-powered tools for tabletop RPG players and game masters. Check out our other models for specialized RPG assistance.