You can deploy this model and start earning money today!

UmbrellaInc/
PG67A-W-Serum-3.2-1B-GGUF

Name: PG67A-W-Serum-3.2-1B-GGUF
Availability: InStock

Views

No views yet

PG67A-W-Serum-3.2-1B

Model creator: UmbrellaInc
Original model: UmbrellaInc/PG67A-W-Serum-3.2-1B
GGUF quantization: provided by Novaciano using llama.cpp

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

ollama run "hf.co/Novaciano/PG67A-W-Serum-3.2-1B-GGUF:Q4_K_M"

lms load "Novaciano/PG67A-W-Serum-3.2-1B-GGUF"

llama-cli --hf "Novaciano/PG67A-W-Serum-3.2-1B-GGUF:Q4_K_M" -p "The meaning to life and the universe is"

llama-server --hf "Novaciano/PG67A-W-Serum-3.2-1B-GGUF:Q4_K_M" -c 4096