You can deploy this model and start earning money today!

ysn-rfd/
OpenELM-3B-Instruct-GGUF

Name: OpenELM-3B-Instruct-GGUF
Availability: InStock

Views

No views yet

chatbench-distilgpt2

Model creator: microsoft
Original model: microsoft/chatbench-distilgpt2
GGUF quantization: provided by ysn-rfd using llama.cpp

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

ollama run "hf.co/ysn-rfd/OpenELM-3B-Instruct-GGUF:F16"

lms load "ysn-rfd/OpenELM-3B-Instruct-GGUF"

llama-cli --hf "ysn-rfd/OpenELM-3B-Instruct-GGUF:F16" -p "The meaning to life and the universe is"

llama-server --hf "ysn-rfd/OpenELM-3B-Instruct-GGUF:F16" -c 4096