Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
codemelon-quantized-0.1-8b – AI Model by vaiditya | AlphaNeural AI
You can deploy this model and start earning money today!
vaiditya
/
codemelon-quantized-0.1-8b
like
0
transformers
gguf
llama
text-generation-inference
en
apache-2.0
endpoints_compatible
us
conversational
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Uploaded model
Developed by:
vaiditya
License:
apache-2.0
Finetuned from model :
meta/meta-llama-3.1-8b-bnb-4bit
How to Run the Model (Easiest Version)
Ollama
You can run this model direct with ollama
Step1
Download ollama for your operating system from
https://ollama.com/
Step2
Run the following command to run the model it will automatically download the model and execute it
Command
4bitModel
ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:Q4_K_M
5bitModel
ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:Q5_K_M
8bitModel
ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:Q8_0
16bitModel
ollama run hf.co/vaiditya/codemelon-quantized-0.1-8b:F16
