Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Meta-Llama-3.1-8B-Instruct-gptq-4bit – AI Model by kaitchup | AlphaNeural AI
You can deploy this model and start earning money today!
kaitchup
/
Meta-Llama-3.1-8B-Instruct-gptq-4bit
like
0
transformers
safetensors
llama
text-generation
auto-gptq
conversational
en
cc-by-4.0
autotrain_compatible
text-generation-inference
endpoints_compatible
4-bit
gptq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Details
This is
meta-llama/Meta-Llama-3.1-8B-Instruct
quantized with AutoGPTQ in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
Details on quantization process, evaluation, and how to use the model here:
The Best Quantization Methods to Run Llama 3.1 on Your GPU
Developed by:
The Kaitchup
Language(s) (NLP):
English
License:
cc-by-4.0
