Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Llama-3.1-Tulu-3-8B-AutoRound-GPTQ-4bit – AI Model by kaitchup | AlphaNeural AI
You can deploy this model and start earning money today!
kaitchup
/
Llama-3.1-Tulu-3-8B-AutoRound-GPTQ-4bit
like
0
transformers
safetensors
llama
text-generation
auto-gptq
AutoRound
conversational
en
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
4-bit
gptq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Details
This is
allenai/Llama-3.1-Tulu-3-8B
quantized with
AutoRound
(symmetric quantization) and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
Details on the quantization process and how to use the model here:
The Recipe for Extremely Accurate and Cheap Quantization of 70B+ LLMs
MMLU.png
Model Size.png
Developed by:
The Kaitchup
Language(s) (NLP):
English
License:
Apache 2.0 license
