Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Falcon3-7B-Instruct-AutoRound-GPTQ-4bit – AI Model by kaitchup | AlphaNeural AI
You can deploy this model and start earning money today!
kaitchup
/
Falcon3-7B-Instruct-AutoRound-GPTQ-4bit
like
0
transformers
safetensors
llama
text-generation
auto-gptq
AutoRound
conversational
en
other
autotrain_compatible
text-generation-inference
endpoints_compatible
4-bit
gptq
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model Details
This is
tiiuae/Falcon3-7B-Instruct
quantized with
AutoRound
(symmetric quantization) and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
Details on the quantization process and how to use the model here:
The Recipe for Extremely Accurate and Cheap Quantization of 70B+ LLMs
Screenshot 2024-12-19 095702.png
Developed by:
The Kaitchup
Language(s) (NLP):
English
License:
Apache 2.0 license
