Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
falcon-180b-omniquant-w3a16g512 – AI Model by ChenMnZ | AlphaNeural AI
You can deploy this model and start earning money today!
ChenMnZ
/
falcon-180b-omniquant-w3a16g512
like
0
transformers
pytorch
falcon
text-generation
2308.13137
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Paper:
https://arxiv.org/abs/2308.13137
Code:
https://github.com/OpenGVLab/OmniQuant
To run this model, refer
https://github.com/OpenGVLab/OmniQuant/blob/main/runing_falcon180b_on_single_a100_80g.ipynb
for more details.