Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Mixtral-8x7B-Instruct-v0.1-OmniQuantv1-w4a16g128 – AI Model by ChenMnZ | AlphaNeural AI
You can deploy this model and start earning money today!
ChenMnZ
/
Mixtral-8x7B-Instruct-v0.1-OmniQuantv1-w4a16g128
like
0
transformers
safetensors
mixtral
text-generation
conversational
2308.13137
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Paper:
https://arxiv.org/abs/2308.13137
Code:
https://github.com/OpenGVLab/OmniQuant
To run this model, refer
https://github.com/OpenGVLab/OmniQuant/blob/main/runing_quantized_mixtral_7bx8.ipynb
for more details.