Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Mixtral-8x7B-Instruct-v0.1-3bit-exl2 – AI Model by n810x | AlphaNeural AI
You can deploy this model and start earning money today!
n810x
/
Mixtral-8x7B-Instruct-v0.1-3bit-exl2
like
0
transformers
safetensors
mixtral
text-generation
conversational
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
This is a 3-bit exl2 (Exllamav2) conversion of MistralAI's Mixtral-8x7B-Instruct-v0.1
It takes about 17GB on disk, so it should load on consumer cards with 24GB of VRAM.
More on ExLlamav2 ->
https://github.com/turboderp/exllamav2
( works with Oobabooga's textgen web ui )
Original Model ->
https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
( Original files are ~87GB on disk )
