Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Mixtral-8x7B-Instruct-v0.1-offloading-demo – AI Model by inventbot | AlphaNeural AI
You can deploy this model and start earning money today!
inventbot
/
Mixtral-8x7B-Instruct-v0.1-offloading-demo
like
0
transformers
safetensors
mixtral
text-generation
text-generation-inference
conversational
en
fr
it
de
es
mit
autotrain_compatible
endpoints_compatible
8-bit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Attention quantization: HQQ 4-bit, groupsize 64, compress zero, compress scale with groupsize 256
Experts quantization: HQQ 2-bit, groupsize 16, compress zero, compress scale with groupsize 128