Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
WizardLM-2-8x22B-6.0bpw-h8-exl2 – AI Model by bdambrosio | AlphaNeural AI
You can deploy this model and start earning money today!
bdambrosio
/
WizardLM-2-8x22B-6.0bpw-h8-exl2
like
0
transformers
safetensors
mixtral
text-generation
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
6-bit
exl2
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Like it says.
Takes about 120GB ram or vram...
Vicuna template, I hear. Works for me, including SYSTEM. YMMV
| 0 N/A N/A 46923 C /usr/bin/python3 46976MiB | | 1 N/A N/A 1483 G /usr/lib/xorg/Xorg 4MiB | | 1 N/A N/A 46923 C /usr/bin/python3 46700MiB | | 2 N/A N/A 1483 G /usr/lib/xorg/Xorg 4MiB | | 2 N/A N/A 46923 C /usr/bin/python3 24934MiB | +