Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
mistral-7b-dolphin-6.5bpw-exl2 – AI Model by CorticalStack | AlphaNeural AI
You can deploy this model and start earning money today!
CorticalStack
/
mistral-7b-dolphin-6.5bpw-exl2
like
0
transformers
safetensors
mistral
text-generation
apache-2.0
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
CorticalStack/mistral-7b-dolphin
An EXL2 6.5bpw quantised version of
CorticalStack/mistral-7b-dolphin-sft
.
An incomplete list of clients and libraries that are known to support EXL2:
text-generation-webui
, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
exllamav2
, an inference library for running local LLMs on modern consumer GPUs.
