Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
dolphin-2.7-mixtral-8x7b-GGUF-IQ3_M – AI Model by NeoChen1024 | AlphaNeural AI
You can deploy this model and start earning money today!
NeoChen1024
/
dolphin-2.7-mixtral-8x7b-GGUF-IQ3_M
like
0
dphn/dolphin-2.7-mixtral-8x7b
quantized
conversational
endpoints_compatible
gguf
imatrix
template
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
GGUF IQ3_M quant of cognitivecomputations/dolphin-2.7-mixtral-8x7b (both non-imatrix and imatrix)
It fits into 24GiB VRAM with 32768 context (@ 8bit KV cache quantization).
