Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Mistral-Small-Instruct-2409_exl2_6.8bpw_rpcal_mk2 – AI Model by DeusImperator | AlphaNeural AI
You can deploy this model and start earning money today!
DeusImperator
/
Mistral-Small-Instruct-2409_exl2_6.8bpw_rpcal_mk2
like
0
transformers
safetensors
mistral
text-generation
conversational
autotrain_compatible
text-generation-inference
endpoints_compatible
exl2
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Mistral-Small-Instruct-2409 - EXL2 6.8 rpcal_mk2
This is a 8bpw EXL2 quant of
mistralai/Mistral-Small-Instruct-2409
This quant was made using exllamav2-0.2.2 with
Fullmoon-light dataset
for RP.
I tested this quant shortly in some random RPs (including ones over 8k and 16k context) and it seems to work fine.
Prompt Templates
Uses Mistral format.
For more details see original model.
