You can deploy this model and start earning money today!

ArtusDev/
mistralai_Mistral-Small-3.2-24B-Instruct-2506-EXL3

Name: mistralai_Mistral-Small-3.2-24B-Instruct-2506-EXL3
Availability: InStock

Views

No views yet

EXL3 Quants of mistralai/Mistral-Small-3.2-24B-Instruct-2506

Based on the HF conversion of the base 3.2 model by unsloth: unsloth/Mistral-Small-3.2-24B-Instruct-2506

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/mistralai_Mistral-Small-3.2-24B-Instruct-2506-EXL3 --revision "5.0bpw_H6" --local-dir ./