You can deploy this model and start earning money today!

ArtusDev/
Delta-Vector_Austral-24B-Winton-EXL2

Name: Delta-Vector_Austral-24B-Winton-EXL2
Availability: InStock

Views

No views yet

EXL2 Quants of Delta-Vector/Austral-24B-Winton

Quant(Revision)	Bits per Weight	Head Bits
4.0_H6	4.0	6
4.5_H6	4.5	6

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2 --revision "5.0bpw_H6" --local-dir ./