You can deploy this model and start earning money today!

ArtusDev/
sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0-EXL3

Name: sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0-EXL3
Availability: InStock

Views

No views yet

EXL3 Quants of sophosympatheia/New-Dawn-Llama-3-70B-32K-v1.0

Quant(Revision)	Bits per Weight	Head Bits
3.5_H6	3.5	6

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0-EXL3 --revision "5.0bpw_H6" --local-dir ./