You can deploy this model and start earning money today!

SinanAkkoyun/
orca_mini_3b_gptq_badtest

Name: orca_mini_3b_gptq_badtest
Rating: 2.5 (7 reviews)

Views

No views yet

This is a very bad attempt at quantizing 128g 4 bit with alpaca (in orca style prompt

python quantize_alpaca.py --pretrained_model_dir orca_mini_3b/ --bits 4 --group_size 128 --quantized_model_dir orca_mini_3b_gptq/ --save_and_reloa

SinanAkkoyun/orca_mini_3b_gptq_badtest