You can deploy this model and start earning money today!

JCTN/
pygmalion-13b-4bit-128g

Name: pygmalion-13b-4bit-128g
Availability: InStock

Views

No views yet

pygmalion-13b-4bit-128g

Warning: THIS model is NOT suitable for use by minors. The model will output X-rated content.

Quantized from the decoded pygmalion-13b xor format. https://huggingface.co/PygmalionAI/pygmalion-13b

In safetensor format.

python llama.py --wbits 4 models/pygmalion-13b c4 --true-sequential --groupsize 128 --save_safetensors models/pygmalion-13b/4bit-128g.safetensors