You can deploy this model and start earning money today!

mayank-mishra/
starcoder-GPTQ-4bit-128g

Name: starcoder-GPTQ-4bit-128g
Availability: InStock

Views

No views yet

GPTQ-for-StarCoder

Visit GPTQ-for-SantaCoder for instructions on how to use the model weights here. If you want 8-bit weights, visit starcoder-GPTQ-8bit-128g.

StarCoder	Bits	group-size	wikitext2	ptb	c4	stack	checkpoint size(MB)
FP32	32	-	10.801	16.425	13.402	1.738	59195
BF16	16	-	10.807	16.424	13.408	1.739	29597
GPTQ	8	128	10.805	15.453	13.408	1.739	16163
GPTQ	4	128	10.989	16.839	13.676	1.757	8877

The model is licenses under the CodeML Open RAIL-M v0.1 license. You can find the full license here.

Thanks to everyone in BigCode who worked so hard to create these code models.