You can deploy this model and start earning money today!

mayank-mishra/
starcoderbase-GPTQ-8bit-128g

Name: starcoderbase-GPTQ-8bit-128g
Availability: InStock

Views

No views yet

GPTQ-for-StarCoder

Visit GPTQ-for-SantaCoder for instructions on how to use the model weights here. If you want 4-bit weights, visit starcoderbase-GPTQ-4bit-128g.

StarCoderBase	Bits	group-size	wikitext2	ptb	c4	stack	checkpoint size(MB)
FP32	32	-	10.172	15.756	12.736	1.692	59195
BF16	16	-	10.173	15.765	12.745	1.692	29597
GPTQ	8	128	10.174	15.767	12.739	1.692	16163
GPTQ	4	128	10.387	16.056	13.005	1.708	8877

The model is licenses under the CodeML Open RAIL-M v0.1 license. You can find the full license here.

Thanks to everyone in BigCode who worked so hard to create these code models.