Is this your dataset? Claim it with the Hugging Face account that owns it.

bigcode/
starcoderdata

Name: starcoderdata
Creator: bigcode

Views

No views yet

	StarCoder Training Dataset




	
	Dataset description

This is the dataset used for training StarCoder and StarCoderBase. It contains 783GB of code in 86 programming languages, and includes 54GB GitHub Issues + 13GB Jupyter notebooks in scripts and text-code pairs, and 32GB of GitHub commits, which is approximately 250 Billion tokens.

Dataset creation

The creation and filtering of The Stack is explained in the original dataset, we additionally decontaminate and… See the full description on the dataset page: https://huggingface.co/datasets/bigcode/starcoderdata.