Is this your dataset? Claim it with the Hugging Face account that owns it.

common-pile/
comma_v0.1_training_dataset

Name: comma_v0.1_training_dataset
Creator: common-pile

Views

No views yet

Comma v0.1 dataset

This repository contains the dataset used to train Comma v0.1-1T and Comma v0.1-2T. It is a slightly modified and consolidated version of the Common Pile v0.1 "filtered" data. If you are looknig for the raw Common Pile v0.1 data, please see this collection. You can learn more about Common Pile in our paper.

Mixing rates and token counts

The Comma v0.1 models were trained in two stages, a "main" stage and a "cooldown" stage. During each stage, we… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/comma_v0.1_training_dataset.