Microsoft's TinyStories V2, cleaned and stored as parquet. 2,745,100 stories, 441 million
words, one story per row with provenance on every record.
TinyStories V2 holds samples generated by GPT-3.5 and samples generated by GPT-4. Only
the GPT-4 samples are here… See the full description on the dataset page:
https://huggingface.co/datasets/Brainquiver/generate-narrate-tinystories-pretrain.