This is the 2022-05 snapshot of BramVanroy/CommonCrawl-CreativeCommons, filtered by:
Extracting the URLs from the dataset
Getting documents that match those URLs from the corresponding snapshot of togethercomputer/RedPajama-Data-V2
Keeping only the head and middle partitions of ccnet
Keeping documents with at least 50 words and a mean word length between 3 and 10 inclusive
In total we keep 4,553,263 of the 15,239,155 total documents.
