This dataset was created by extracting 500 million tokens from Fineweb-2.
Since the data is only 500M tokens in size, please consider using it in conjunction with other high-quality data or using the original dataset.
This dataset was created by the owner of this dataset repository to verify the additional filtering effect of Lumia101/Nari-C4-ko-500MT.
