Is this your dataset? Claim it with the Hugging Face account that owns it.

Viet-Mistral/
CulturaY

Name: CulturaY
Creator: Viet-Mistral
License: https://spdx.org/licenses/CC-BY-4.0.html

text-generation

fill-mask

language-modeling

masked-language-modeling

Views

No views yet

	CulturaY: A Large Cleaned Multilingual Dataset of 75 Languages




	
	Dataset Summary

From the team that brought you CulturaX, we present CulturaY, another substantial multilingual dataset of 15TB (uncompressed)/3TB (zstd-compressed) that applies the same dataset cleaning methodology to the HPLT v1.1 dataset. Please note that HPLT v1.2 has also been released and is an alternative verison with different cleaning methodolgies. This data was used in part to train our SOTA… See the full description on the dataset page: https://huggingface.co/datasets/Viet-Mistral/CulturaY.