The Cultura-Ru-Edu dataset consists of Russian educational web pages filtered from the uonlp/CulturaX dataset.
The dataset creation was inspired by HuggingFaceFW/fineweb-edu, but with a focus on the Russian language.
By filtering the dataset based on educational criteria, the Cultura-Ru-Edu dataset is both high-quality and large enough to train a Russian-focused language model for tasks requiring knowledge of the world.
To create this… See the full description on the dataset page:
https://huggingface.co/datasets/deepvk/cultura_ru_edu.