Kratki-Istorii-100k is a synthetically generated dataset (using INSAIT-Institute/BgGPT-Gemma-2-9B-IT-v1.0) of short stories (3-5) paragraphs, which a young kid should be able to understand. The simplicity of the language used makes it very suitable for training and studying the behaviour of really small Language Models (<500M parameters).
The dataset consists of ~100k texts in Bulgarian. You can use the dataset via the HF interface:
from datasets import load_dataset
ds =… See the full description on the dataset page:
https://huggingface.co/datasets/WT-solutions/Kratki-Istorii-100k.