Kholle is a french benchmark designed for small language models (SLMs) to evaluate their academic and school-level knowledge in science, ranging from high school to French preparatory classes (classes prépa).
The benchmark consists of short course-style questions and small exercises, similar to those that could appear in exams.
All metrics and extraction code for evaluation are available in the official Luth repo.
Dataset Construction… See the full description on the dataset page: https://huggingface.co/datasets/kurakurai/kholle.
