The DeepSeek Math Dataset is a high-quality dataset designed for distilling smaller mathematical reasoning models. It is derived from the official DeepSeek-Prover-V1 dataset and tailored to improve the efficiency of lightweight models while preserving strong mathematical problem-solving capabilities.
This dataset has been used to distill Qwen2.5-1.5B, achieving impressive performance on mathematical reasoning tasks.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/madaibaba/deepseek-math-dataset.
