OlymMATH is a dataset we introduced in Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models by Haoxiang Sun, Yingqian Min, Zhipeng Chen, Wayne Xin Zhao, Zheng Liu, Zhongyuan Wang, Lei Fang, and Ji-Rong Wen. You can find more information on GitHub and HuggingFace 🤗.
We have made our evaluation results for the avg@{8, 64} and cons@{8, 64} metrics in this dataset publicly available for academic research… See the full description on the dataset page:
https://huggingface.co/datasets/RUC-AIBOX/OlymMATH-eval.