This dataset contains 123 questions from the International Mathematical Olympiad (IMO) Shortlist subset of the IMO AnswerBench benchmark with 50 candidate responses generated by Qwen3-30B-A3B-Thinking-2507 for each problem. Each response has been evaluated for correctness using a mixture of DeepSeek-R1-Distill-Llama-70B and Python code to parse different answer formats, and scored by multiple LLM judges according to a 0-5 rubric. The… See the full description on the dataset page:
https://huggingface.co/datasets/FUSE-verifiers/IMO-Shortlist-Verifications.
