Humanity’s Last Exam (HLE) is a challenging question-answering AI benchmark covering advanced academic fields including Math, Physics, Chemistry, Biology, Engineering, and Computer Science.
At FutureHouse, we audited the biology and chemistry subsets of HLE using a combination of expert human evaluators and our in-house research agent, and found that around 30% of the questions contain answers directly contradicted by peer-reviewed… See the full description on the dataset page:
https://huggingface.co/datasets/futurehouse/hle-gold-bio-chem.
