CoffeeGitta/

difficulty-aime_2025-generations

Paper: LLMs Encode Their Failures: Predicting Success from Pre-Generation ActivationsCode: GitHub LLM-generated solutions across train/validation/test splits for multiple models.

	Columns




	

Column Type Description

problem str Problem statement

generated_solutions list Generated solutions with scores

success_rate float Fraction of correct generations

majority_vote_is_correct int (0/1) Whether majority vote is correct

k… See the full description on the dataset page: https://huggingface.co/datasets/CoffeeGitta/difficulty-aime_2025-generations.