blind-spots-bench is a benchmark designed to stress test the reasoning capabilities of frontier AI models on tasks that are straightforward for humans but difficult for AI. The questions are crafted to highlight the limitations of current AI systems and understand where they struggle in reasoning tasks.

	👾 GitHub codebase for automated evaluation




	


	📄 Pre-print on arxiv




	


	📊 Evaluation Results… See the full description on the dataset page: https://huggingface.co/datasets/matsant01/blind-spots-bench.