LogiHard-2k is a native logical reasoning benchmark constructed from high-stakes human examinations. It comprises 2,000 rigorously stratified multiple-choice questions designed to evaluate combinatorial propositional reasoning in large language models.
Curated atomic questions (LogiHard-Base): 1,461 items requiring 0-order natural language inference.
Combinatorial questions (LogiHard-C): 539 items deterministically transformed… See the full description on the dataset page: https://huggingface.co/datasets/datatune/LogiHard-2K.
