The commonsense reasoning tasks consist of 8 subtasks, each with predefined training and testing sets, as described by LLM-Adapters (Hu et al., 2023). The following table lists the details of each sub-dataset.
Train
Test
Information
BoolQ (Clark et al., 2019)
9427
3270
Question-answering dataset for yes/no questions
PIQA (Bisk et al., 2020)
16113
1838
Questions with two solutions requiring physical commonsense to answer
SIQA (Sap et al., 2019)
33410… See the full description on the dataset page:
https://huggingface.co/datasets/fxmeng/commonsense_filtered.