This dataset is a deduplicated subset of the train split of Social IQa, as used in the paper How Much Can We Forget about Data Contamination?. The deduplication was performed using this script.
The data fields are the same as in
https://huggingface.co/datasets/allenai/social_i_qa, with the additional "split-id" column that can be used to partition the benchmark questions into different subsets.
The dataset can be used as a plug-in replacement if you want to work with the deduplicated benchmark… See the full description on the dataset page:
https://huggingface.co/datasets/sbordt/forgetting-contamination-social_i_qa.
