This is a filtered subset of the HellaSwag validation set. In the following table, we present the complete set of stages used for the filtering of the HellaSwag validation set, which consists of 10042 questions.
Filter
to remove
removed
left
Toxic content
6
6
10036
Nonsense or ungrammatical prompt
4065
4064
5972
Nonsense or ungrammatical correct answer
711
191
5781
Ungrammatical incorrect answers
3953
1975
3806
Wrong answer
370
89
3717
All… See the full description on the dataset page:
https://huggingface.co/datasets/PleIAs/GoldenSwag.