This dataset contains safety ratings for image and text inputs.
It contains 1000 adversarial prompts and 5 attention check prompts
There are 35164 safety annotations from high-quality raters and 3246 safety annotations from low-quality raters
The total number of ratings in the dataset is 38410 equal of the number of rows in this dataset.
All the ratings in this dataset are provided by 707 demographically diverse raters - 637 are deemed high-quality and… See the full description on the dataset page:
https://huggingface.co/datasets/neurips-dataset-1211/DIVE.