Seems like it could be useful for crafting toxic preference datasets, so I am mirroring it.
AI Village - Generative Red Team 2 Dataset
Data Dictionary
At Defcon 32, the AI Village hosted the 2nd Generative Red Teaming event (GRT2). This dataset contains all the raw data collected during the event.
The dataset is provided in both csv and parquet formats for convenience.
Inference (grt2_inference.csv/grt2_inference.parquet)… See the full description on the dataset page: https://huggingface.co/datasets/adamo1139/Grt2-copy.