unalignment/

toxic-dpo-v0.1

This is a highly toxic, "harmful" dataset meant to illustrate how DPO can be used to de-censor/unalign a model quite easily using direct-preference-optimization (DPO) using very few examples. Most of the examples still contain some amount of warnings/disclaimers, so it's still somewhat editorialized.

To use this data, you must acknowledge/agree to the following:

data contained within is "toxic"/"harmful", and contains profanity and other types… See the full description on the dataset page: https://huggingface.co/datasets/unalignment/toxic-dpo-v0.1.