TOFU-SFT/

MaliciousInstruct

This dataset was created based on https://github.com/Princeton-SysML/Jailbreak_LLM/blob/main/data/MaliciousInstruct.txt

This dataset includes harmful content.

@article{huang2023catastrophic, title={Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation}, author={Huang, Yangsibo and Gupta, Samyak and Xia, Mengzhou and Li, Kai and Chen, Danqi}, journal={arXiv preprint arXiv:2310.06987}, year={2023} }