The official dataset of paper "Goal-Oriented Prompt Attack and Safety Evaluation for LLMs".
Abstract: Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box attack methods, such as Prompt Attack, which can change the behaviour of LLMs and induce LLMs to generate unexpected answers with harmful… See the full description on the dataset page:
https://huggingface.co/datasets/walledai/CPAD.
