Instead of relying on static red-teaming datasets, the attacker continuously generates increasingly challenging harmful or policy-violating prompts, while the defender model is iteratively trained to resist these attacks without sacrificing helpfulness. Through this dynamic co-evolution process, the defender generalizes better to unseen and adaptive jailbreak attacks, leading to improved robustness in real-world deployment scenarios.
1from datasets import load_dataset
2
3dataset = load_dataset("XiaoyuWen/MAGIC-Attack-Pool-Benchmark")
1@article{wen2026magic,
2 title={MAGIC: A Co-Evolving Attacker-Defender Adversarial Game for Robust LLM Safety},
3 author={Wen, Xiaoyu and He, Zhida and Qi, Han and Wan, Ziyu and Wen, Ying and Zheng, Tianhang and Xu, Xingcheng and Lu, Chaochao and Zhang, Qiaosheng},
4 journal={arXiv preprint arxiv:2602.01539},
5 year={2026}
6}