This is the eponymous benchmark accompanying the paper JailbreaksOverTime: Detecting Jailbreak Attacks Under Distribution Shift (ArXiv Link), published in The 18th ACM Workshop on Artificial Intelligence and Security (AISec 2025, co-located with ACM CCS 2025).
JailbreaksOverTime is a timestamped benchmark of 3,900 jailbreaks and 19,650 benign queries collected over the span of 10 months… See the full description on the dataset page:
https://huggingface.co/datasets/djapp18/JailbreaksOverTime.
