Welcome to the dataset of the LLM CTF @ SaTML 2024. You can find a detailed report of the competition here.
The task of the attacker was to discover a secret from the start of the chat, hidden by the defending team's system prompt, Python filters, and LLM filters.
The models used were gpt-3.5-turbo-1106 and llama-2-70b-chat.
The dataset contains three splits:
teams: mapping between team names and the… See the full description on the dataset page:
https://huggingface.co/datasets/ethz-spylab/ctf-satml24.
