StreamGuardBench is the first benchmark specifically designed for evaluating streaming guardrails. StreamGuardBench prompts ten widely used open-source LMs—comprising five text-only and five vision-language models—and annotates every generated response with harm labels, therefore enabling accurate measurement of streaming guardrail effectiveness in… See the full description on the dataset page:
https://huggingface.co/datasets/Alibaba-AAIG/StreamGuardBench.