MM-Hallu/

Hal-Eval

A comprehensive benchmark for evaluating hallucination in vision-language models through caption comparison, from the paper "Hal-Eval: A Universal and Multi-Dimensional Benchmark for Hallucination Evaluation in Large Vision-Language Models."

	Statistics




	

Split Samples Images Source

in_domain 20,000 5,000 COCO val2014

out_of_domain 20,000 4,995 CC-SBU

Total 40,000 9,995

Note: Out-of-domain samples reference… See the full description on the dataset page: https://huggingface.co/datasets/MM-Hallu/Hal-Eval.