š Paper | š» GitHub
ColorBench is a multimodal dataset to comprehensively assess capabilities of VLMs in color understanding, including color perception, reasoning, and robustness, introduced in "ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustness".
It provides:
More than 5,800 image-text questions covering diverse application scenarios and practical challenges for VLMs evaluation.
3ā¦ See the full description on the dataset page: https://huggingface.co/datasets/umd-zhou-lab/ColorBench.
