CRPE is a benchmark designed to quantitatively evaluate the object recognition and relation comprehension ability of models.
The evaluation is formulated as single-choice questions.
The benchmark consists of four splits:
Existence, Subject, Predicate, and Object.
The Existence split evaluates the object recognition ability while the remaining splits are designed to evaluate the capability of relation comprehension, focusing on… See the full description on the dataset page:
https://huggingface.co/datasets/OpenGVLab/CRPE.
