A high-density, taxonomy-grounded benchmark for evaluating image caption quality and the alignment between image information and generated captions
š Paper: CaptionQA: Is Your Caption as Useful as the Image Itself? š¦ Evaluation Code: GitHub Repository
You can load the dataset using the Hugging Face datasets library:
from datasets import load_dataset
Load the entire dataset
dataset = load_dataset("Borise/CaptionQA")
