This document describes how to use a GPT-5.1 model (via the OpenAI API) to evaluate image-generation outputs on the Reason2Gen benchmark.
The evaluation script:
Reads each task directory under your Reason2Gen benchmark.
For every sample, loads:
The question / input prompt.
The target image (ground-truth).
The generated image from your method (e.g., Bagel / FLUX2).
Asks GPT to judge whether the generated image correctly solves the puzzle or… See the full description on the dataset page:
https://huggingface.co/datasets/Tuyuanpeng/Reason2Gen_Full.
