Overview: Process-aware evaluation for Generative Video Reasoning tasks.
Statistics: 309 carefully curated samples spanning 6 distinct domains (i.e., temporal, structural, symbolic, spatial, physics and planning reasoning).
New Metric: Process-outcome Consistency (POC@r). POC@r evaluate video correctness at both process- and outcome-level, with multiple frames… See the full description on the dataset page:
https://huggingface.co/datasets/Monosail/VIPER.
