The v0 dataset is designed to evaluate the capabilities of VLMs in a non-interactive manner. This initial version primarily serves to help readers understand the structure and design of our benchmark.
Each ability dimension is represented by a dedicated directory, and within each ability directory are multiple task-specific subdirectories. For each task, there are numerous data examples. Each example includes original multi-view images, segmented images for visual prompts, a corresponding… See the full description on the dataset page:
https://huggingface.co/datasets/VLABench/vlm_evaluation_v0_test.