VitaSet is a vision-tactile Visual Question Answering dataset for physical property reasoning. The dataset combines RGB vision and tactile sensing for material property understanding, containing 5,145 human-verified QA pairs across three tasks: hardness classification, material property description, and surface roughness classification.
Hardware: Franka Emika Panda robot + GelSight Mini tactile sensor
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/Bupt-Joy/VitaSet.
