This dataset is designed for expert evaluation (GDPval) of multimodal models’ ability to understand and execute physical, subtractive material operations described in natural language.
The primary focus is on verbs such as:
engrave
carve
chisel
cut into material
These verbs imply material removal and geometric transformation, not merely visual styling.
Evaluation Goal
The goal of this dataset is to assess whether a model:
✅ correctly performs subtractive geometry
❌ or instead substitutes the… See the full description on the dataset page:
https://huggingface.co/datasets/8Planetterraforming/subtractive_material_operations_eval.
