Natural Language → GUI Action Grounding
Convert user instructions into JSON action objects.
Instruction Following
Models learn to interpret varying natural language formulations (e.g., “press submit” vs “click the submit button”).
Multi-step UI Automation
Some samples involve sequences of actions (e.g., open site → type → press Enter → screenshot).
Languages
English (en)
Generated with simple variations (synonyms, phrasings).
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/ArunKr/gui_grounding_dataset-100.