we introduce Lemonade: Language models Evaluation of MOtion aNd Action-Driven Enquiries.
Lemonade consists of 36,521 closed-ended QA pairs linked to egocentric video clips, categorized in three groups and six subcategories. 18,857 QAs focus on behavior understanding, leveraging the rich ground truth behavior annotations of the EPFL-Smart Kitchen to interrogate models about perceived actionsโฆ See the full description on the dataset page:
https://huggingface.co/datasets/amathislab/LEMONADE.