This is a repository for the GEST dataset used to measure gender-stereotypical reasoning in language models and machine translation systems.
Paper: Women Are Beautiful, Men Are Leaders: Gender Stereotypes in Machine Translation and Language Modeling
Code and additional data (annotation details, translations) are available in our repository
December 6th 2024 - gest_1.1.csv was added. This is a new version that has 244 typos and other errors… See the full description on the dataset page:
https://huggingface.co/datasets/kinit/gest.