🌍 Deep Culture Lense (YaPO Cultural Alignment Benchmark)
Motivation
Existing cultural benchmarks often suffer from a critical limitation: they conflate culture with language or geography. When a model is tested in Arabic, it is often assumed to align with a generic "Arab culture," ignoring the vast differences between Moroccan, Egyptian, Saudi, and Levantine norms. Furthermore, current evaluations frequently rely on surface-level lexical cues or trivia, making it unclear… See the full description on the dataset page: https://huggingface.co/datasets/MBZUAI-Paris/Deep-Culture-Lense.
