Lost in Multilinguality: Dissecting Cross-lingual Factual Inconsistency in Transformer Language Models
We apply mechanistic interpretability methods to analyze cross-lingual inconsistencies in multilingual masked language models (MLMs). Our findings reveal that MLMs represent knowledge in a shared, language-independent space through most layers, transitioning to language-specific representations only in… See the full description on the dataset page:
https://huggingface.co/datasets/mingyang26/KLAR-CLC.
