[Paper]
[Repository]
Apoorv Khandelwal & Ellie Pavlick
Abstract: While large language models (LLMs) appear to be increasingly capable of solving compositional tasks, it is an open question whether they do so using compositional mechanisms. In this work, we investigate how feedforward LLMs solve two-hop factual recall tasks, which can be expressed compositionally as $g(f(x))$. We first confirm that modern LLMs continue to suffer from the… See the full description on the dataset page:
https://huggingface.co/datasets/apoorvkh/composing-functions.
