Task Dyna: Dynamic State Tracking (Non-Commutative Permutation Composition)
Overview
Task Dyna tests a language model's ability to maintain and update a mutable mental state
through a sequence of non-commutative operations. Unlike retrieval tasks where answers exist
in the context, Dyna's answers are latent variables that must be computed through
sequential operation composition.
