Sotopia-ToM: Evaluating Information Management in Multi-Agent Interaction with Theory of Mind
Dataset Description
Sotopia-ToM is a multi-dimensional benchmarking dataset for evaluating LLM agents' ability to navigate information-asymmetric and privacy-sensitive multi-party interactions. Each scenario involves 3–5 agents with partitioned private knowledge, channel-dependent sharing policies, and realistic coordination goals across professional domains.
Authors: Yashwanth… See the full description on the dataset page: https://huggingface.co/datasets/yashwanthys/sotopia-tom.
