We present Tiny Town QA, a multiple choice question and answer dataset designed to provide insight into how LLMs understand tile-based game worlds.
Tiny town maps and question sets were originally generated with Our Tiny Town Dataset Generator. Question data then underwent a multiple pass validation check to ensure quality.
As of March 2025, models are capable of the following results when tested via our QA Analysis tool:
Model Name
World Representation
Accuracy… See the full description on the dataset page:
https://huggingface.co/datasets/collectioncard/TinyTownQA.
