Code, datasets, and trained checkpoints for studying world-model representations in maze navigation, based on a modified NanoGPT.
*.py — training, testing, probing, and visualization scripts (see readme.md).
model/ — architectures: transformer, transformer-rope, transformer-nextlat, mamba, mamba2, gated-deltanet, gru.
data/maze/100/ — tokenized maze datasets for Tasks A/C/E/H/I (RWs paths, 100 nodes).
out/ — final (10000-iter)… See the full description on the dataset page:
https://huggingface.co/datasets/Kalso42/WorldModelForMaze.
