Final model checkpoints for the experiments in
brendanlong/lens-loss-grokking-experiment
(deep supervision vs grokking: LN-scoped chronic instability, weight-decay
circuit pruning, and failure isolation). Training curves:
public wandb project.
Layout: grok_lens/<run_name>/final.pt (modular-arithmetic runs, ~1.7 MB
each, with .json metadata sidecars) and lego/<run_name>/step_*.pt
(S3 multi-hop composition runs). Run names encode the… See the full description on the dataset page:
https://huggingface.co/datasets/brendanlong/lens-loss-grokking-experiment.