This dataset contains necessary data to reproduce results in paper SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training.
Dataset structures
SFTvsRL_DATA/
VIRL_Routes/
VLN_mini.zip # containing 18 routes in VLN mini benchmark, for eval
nyc_1k_routes.zip # containing 1k routes in NYC, for training