BAGEL VLM-Gym world-model dataset (pusht / cot).
CoT chunk-K train set: all-step interleaved imagined reasoning; re-grounds on the true frame every K=inf (open-loop; imagine the whole episode) steps.
layout: Train-only. Gzipped-JSONL shards under training/; each row is one packed SFT sample with base64-JPEG frames inline.
images are base64-encoded JPEG frames stored inline in each JSONL row.
Pairs with the matching pusht checkpoint(s) under the… See the full description on the dataset page:
https://huggingface.co/datasets/novastar111/pusht_cot_chunk_kinf_train.