Pre-computed advantage values for offline RL training.

Dataset: villekuosmanen/build_block_tower Value Model: villekuosmanen/rewact_build_block_tower_all_3 N-step lookahead: 50

This dataset contains per-episode parquet files with advantage values for each frame.

from pathlib import Path import pandas as pd

advantage_df =… See the full description on the dataset page: https://huggingface.co/datasets/villekuosmanen/build_block_tower-advantages.