Pre-computed advantage values for offline RL training.

Dataset: villekuosmanen/pack_toothbrush_Nov19 Value Model: villekuosmanen/rewact_toothbrush_pistar_1.5.0 N-step lookahead: 50

This dataset contains per-episode parquet files with advantage values for each frame.

from pathlib import Path import pandas as pd

advantage_df =… See the full description on the dataset page: https://huggingface.co/datasets/villekuosmanen/pack_toothbrush_Nov19-advantages.