combines SFT-Final (
https://huggingface.co/datasets/clembench-playpen/SFT-Final-Dataset) and DPO_dialogue (
https://huggingface.co/datasets/clembench-playpen/DPO_dialogue).
Info:
"id": concat of "game"+"episode"
"query": "string in llama-format"
"reward": rewards given (1=="chosen" from dpo-dialogue and "success" from sft-final, 0== "rejected" from dpo-dialogue)
"origin": marks origin of sample
"player": kept for dpo-dialogue samples… See the full description on the dataset page:
https://huggingface.co/datasets/pm-25/clembench-rlvr-dataset.