This dataset is the RL training dataset for GoLongRL, targeting long-context capabilities of language models. It contains 23K training samples in total, with 9 types of reward functions.
You can load the dataset using:
from datasets import load_dataset
dataset = load_dataset("Kwai-Klear/GoLongRL")
See our paper and GitHub repository for more details.
Resource
Link
📝 Preprints
Paper
🤗 Daily Paper
Paper
🤗 Model Hub
GoLongRL-4B(w. tmn-reweight)
