Kyleyee/

train_data_tldr_for_drpo

	TL;DR Dataset for DRPO




	
	Summary

The TL;DR dataset is a processed version of Reddit posts

Columns:

"prompt": The unabridged Reddit post. "a1": A summary of the post. "a2": An alternative summary of the post. "rank": The rank of the summary, where 1 indicates the first summary is preferred and 0 indicates the second summary is preferred.

This structure enables models to learn the relationship between detailed content and its abbreviated form… See the full description on the dataset page: https://huggingface.co/datasets/Kyleyee/train_data_tldr_for_drpo.