OpenMOSS-Team/

hh-rlhf-strength-cleaned

Other Language Versions: English, 中文.

In the paper titled "Secrets of RLHF in Large Language Models Part II: Reward Modeling" we measured the preference strength of each preference pair in the hh-rlhf dataset through model ensemble and annotated the valid set with GPT-4. In this repository, we provide:

Metadata of preference strength for both the training and valid sets. GPT-4 annotations on the valid set.

We… See the full description on the dataset page: https://huggingface.co/datasets/OpenMOSS-Team/hh-rlhf-strength-cleaned.