You can deploy this model and start earning money today!

RLHFlow/
HH-RLHF-Harmless-and-RedTeam-standard

Views

No views yet

We process the Harmlnessess and Red-Teaming subsets of Anthropic-HH into the standard format. The filtering script is as follows.

def filter_example(example):

if len(example['chosen']) != len(example['rejected']):
    return False
if len(example['chosen']) % 2 != 0:
    return False

n_rounds = len(example['chosen'])
for i in range(len(example['chosen'])):
    if example['chosen'][i]['role'] != ['user', 'assistant'][i % 2]:
        return False… See the full description on the dataset page: https://huggingface.co/datasets/RLHFlow/HH-RLHF-Harmless-and-RedTeam-standard.