The dataset is a relabel dataset of the CarperAI/openai_summarize_comparisons dataset.
The annotators are Reward Model trained on the train split of CarperAI/openai_summarize_comparisons dataset based on the llama-2-7b .
The annotation python script is as follows:
from transformers import AutoModelForSequenceClassification, AutoTokenizer
import torch
from datasets import load_dataset
from scipy.special import expit
import numpy as np
import random
import json
from tqdm import tqdm
import… See the full description on the dataset page:
https://huggingface.co/datasets/chadlzx/openai_summarize_comparisons_relabel.
