Total copy of Anthropic/hh-rlhf (all credit and rights to the authors of that), just with some modifications to the format so that it can be used with the eleuther-elk repository.
Changes:
rename column "chosen" to "choice0" and "rejected" to "choice1"
randomly flip the entry in column choice0 and choice1 for half of the entries
create a ClassLabel column "label" that stores an integer 0 or 1, corresponding to which of choice0 or choice1 was… See the full description on the dataset page:
https://huggingface.co/datasets/LRudL/anthropic_hh_modified.
