This dataset is reformatted version of following datasets
ryota39/synthetic-instruct-gptj-pairwise-ja
ryota39/webgpt_comparisons-ja
label 1 stands for chosen sentence
label 0 stands for rejected sentence
Format
train sample: 199628
validation sample: 1000
test sample: 1000
skip sample: 417
data points which have same chosen and rejected responses were eliminated
{
"index": 33045,
"input": "user: 今年知っておくべき税法の変更点にはどのようなものがありますか。\nassistant:… See the full description on the dataset page: https://huggingface.co/datasets/ryota39/open_preference_v0.4.
