data source from
data_name1 = 'xiaodongguaAIGC/CValues_DPO' # 110k, 30k
data_name2 = 'Anthropic/hh-rlhf' # 160k
data_name3 = 'PKU-Alignment/PKU-SafeRLHF-30K' # 30k filter both unsafe dataset
data_name4 = 'wenbopan/Chinese-dpo-pairs' # 10k
特别处理:
hh-rlhf里 删除了第一个###Question
saferlhf里,去除了都不安全回复