Full details on simulation and training can be found
here.
This is the second step of Stable Alignment project, which is a supervised fine-tuned model on
Anthropic HH-RLHF dataset (only on the 'accepted' options).
Although this project aims to better align current LMs with social norms, inappropriate content and inherent biases in the training data will still impair the alignment of the model.
The model should not be used directly in any application, without a prior assessment of safety and fairness concerns specific to the application.
1@misc{liu2023sociallyaligned,
2 title={Training Socially Aligned Language Models in Simulated Human Society},
3 author={Ruibo Liu and Ruixin Yang and Chenyan Jia and Ge Zhang and Denny Zhou and Andrew M. Dai and Diyi Yang and Soroush Vosoughi},
4 year={2023},
5 eprint={2305.16960},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL}
8}
