ValueLlama is designed for perception-level value measurement in an open-ended value space, which includes two tasks: (1) Relevance classification determines whether a perception is relevant to a value; and (2) Valence classification determines whether a perception supports, opposes, or remains neutral (context-dependent) towards a value. Both tasks are formulated as generating a label given a value and a perception.
See our codebase for more details:
https://github.com/Value4AI/gpv.
1@misc{ye2024gpv,
2 title={Measuring Human and AI Values based on Generative Psychometrics with Large Language Models},
3 author={Haoran Ye and Yuhang Xie and Yuanyi Ren and Hanjun Fang and Xin Zhang and Guojie Song},
4 year={2024},
5 eprint={2409.12106},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2409.12106},
9}