The MultiPref dataset (version 1.0) is a rich collection of 10k human preferences. It is:
Multi-annotated: each instance is annotated multiple times—twice by normal crowdworkers and twice by domain-experts— resulting in around 40k annotations.
Multi-aspect: aside from their Overall preference, annotators choose their preferred response on a five-point Likert… See the full description on the dataset page:
https://huggingface.co/datasets/1-800-SHARED-TASKS/allenai-multipref.
