Note that this collection is licensed under ODC-BY-1.0 license; different licenses apply to subsets of the data. Some portions of the dataset are non-commercial. We present the mixture as a research artifact.
This preference dataset is part of our Tulu 3 preference mixture:
it contains prompts from WildChat, which include constraints, and it contains 10,792 generation pairs (some of which on-policy from allenai/Llama-3.1-Tulu-3-70B)… See the full description on the dataset page:
https://huggingface.co/datasets/allenai/tulu-3-wildchat-if-on-policy-70b.
