Is this your dataset? Claim it with the Hugging Face account that owns it.

allenai/
Dolci-Instruct-DPO

Name: Dolci-Instruct-DPO
Creator: allenai
License: https://spdx.org/licenses/ODC-By-1.0.html

Views

No views yet

Dolci Instruct DPO Mixture

This dataset is licensed under ODC-BY. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines. The Dolci Instruct DPO mixture was used to preference tune Olmo 3 Instruct 7B. It contains 260,000 preference pairs in total, including:

125,000 pairs created with the preference heuristic described in Delta Learning (Geng et al. 2025) 125,000 pairs created with a delta-aware Ultrafeedback-esque GPT-judge pipeline… See the full description on the dataset page: https://huggingface.co/datasets/allenai/Dolci-Instruct-DPO.