This dataset contains up to 2.5 million responses for each model in the Olmo 3 DPO model pool, totalling about 71 million prompt, response pairs. Prompts are sourced from allenai/Dolci-Instruct-SFT, with additional data from allenai/WildChat.

	Dataset Structure




	


	Configurations

Each model has its own configuration. Load a specific model's responses with: from datasets import load_dataset

ds =… See the full description on the dataset page: https://huggingface.co/datasets/allenai/Dolci-DPO-Model-Response-Pool.