French part of the Aya dataset, which we have formatted to be usable for DPO.
To do this, we use the annotation_type column, which contains the values original_annotations (response rejected for the given prompt) or re-annotations (response chosen for the given prompt).
@misc{singh2024aya,
title={Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning},
author={Shivalika Singh and Freddie Vargus and Daniel Dsouza and… See the full description on the dataset page:
https://huggingface.co/datasets/CATIE-AQ/aya_french_dpo.
