This dataset is a simplified version of argilla/dpo-mix-7k.
The simplification comes from the fact that the prompt column is detached from both the chosen and rejected
columns so that there's no need for extra pre-processing while applying the chat template to the dataset before the
fine-tuning. So on, the dataset remains as is, with an additional column for the prompt.
The dataset is a small cocktail combining Argilla's latest efforts on DPO… See the full description on the dataset page:
https://huggingface.co/datasets/alvarobartt/dpo-mix-7k-simplified.
