Ultrafeedback binarized dataset using the mean of preference ratings
Introduction
This dataset contains the result of curation work performed by Argilla (using Argilla 😃).
After visually browsing around 200 examples using the sort and filter feature of Argilla, we noticed a strong mismatch between the overall_score in the original UF dataset (and the Zephyr train_prefs dataset) and the quality of the chosen response.
By adding the critique rationale to our Argilla… See the full description on the dataset page: https://huggingface.co/datasets/argilla/ultrafeedback-binarized-curation.
