This dataset is a curated version of UltraFeedback dataset performed by Argilla (using distilabel).
You can take a look at argilla/ultrafeedback-binarized-preferences for more context on the UltraFeedback error, but the following excerpt sums up the problem found:
After visually browsing around some examples using the sort and filter feature of Argilla (sort by highest rating for chosen responses), we noticed a strong mismatch between… See the full description on the dataset page:
https://huggingface.co/datasets/argilla/ultrafeedback-curated.
