This dataset is a DPO dataset sourced from a non-deduplicated version of the Pipkin dataset in which regenerations have been utilized to create DPO signals.
These are real data signals from real users.
It is not reccomended to utilize the prompt items of this dataset for SFT, as for the majaority of them, along with the responses are low quality. This works for DPO due to delta learning however does not transfer to SFT.
This dataset is in… See the full description on the dataset page:
https://huggingface.co/datasets/LucidityAI/PIPKIN-10K-DPO.
