Source: Curated list of English sentences from
https://huggingface.co/datasets/Aarif1430/english-to-hindi and the translations generated using Gemma2. When asked to translated a short text from English to Hindi, the response given by Gemma2 2B are in the rejected column while the accepted column contains responses by Gemma2 9B.
Use Case: Preference alignment using DPO or ORPO for machine translation models… See the full description on the dataset page:
https://huggingface.co/datasets/Avibhi/Gemma2_DPO_EnToHindi.