We preprocess the dataset using our standard prompt, chosen, rejected format.
Download the anthropic_hh.py from the
https://huggingface.co/datasets/minnmamin/hh-rlhf-helpful-base-trl-style/tree/0.1.0.
Run python examples/datasets/anthropic_hh.py --debug --push_to_hub
