We preprocess the dataset using our standard prompt, chosen, rejected format.
Download the anthropic_hh.py from the
https://huggingface.co/datasets/daidv1112/alignmem/tree/0.1.0.
Run python examples/datasets/anthropic_hh.py --push_to_hub --hf_entity daidv1112
