Please check our GitHub for more details.:
https://github.com/HJYao00/MulberryWe use LLaMA-Factory to fine-tune the Mulberry models. We provide the training instructions and configs here.
First, install LLaMA-Factory according to the official_instruction.
Then, refer here and update the following customized dataset into dataset_info.json in LLaMA-Factory.
"mulberry": {
"file_name": "./mulberry_sft.json",
"formatting": "sharegpt",
"columns": {
"messages":… See the full description on the dataset page:
https://huggingface.co/datasets/HuanjinYao/Mulberry-SFT.
