This is a Lora trained on llama2 7B Chat, with its dataset consisting of a large number of AI-generated conversation examples. This training allows llama2 7B to maintain its original vibrant conversational style as much as possible and excel in roles other than just being an assistant, especially in Chinese contexts.
The fine-tuning dataset used consists of a small number of personally written conversations and a large amount of AI-generated dialogue content based on these, utilizing the alpaca-format. It comprises approximately 7,000 instructions in total and has a size of 9MB.
Using the Training tool in the text-generation-webui, calling a V100 on Google Colab, and reading Llama2 7B in 4-bit mode, training was performed with default parameters. The total training time took approximately 2 hours
