导出Chatgpt的历史聊天记录后使用origin2trainDatasets.py清洗为符合微调模型的数据集,并通过
unsloth进行微调训练
Code:
colab code Dataset: export chatgpt data and use
script program to organize trainable canonical data
Export Chatgpt's history chats and use origin2trainDatasets.py to clean them into datasets that match the fine-tuned model and train them with
unsloth for fine-tuning.
Base model: unsloth/Meta-Llama-3.1-8B-bnb-4bit Training method: lora
Effectiveness evaluation to be determined