This model is a merge of several pre-trained Llama 3 8B language models specifically focused on Simplified Chinese (China), created using
mergekit.
Llama3-zhcn aims to deliver a Llama 3 model with deep Chinese cultural, historical, and linguistic comprehension. This model serves dual purposes: handling diverse everyday tasks and providing a solid foundation for additional merging and fine-tuning. As Chinese model development trends away from the Llama series, this merge strives to maintain and improve Llama 3's Chinese language capabilities
This model was created using the
Linear merge method, utilizing the Meta-Llama-3-8B-Instruct tokenizer.