Model Card: llama3-pre1-pre2-ds-lora3 with Fine-Tuning
Model Overview
Model Name: llama3-pre1-pre2-ds-lora3
llama3-pre1-pre2-ds-lora3 is a language model pre-trained on a diverse corpus of English and Korean texts.
This fine-tuning approach allows the model to adapt to specific tasks or datasets with a minimal number of additional parameters, making it efficient and effective for specialized applications.
1from transformers import AutoConfig, AutoModel, AutoTokenizer
2
3config = AutoConfig.from_pretrained("4yo1/llama3-pre1-pre2-ds-lora3")
4model = AutoModel.from_pretrained("4yo1/llama3-pre1-pre2-ds-lora3")
5tokenizer = AutoTokenizer.from_pretrained("4yo1/llama3-pre1-pre2-ds-lora3")