You can deploy this model and start earning money today!

MurDanya/
llm-course-hw3-lora

Name: llm-course-hw3-lora
Availability: InStock

safetensors

mistral

cardiffnlp/tweet_eval

OuteAI/Lite-Oute-1-300M-Instruct

finetune

Views

No views yet

LoRA (Low-Rank Adaptation of Large Language Models) for sentiment analysis task

Описание задания

В этой домашке была дообучена языковая модель Lite-Oute-1-300M-Instruct с помощью LoRA на датасете cardiffnlp/tweet_eval для задачи анализа тональности текстов

Пример генерации

Вопрос

QT @user In the original draft of the 7th book, Remus Lupin survived the Battle of Hogwarts. #HappyBirthdayRemusLupin

Ответ модели

positive

Качество на тестовой выборке

F1 macro: 0.53

Пример запуска

python

from transformers import AutoModelForCausalLM, AutoTokenizer

REPO_NAME = "MurDanya/llm-course-hw3-lora"

model = AutoModelForCausalLM.from_pretrained(REPO_NAME, device_map="auto")
tokenizer = AutoTokenizer.from_pretrained(REPO_NAME)
tokenizer.pad_token = tokenizer.eos_token
tokenizer.padding_side = "left"