MLap/

bloom1.7-lora-sentiment-analysis-classification

Model Description

• Developed by: Aman Prakash
• Model type: Decoder only LLM
• Language(s) (NLP): All suported by Bloom-1.7B, but primarily finetuned on English Dataset.
• License: MIT
• Finetuned from model: Bloom-1.7B

Uses

Downstream Use

Training Details

FineTuning Data

Training Procedure

Training Hyperparameters

per_device_train_batch_size=4,
per_device_eval_batch_size=4,
gradient_accumulation_steps=4,
eval_strategy="steps",
eval_steps=200,
logging_steps=100,
num_train_epochs=2,
learning_rate=2e-4,
fp16=True, 
save_steps=500,
save_total_limit=2,