You can deploy this model and start earning money today!

ard2020/
l3_it_10k_minus_hien

Name: l3_it_10k_minus_hien
Availability: InStock

generated_from_trainer

meta-llama/Meta-Llama-3-8B-Instruct

adapter

llama3

Views

No views yet

l3_it_10k_minus_hien

This model is a fine-tuned version of meta-llama/Meta-Llama-3-8B-Instruct on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.6522

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0003
train_batch_size: 8
eval_batch_size: 4
seed: 3407
gradient_accumulation_steps: 8
total_train_batch_size: 64
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: cosine
lr_scheduler_warmup_steps: 0.01
num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss
0.7703	0.2010	24	0.7228
0.6912	0.4021	48	0.6820
0.6512	0.6031	72	0.6617
0.6573	0.8042	96	0.6522

Framework versions

PEFT 0.11.1
Transformers 4.41.1
Pytorch 2.3.0+cu121
Datasets 2.19.1
Tokenizers 0.19.1

ard2020/l3_it_10k_minus_hien

l3_it_10k_minus_hien

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

ard2020/
l3_it_10k_minus_hien