You can deploy this model and start earning money today!

thedeba/
gemma_bn_instruct_v2

Name: gemma_bn_instruct_v2
Availability: InStock

Views

No views yet

gemma_bn_instruct_v2

This model is a fine-tuned version of INSAIT-Institute/BgGPT-Gemma-2-2.6B-IT-v1.0 on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 0.0002
train_batch_size: 1
eval_batch_size: 2
seed: 42
gradient_accumulation_steps: 8
total_train_batch_size: 8
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 3
mixed_precision_training: Native AMP

Training Loss	Epoch	Step	Validation Loss
1.8384	0.2768	200	1.8630
1.8637	0.5535	400	1.7923
1.7568	0.8303	600	1.6993
1.4292	1.1066	800	1.6683
1.5239	1.3833	1000	1.6333
1.585	1.6601	1200	1.5996
1.3414	1.9369	1400	1.5713
1.1018	2.2131	1600	1.6156
1.1496	2.4899	1800	1.5968
1.106	2.7666	2000	1.5895