Model description

More information needed

Intended uses & limitations

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 1e-05
train_batch_size: 2
eval_batch_size: 2
seed: 42
gradient_accumulation_steps: 16
total_train_batch_size: 32
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 50
training_steps: 900
mixed_precision_training: Native AMP

Training Loss	Epoch	Step	Validation Loss
0.6278	3.4622	100	0.5139
0.5249	6.9244	200	0.4909
0.4875	10.3556	300	0.4814
0.481	13.8178	400	0.4738
0.462	17.2489	500	0.4714
0.4601	20.7111	600	0.4699
0.4512	24.1422	700	0.4688
0.4496	27.6044	800	0.4687
0.4455	31.0356	900	0.4698