You can deploy this model and start earning money today!

bashyaldhiraj2067/
3_march_28_attention_copy_mechanism

Name: 3_march_28_attention_copy_mechanism
Availability: InStock

Views

No views yet

3_march_28_attention_copy_mechanism

This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 0.0005
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 2

Training Loss	Epoch	Step	Validation Loss
2.9269	0.1219	1000	2.4584
2.4626	0.2438	2000	2.4223
2.4336	0.3658	3000	2.3997
2.4315	0.4877	4000	2.3965
2.4187	0.6096	5000	2.4025
2.4139	0.7315	6000	2.3762
2.4017	0.8535	7000	2.3742
2.4012	0.9754	8000	2.3543
2.3823	1.0973	9000	2.3446
2.3764	1.2192	10000	2.3413
2.3649	1.3411	11000	2.3180
2.3525	1.4631	12000	2.3058
2.3444	1.5850	13000	2.2971
2.3329	1.7069	14000	2.2840
2.3212	1.8288	15000	2.2847
2.3184	1.9507	16000	2.2734