You can deploy this model and start earning money today!

devika-tiwari/
gpt2_small_expandedbabyLM_100M_exp3_conj_ratio_0p25_mix_0p50_44

Name: gpt2_small_expandedbabyLM_100M_exp3_conj_ratio_0p25_mix_0p50_44
Availability: InStock

Views

No views yet

gpt2_small_expandedbabyLM_100M_exp3_conj_ratio_0p25_mix_0p50_44

This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss
3.614	1.0	4088	4.5491
3.2626	2.0	8176	3.8864
3.1257	3.0	12264	3.7857
3.0436	4.0	16352	3.7108
2.9766	5.0	20440	3.7256
2.9408	6.0	24528	3.7372
2.8923	7.0	28616	3.6848
2.8673	8.0	32704	3.7826
2.8353	9.0	36792	3.7885
2.8141	10.0	40880	3.8231