You can deploy this model and start earning money today!

jonasknobloch/
gpt2_m070_tiny-stories_1024

Name: gpt2_m070_tiny-stories_1024
Availability: InStock

Views

No views yet

gpt2_m070_tiny-stories_1024

This model is a fine-tuned version of on the roneneldan/TinyStories dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Accuracy
2.8977	0.0523	1000	2.4285	0.4506
1.9691	0.1045	2000	1.7883	0.5700
1.7235	0.1568	3000	1.6068	0.6021
1.6024	0.2091	4000	1.5058	0.6207
1.5325	0.2613	5000	1.4471	0.6315
1.481	0.3136	6000	1.4035	0.6400
1.4382	0.3659	7000	1.3690	0.6468
1.4083	0.4181	8000	1.3372	0.6527
1.3835	0.4704	9000	1.3157	0.6568
1.3618	0.5227	10000	1.2963	0.6608
1.3439	0.5750	11000	1.2785	0.6642
1.3279	0.6272	12000	1.2658	0.6668
1.3158	0.6795	13000	1.2528	0.6693
1.3022	0.7318	14000	1.2427	0.6714
1.295	0.7840	15000	1.2337	0.6733
1.285	0.8363	16000	1.2253	0.6751
1.2774	0.8886	17000	1.2190	0.6765
1.2734	0.9408	18000	1.2134	0.6776
1.2705	0.9931	19000	1.2098	0.6783