You can deploy this model and start earning money today!

kanishka/
smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_7

Name: smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_7
Availability: InStock

Views

No views yet

smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_7

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Accuracy
3.3063	1.0	2928	3.2287	0.4224
2.8612	2.0	5856	2.8999	0.4499
2.6613	3.0	8784	2.7412	0.4650
2.5669	4.0	11712	2.6672	0.4730
2.5047	5.0	14640	2.6345	0.4772
2.4798	6.0	17568	2.6113	0.4801
2.4456	7.0	20496	2.6108	0.4799
2.4362	8.0	23424	2.5973	0.4813
2.4183	9.0	26352	2.5758	0.4843
2.374	10.0	29280	2.5539	0.4876
2.3369	11.0	32208	2.5352	0.4899
2.3013	12.0	35136	2.5222	0.4916
2.2697	13.0	38064	2.5128	0.4930
2.2431	14.0	40992	2.5017	0.4946
2.1894	15.0	43920	2.4960	0.4955
2.1443	16.0	46848	2.4917	0.4965
2.1003	17.0	49776	2.4910	0.4981
2.0394	18.0	52704	2.4929	0.4983
1.9811	19.0	55632	2.4999	0.4987
1.9121	20.0	58560	2.5075	0.4986