You can deploy this model and start earning money today!

kanishka/
smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_2409

Name: smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_2409
Availability: InStock

Views

No views yet

smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_2409

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Accuracy
3.3001	1.0	2928	3.2264	0.4217
2.8648	2.0	5856	2.9074	0.4497
2.6734	3.0	8784	2.7481	0.4638
2.5598	4.0	11712	2.6742	0.4715
2.5101	5.0	14640	2.6399	0.4753
2.4816	6.0	17568	2.6169	0.4779
2.454	7.0	20496	2.6083	0.4791
2.445	8.0	23424	2.6006	0.4792
2.4111	9.0	26352	2.5726	0.4846
2.385	10.0	29280	2.5509	0.4866
2.3402	11.0	32208	2.5366	0.4892
2.306	12.0	35136	2.5242	0.4911
2.2773	13.0	38064	2.5114	0.4925
2.2262	14.0	40992	2.5019	0.4939
2.1914	15.0	43920	2.4951	0.4951
2.1503	16.0	46848	2.4916	0.4968
2.1054	17.0	49776	2.4882	0.4981
2.0424	18.0	52704	2.4923	0.4979
1.9798	19.0	55632	2.5003	0.4981
1.9075	20.0	58560	2.5082	0.4985