You can deploy this model and start earning money today!

kanishka/
smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_924

Name: smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_924
Availability: InStock

Views

No views yet

smolm-aochildes-vocab_8192-layers_8-attn_8-hidden_256-inter_1024-lr_1e-3-seed_924

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Accuracy
3.299	1.0	2928	3.2238	0.4226
2.8467	2.0	5856	2.8936	0.4503
2.6428	3.0	8784	2.7409	0.4650
2.5599	4.0	11712	2.6692	0.4727
2.5025	5.0	14640	2.6339	0.4774
2.4815	6.0	17568	2.6151	0.4787
2.4455	7.0	20496	2.6038	0.4804
2.4416	8.0	23424	2.6013	0.4803
2.4223	9.0	26352	2.5769	0.4841
2.3745	10.0	29280	2.5539	0.4861
2.339	11.0	32208	2.5347	0.4893
2.3068	12.0	35136	2.5238	0.4903
2.2783	13.0	38064	2.5181	0.4907
2.2372	14.0	40992	2.5051	0.4936
2.2031	15.0	43920	2.5039	0.4949
2.161	16.0	46848	2.4954	0.4960
2.1152	17.0	49776	2.4918	0.4967
2.0563	18.0	52704	2.4950	0.4975
1.9924	19.0	55632	2.5000	0.4978
1.9264	20.0	58560	2.5082	0.4976