You can deploy this model and start earning money today!

RefalMachine/
ruadapt_qwen2.5_3B_darulm_bpe_64000_full_lr2e4_bs256

Name: ruadapt_qwen2.5_3B_darulm_bpe_64000_full_lr2e4_bs256
Availability: InStock

Views

No views yet

ruadapt_qwen2.5_3B_darulm_bpe_64000_full_lr2e4_bs256

This model is a fine-tuned version of RefalMachine/ruadapt_qwen2.5_3B_darulm_bpe_64000_mean_init on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

Training Loss	Epoch	Step	Validation Loss	Accuracy
2.8396	0.09	1000	2.6993	0.4783
2.7801	0.18	2000	2.6373	0.4849
2.7488	0.26	3000	2.6154	0.4868
2.7519	0.35	4000	2.6053	0.4880
2.7159	0.44	5000	2.6004	0.4888
2.7303	0.53	6000	2.5980	0.4888
2.7572	0.61	7000	2.5966	0.4891
2.7377	0.7	8000	2.5961	0.4892
2.7412	0.79	9000	2.5959	0.4893
2.7246	0.88	10000	2.5958	0.4892
2.7197	0.97	11000	2.5958	0.4892