You can deploy this model and start earning money today!

ThanhHuyZZZ/
abte-restaurants-transfomer-encoder

Name: abte-restaurants-transfomer-encoder
Availability: InStock

transformers

safetensors

generated_from_trainer

endpoints_compatible

Views

No views yet

abte-restaurants-transfomer-encoder

This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.4025
F1-score: 0.5586

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 256
eval_batch_size: 256
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	F1-score
0.6377	1.0	15	0.6333	0.0
0.5454	2.0	30	0.5902	0.0
0.5136	3.0	45	0.5706	0.0928
0.4879	4.0	60	0.5432	0.2026
0.4739	5.0	75	0.5194	0.2862
0.4504	6.0	90	0.5006	0.3124
0.4312	7.0	105	0.4859	0.3313
0.4095	8.0	120	0.4782	0.3358
0.4017	9.0	135	0.4554	0.3741
0.3849	10.0	150	0.4601	0.3682
0.3697	11.0	165	0.4432	0.4120
0.3579	12.0	180	0.4312	0.4389
0.3482	13.0	195	0.4281	0.4380
0.3372	14.0	210	0.4211	0.4605
0.3313	15.0	225	0.4137	0.4740
0.3183	16.0	240	0.4188	0.4733
0.3113	17.0	255	0.4054	0.4923
0.3028	18.0	270	0.4014	0.5046
0.2868	19.0	285	0.4130	0.4948
0.2918	20.0	300	0.3967	0.5093
0.2883	21.0	315	0.3888	0.5119
0.2798	22.0	330	0.3990	0.5012
0.2752	23.0	345	0.3977	0.5029
0.266	24.0	360	0.3915	0.5143
0.262	25.0	375	0.3876	0.5169
0.257	26.0	390	0.3871	0.5202
0.2493	27.0	405	0.3772	0.5296
0.2431	28.0	420	0.3779	0.5273
0.2481	29.0	435	0.3824	0.5307
0.2377	30.0	450	0.3838	0.5295
0.2332	31.0	465	0.3769	0.5312
0.2345	32.0	480	0.3646	0.5535
0.2284	33.0	495	0.3908	0.5314
0.2228	34.0	510	0.3671	0.5470
0.2221	35.0	525	0.3726	0.5513
0.2193	36.0	540	0.3790	0.5442
0.2061	37.0	555	0.3820	0.5418
0.2065	38.0	570	0.3801	0.5456
0.202	39.0	585	0.3734	0.5428
0.2026	40.0	600	0.3686	0.5471
0.1982	41.0	615	0.3689	0.5501
0.1934	42.0	630	0.3769	0.5473
0.1912	43.0	645	0.3777	0.5431
0.1888	44.0	660	0.3704	0.5494
0.1866	45.0	675	0.3723	0.5486
0.1878	46.0	690	0.3742	0.5515
0.1809	47.0	705	0.3849	0.5490
0.1773	48.0	720	0.3788	0.5520
0.172	49.0	735	0.3720	0.5569
0.1753	50.0	750	0.3778	0.5573
0.1714	51.0	765	0.3876	0.5517
0.1699	52.0	780	0.3704	0.5575
0.1659	53.0	795	0.3857	0.5558
0.1627	54.0	810	0.3844	0.5561
0.1605	55.0	825	0.3899	0.5540
0.1623	56.0	840	0.3843	0.5517
0.1605	57.0	855	0.3856	0.5543
0.1535	58.0	870	0.3855	0.5528
0.1565	59.0	885	0.3824	0.5573
0.154	60.0	900	0.3870	0.5560
0.1521	61.0	915	0.3912	0.5544
0.1493	62.0	930	0.3868	0.5556
0.1487	63.0	945	0.3856	0.5563
0.1529	64.0	960	0.3864	0.5548
0.1492	65.0	975	0.4026	0.5552
0.147	66.0	990	0.3927	0.5526
0.145	67.0	1005	0.3860	0.5552
0.142	68.0	1020	0.3958	0.5550
0.1432	69.0	1035	0.3870	0.5529
0.1415	70.0	1050	0.3912	0.5546
0.1377	71.0	1065	0.3937	0.5526
0.1427	72.0	1080	0.3925	0.5559
0.1353	73.0	1095	0.3941	0.5564
0.1379	74.0	1110	0.4017	0.5544
0.1353	75.0	1125	0.3955	0.5594
0.1355	76.0	1140	0.3959	0.5577
0.135	77.0	1155	0.3995	0.5563
0.1332	78.0	1170	0.3991	0.5528
0.1423	79.0	1185	0.3983	0.5569
0.1311	80.0	1200	0.3908	0.5562
0.1308	81.0	1215	0.3966	0.5563
0.1341	82.0	1230	0.4007	0.5550
0.1309	83.0	1245	0.3990	0.5568
0.1309	84.0	1260	0.3925	0.5570
0.1286	85.0	1275	0.3964	0.5552
0.1287	86.0	1290	0.4018	0.5566
0.1282	87.0	1305	0.3993	0.5563
0.1306	88.0	1320	0.3998	0.5556
0.1299	89.0	1335	0.3993	0.5568
0.1301	90.0	1350	0.4023	0.5559
0.1264	91.0	1365	0.4035	0.5548
0.1274	92.0	1380	0.3996	0.5561
0.1276	93.0	1395	0.3990	0.5559
0.1273	94.0	1410	0.4026	0.5582
0.1261	95.0	1425	0.4025	0.5575
0.1266	96.0	1440	0.4004	0.5564
0.1299	97.0	1455	0.4020	0.5580
0.1279	98.0	1470	0.4011	0.5567
0.127	99.0	1485	0.4025	0.5585
0.125	100.0	1500	0.4025	0.5586

Framework versions

Transformers 4.57.3
Pytorch 2.9.0+cu126
Datasets 3.2.0
Tokenizers 0.22.2

ThanhHuyZZZ/abte-restaurants-transfomer-encoder

abte-restaurants-transfomer-encoder

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

ThanhHuyZZZ/
abte-restaurants-transfomer-encoder