You can deploy this model and start earning money today!

ThanhHuyZZZ/
abte-restaurants-distilbert-base-uncased

Name: abte-restaurants-distilbert-base-uncased
Availability: InStock

generated_from_trainer

distilbert/distilbert-base-uncased

finetune

apache-2.0

endpoints_compatible

Views

No views yet

abte-restaurants-distilbert-base-uncased

This model is a fine-tuned version of distilbert/distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.2972
F1-score: 0.8323

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 256
eval_batch_size: 256
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 40

Training results

Training Loss	Epoch	Step	Validation Loss	F1-score
0.6385	1.0	15	0.5273	0.0
0.3647	2.0	30	0.3032	0.5381
0.2312	3.0	45	0.2595	0.6198
0.1766	4.0	60	0.2345	0.6653
0.1398	5.0	75	0.2154	0.7362
0.1019	6.0	90	0.2052	0.7802
0.08	7.0	105	0.2048	0.8063
0.0658	8.0	120	0.2111	0.8119
0.0537	9.0	135	0.2171	0.8083
0.0445	10.0	150	0.2230	0.8189
0.039	11.0	165	0.2296	0.8200
0.0316	12.0	180	0.2293	0.8282
0.0291	13.0	195	0.2412	0.8276
0.0263	14.0	210	0.2422	0.8323
0.0246	15.0	225	0.2466	0.8288
0.0202	16.0	240	0.2581	0.8309
0.02	17.0	255	0.2596	0.8318
0.0172	18.0	270	0.2620	0.8352
0.0162	19.0	285	0.2664	0.8357
0.0151	20.0	300	0.2710	0.8356
0.0156	21.0	315	0.2743	0.8299
0.0142	22.0	330	0.2776	0.8269
0.0137	23.0	345	0.2823	0.8326
0.0129	24.0	360	0.2801	0.8357
0.0119	25.0	375	0.2843	0.8342
0.0111	26.0	390	0.2834	0.8339
0.0104	27.0	405	0.2851	0.8365
0.0103	28.0	420	0.2856	0.8385
0.0112	29.0	435	0.2921	0.8350
0.0093	30.0	450	0.2869	0.8376
0.01	31.0	465	0.2894	0.8367
0.0113	32.0	480	0.2932	0.8359
0.0091	33.0	495	0.2937	0.8348
0.009	34.0	510	0.2928	0.8347
0.0111	35.0	525	0.2950	0.8360
0.0087	36.0	540	0.2974	0.8337
0.0084	37.0	555	0.2971	0.8362
0.0078	38.0	570	0.2965	0.8337
0.0079	39.0	585	0.2968	0.8334
0.0084	40.0	600	0.2972	0.8323

Framework versions

Transformers 4.57.3
Pytorch 2.9.0+cu126
Datasets 3.2.0
Tokenizers 0.22.2

ThanhHuyZZZ/abte-restaurants-distilbert-base-uncased

abte-restaurants-distilbert-base-uncased

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

ThanhHuyZZZ/
abte-restaurants-distilbert-base-uncased