This model is a fine-tuned version of facebook/deit-tiny-patch16-224 on the imagefolder dataset. It achieves the following results on the evaluation set:

Loss: 0.4210
Accuracy: 0.8331

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.001
train_batch_size: 32
eval_batch_size: 32
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.1
num_epochs: 50

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
1.0811	1.0	76	1.0552	0.4808
0.945	2.0	152	0.9389	0.5793
0.8473	3.0	228	0.8609	0.6361
0.7999	4.0	304	0.8002	0.6561
0.6841	5.0	380	0.7558	0.6745
0.6329	6.0	456	0.7159	0.6895
0.6112	7.0	532	0.6747	0.7112
0.5645	8.0	608	0.6404	0.7195
0.5735	9.0	684	0.6198	0.7162
0.4448	10.0	760	0.5963	0.7362
0.4826	11.0	836	0.5775	0.7446
0.4884	12.0	912	0.5596	0.7546
0.419	13.0	988	0.5449	0.7629
0.4668	14.0	1064	0.5322	0.7713
0.3648	15.0	1140	0.5206	0.7780
0.435	16.0	1216	0.5120	0.7796
0.3985	17.0	1292	0.5037	0.7846
0.3605	18.0	1368	0.4957	0.7913
0.4239	19.0	1444	0.4882	0.7980
0.3983	20.0	1520	0.4823	0.7980
0.3854	21.0	1596	0.4759	0.8047
0.3728	22.0	1672	0.4711	0.8114
0.3399	23.0	1748	0.4667	0.8047
0.3623	24.0	1824	0.4632	0.8114
0.3017	25.0	1900	0.4575	0.8164
0.388	26.0	1976	0.4531	0.8147
0.2998	27.0	2052	0.4507	0.8147
0.3486	28.0	2128	0.4459	0.8180
0.2911	29.0	2204	0.4440	0.8214
0.2957	30.0	2280	0.4418	0.8230
0.3626	31.0	2356	0.4385	0.8264
0.2887	32.0	2432	0.4361	0.8214
0.3011	33.0	2508	0.4347	0.8247
0.3216	34.0	2584	0.4321	0.8230
0.4399	35.0	2660	0.4322	0.8314
0.3353	36.0	2736	0.4294	0.8297
0.3238	37.0	2812	0.4281	0.8280
0.3158	38.0	2888	0.4267	0.8297
0.316	39.0	2964	0.4263	0.8331
0.3078	40.0	3040	0.4248	0.8297
0.2618	41.0	3116	0.4247	0.8331
0.2721	42.0	3192	0.4237	0.8314
0.2921	43.0	3268	0.4227	0.8347
0.3099	44.0	3344	0.4222	0.8347
0.3081	45.0	3420	0.4219	0.8347
0.2984	46.0	3496	0.4214	0.8347
0.2929	47.0	3572	0.4213	0.8331
0.3041	48.0	3648	0.4210	0.8331
0.2743	49.0	3724	0.4210	0.8331
0.3962	50.0	3800	0.4210	0.8331

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu118
Datasets 2.15.0
Tokenizers 0.15.0

hkivancoral/smids_1x_deit_tiny_sgd_001_fold1

smids_1x_deit_tiny_sgd_001_fold1

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

hkivancoral/
smids_1x_deit_tiny_sgd_001_fold1