This model is a fine-tuned version of facebook/dinov2-small-imagenet1k-1-layer on the matthieulel/galaxy10_decals dataset. It achieves the following results on the evaluation set:

Loss: 0.5373
Accuracy: 0.8563
Precision: 0.8536
Recall: 0.8563
F1: 0.8543

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
gradient_accumulation_steps: 4
total_train_batch_size: 256
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.1
num_epochs: 30

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Precision	Recall	F1
1.0027	0.99	62	0.8262	0.7080	0.7231	0.7080	0.7017
0.8374	2.0	125	0.6129	0.7948	0.7960	0.7948	0.7899
0.7753	2.99	187	0.6555	0.7892	0.7921	0.7892	0.7787
0.7165	4.0	250	0.5862	0.8005	0.8053	0.8005	0.7970
0.6477	4.99	312	0.6183	0.7965	0.8119	0.7965	0.7985
0.6892	6.0	375	0.5310	0.8247	0.8275	0.8247	0.8195
0.6171	6.99	437	0.5678	0.8083	0.8157	0.8083	0.8022
0.55	8.0	500	0.4961	0.8326	0.8353	0.8326	0.8316
0.5615	8.99	562	0.5033	0.8309	0.8312	0.8309	0.8274
0.5107	10.0	625	0.5162	0.8191	0.8164	0.8191	0.8152
0.5237	10.99	687	0.4790	0.8422	0.8452	0.8422	0.8381
0.4954	12.0	750	0.4782	0.8422	0.8430	0.8422	0.8373
0.4887	12.99	812	0.4689	0.8371	0.8395	0.8371	0.8358
0.4629	14.0	875	0.4541	0.8523	0.8500	0.8523	0.8502
0.4486	14.99	937	0.4755	0.8405	0.8400	0.8405	0.8394
0.4361	16.0	1000	0.4763	0.8371	0.8392	0.8371	0.8370
0.3833	16.99	1062	0.4982	0.8416	0.8429	0.8416	0.8396
0.3788	18.0	1125	0.5632	0.8292	0.8365	0.8292	0.8267
0.3722	18.99	1187	0.5162	0.8388	0.8364	0.8388	0.8357
0.3467	20.0	1250	0.5125	0.8399	0.8357	0.8399	0.8342
0.3518	20.99	1312	0.5569	0.8309	0.8327	0.8309	0.8276
0.3432	22.0	1375	0.5032	0.8484	0.8451	0.8484	0.8454
0.3067	22.99	1437	0.5246	0.8433	0.8462	0.8433	0.8433
0.2923	24.0	1500	0.5363	0.8467	0.8482	0.8467	0.8464
0.303	24.99	1562	0.5435	0.8484	0.8453	0.8484	0.8457
0.2523	26.0	1625	0.5500	0.8444	0.8422	0.8444	0.8419
0.2523	26.99	1687	0.5369	0.8529	0.8533	0.8529	0.8529
0.262	28.0	1750	0.5373	0.8563	0.8536	0.8563	0.8543
0.232	28.99	1812	0.5384	0.8529	0.8509	0.8529	0.8516
0.2278	29.76	1860	0.5429	0.8512	0.8489	0.8512	0.8495

Framework versions

Transformers 4.37.2
Pytorch 2.3.0
Datasets 2.19.1
Tokenizers 0.15.1

matthieulel/dinov2-small-imagenet1k-1-layer-finetuned-galaxy10-decals

dinov2-small-imagenet1k-1-layer-finetuned-galaxy10-decals

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

matthieulel/
dinov2-small-imagenet1k-1-layer-finetuned-galaxy10-decals