You can deploy this model and start earning money today!

ai4jobs/
ModernBERT-base_en-tr_jobs_sentence-transformer_isco08-clf

Name: ModernBERT-base_en-tr_jobs_sentence-transformer_isco08-clf
Availability: InStock

generated_from_trainer

ai4jobs/ModernBERT-base_en-tr_jobs_sentence-transformer

finetune

autotrain_compatible

endpoints_compatible

Views

No views yet

ModernBERT-base_en-tr_jobs_sentence-transformer_isco08-clf

This model is a fine-tuned version of ai4jobs/ModernBERT-base_en-tr_jobs_sentence-transformer on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6422
F1 Weighted: 0.8648
F1 Macro: 0.7261
Accuracy: 0.8664

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 8
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.1
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	F1 Weighted	F1 Macro	Accuracy
3.7046	0.0738	1000	1.8127	0.5404	0.2164	0.6028
1.4045	0.1476	2000	1.2539	0.6467	0.3401	0.6696
1.1355	0.2214	3000	1.2250	0.6547	0.4044	0.6804
1.0971	0.2951	4000	1.1231	0.6729	0.4477	0.6908
1.0373	0.3689	5000	1.1859	0.6534	0.3802	0.6788
1.0494	0.4427	6000	1.1778	0.6555	0.4046	0.6684
1.0086	0.5165	7000	1.0574	0.6865	0.4335	0.7064
0.9477	0.5903	8000	1.0233	0.6943	0.4509	0.7104
0.9033	0.6641	9000	0.9616	0.7164	0.4816	0.7288
0.8603	0.7378	10000	0.9422	0.7261	0.5033	0.7388
0.8244	0.8116	11000	0.8999	0.7298	0.5248	0.7464
0.795	0.8854	12000	0.8613	0.7431	0.5233	0.76
0.782	0.9592	13000	0.8270	0.7389	0.5230	0.7512
0.6856	1.0330	14000	0.7930	0.7566	0.5786	0.768
0.5895	1.1068	15000	0.7790	0.7634	0.5799	0.7728
0.5914	1.1806	16000	0.8156	0.7516	0.5589	0.7624
0.5891	1.2543	17000	0.7365	0.7790	0.5949	0.7884
0.5729	1.3281	18000	0.7380	0.7724	0.5787	0.7788
0.5644	1.4019	19000	0.7421	0.7804	0.6100	0.7872
0.559	1.4757	20000	0.7244	0.7908	0.6147	0.8
0.5336	1.5495	21000	0.7134	0.7876	0.6180	0.7916
0.5237	1.6233	22000	0.7011	0.7793	0.5901	0.7912
0.5461	1.6970	23000	0.6844	0.7975	0.6187	0.8032
0.5339	1.7708	24000	0.6587	0.7984	0.6496	0.8036
0.5227	1.8446	25000	0.6313	0.8080	0.6262	0.8144
0.5183	1.9184	26000	0.6386	0.8141	0.6476	0.8164
0.4929	1.9922	27000	0.6458	0.8030	0.6338	0.8092
0.3195	2.0660	28000	0.6624	0.8038	0.6340	0.8092
0.299	2.1397	29000	0.6549	0.8182	0.6642	0.8248
0.3	2.2135	30000	0.6606	0.8103	0.6590	0.818
0.314	2.2873	31000	0.6637	0.8190	0.6661	0.8244
0.2975	2.3611	32000	0.6709	0.8212	0.6622	0.826
0.3115	2.4349	33000	0.6536	0.8201	0.6685	0.824
0.2924	2.5087	34000	0.6921	0.8117	0.6676	0.816
0.2853	2.5825	35000	0.6499	0.8254	0.6654	0.83
0.291	2.6562	36000	0.6373	0.8279	0.6785	0.8312
0.2826	2.7300	37000	0.6537	0.8264	0.6748	0.8304
0.2848	2.8038	38000	0.6588	0.8374	0.7092	0.8392
0.2654	2.8776	39000	0.6368	0.8362	0.6912	0.8388
0.2703	2.9514	40000	0.6114	0.8354	0.6824	0.8368
0.1955	3.0252	41000	0.6244	0.8378	0.7030	0.8412
0.0969	3.0989	42000	0.6755	0.8316	0.6761	0.8348
0.111	3.1727	43000	0.6181	0.8413	0.6869	0.8456
0.107	3.2465	44000	0.6431	0.8426	0.6894	0.846
0.1118	3.3203	45000	0.6591	0.8422	0.6947	0.8452
0.1106	3.3941	46000	0.6392	0.8472	0.7073	0.8492
0.1074	3.4679	47000	0.6674	0.8479	0.7100	0.8504
0.1074	3.5417	48000	0.6679	0.8448	0.7094	0.8476
0.1137	3.6154	49000	0.6835	0.8430	0.7026	0.8452
0.1082	3.6892	50000	0.6581	0.8481	0.7029	0.85
0.112	3.7630	51000	0.6675	0.8470	0.6989	0.85
0.1087	3.8368	52000	0.6517	0.8486	0.6952	0.8508
0.1019	3.9106	53000	0.6492	0.8530	0.6923	0.8552
0.1087	3.9844	54000	0.6315	0.8607	0.7178	0.8632
0.0392	4.0581	55000	0.6417	0.8552	0.7318	0.8568
0.0295	4.1319	56000	0.6298	0.8588	0.7289	0.86
0.0298	4.2057	57000	0.6622	0.8578	0.7363	0.8596
0.0246	4.2795	58000	0.6510	0.8614	0.7341	0.8628
0.0284	4.3533	59000	0.6510	0.8568	0.7191	0.8592
0.0337	4.4271	60000	0.6435	0.8592	0.7244	0.8616
0.03	4.5008	61000	0.6605	0.8602	0.7267	0.8624
0.0295	4.5746	62000	0.6573	0.8630	0.7282	0.864
0.0277	4.6484	63000	0.6425	0.8636	0.7337	0.8652
0.0324	4.7222	64000	0.6392	0.8597	0.7326	0.8616
0.024	4.7960	65000	0.6478	0.8613	0.7294	0.8632
0.0263	4.8698	66000	0.6415	0.8652	0.7309	0.8668
0.0217	4.9436	67000	0.6422	0.8648	0.7261	0.8664

Framework versions

Transformers 4.48.3
Pytorch 2.6.0+cu124
Datasets 3.3.0
Tokenizers 0.21.0

ai4jobs/ModernBERT-base_en-tr_jobs_sentence-transformer_isco08-clf

ModernBERT-base_en-tr_jobs_sentence-transformer_isco08-clf

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

ai4jobs/
ModernBERT-base_en-tr_jobs_sentence-transformer_isco08-clf