You can deploy this model and start earning money today!

ferrazzipietro/
Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged-60k

Name: Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged-60k
Availability: InStock

ferrazzipietro/Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged

Views

No views yet

Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged-60k

This model is a fine-tuned version of ferrazzipietro/Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.8867
F1 Micro: 0.9336
F1 Macro: 0.4162
F1 Weighted: 0.9350

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0003
train_batch_size: 16
eval_batch_size: 64
seed: 42
distributed_type: multi-GPU
gradient_accumulation_steps: 4
total_train_batch_size: 64
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-07 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
lr_scheduler_warmup_ratio: 0.1
num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	F1 Micro	F1 Macro	F1 Weighted
24.0625	0.0024	2	5.3438	0.0	0.0	0.0
24.0625	0.0047	4	5.3250	0.0	0.0	0.0
23.7734	0.0071	6	5.2937	0.0	0.0	0.0
23.7734	0.0095	8	5.2125	0.0	0.0	0.0
22.8562	0.0118	10	5.0813	0.0	0.0	0.0
22.8562	0.0142	12	4.8625	0.0	0.0	0.0
22.8562	0.0165	14	4.6375	0.0	0.0	0.0
21.3062	0.0189	16	4.3500	0.0	0.0	0.0
21.3062	0.0213	18	3.9656	0.0	0.0	0.0
18.4125	0.0236	20	3.5531	0.0	0.0	0.0
18.4125	0.0260	22	3.2219	0.0	0.0	0.0
18.4125	0.0284	24	3.0844	0.0	0.0	0.0
14.65	0.0307	26	3.0344	0.0	0.0	0.0
14.65	0.0331	28	2.9094	0.0	0.0	0.0
13.3875	0.0355	30	2.7875	0.0	0.0	0.0
13.3875	0.0378	32	2.6781	0.0	0.0	0.0
13.3875	0.0402	34	2.5781	0.0	0.0	0.0
12.1469	0.0426	36	2.4625	0.0	0.0	0.0
12.1469	0.0449	38	2.3531	0.0	0.0	0.0
11.125	0.0473	40	2.2531	0.0233	0.0043	0.0333
11.125	0.0496	42	2.1781	0.2857	0.0364	0.2519
11.125	0.0520	44	2.1094	0.3987	0.0591	0.3626
10.3906	0.0544	46	2.0578	0.4153	0.0656	0.4077
10.3906	0.0567	48	2.0062	0.5282	0.0592	0.4279
10.0375	0.0591	50	1.9625	0.4917	0.0640	0.4374
10.0375	0.0615	52	1.9219	0.4585	0.0714	0.4004
10.0375	0.0638	54	1.8813	0.5482	0.0886	0.5287
9.2594	0.0662	56	1.8500	0.6346	0.1003	0.6127
9.2594	0.0686	58	1.8234	0.6445	0.1469	0.6363
9.2406	0.0709	60	1.7969	0.6512	0.1297	0.6595
9.2406	0.0733	62	1.7734	0.6944	0.1627	0.7077
9.2406	0.0757	64	1.7516	0.7309	0.2075	0.7120
8.9766	0.0780	66	1.7313	0.7143	0.2024	0.7162
8.9766	0.0804	68	1.7125	0.7641	0.2155	0.7588
8.7359	0.0827	70	1.6984	0.7774	0.2064	0.7629
8.7359	0.0851	72	1.6781	0.7641	0.2096	0.7613
8.7359	0.0875	74	1.6609	0.7409	0.2186	0.7430
8.425	0.0898	76	1.6469	0.7442	0.2012	0.7173
8.425	0.0922	78	1.6297	0.7940	0.1975	0.7821
8.2672	0.0946	80	1.6187	0.7907	0.1966	0.7765
8.2672	0.0969	82	1.6047	0.7973	0.2490	0.7852
8.2672	0.0993	84	1.5922	0.8073	0.2836	0.7977
8.1297	0.1017	86	1.5781	0.7973	0.2788	0.7906
8.1297	0.1040	88	1.5688	0.8040	0.2231	0.7941
8.0656	0.1064	90	1.5625	0.7375	0.2657	0.7395
8.0656	0.1087	92	1.5531	0.8106	0.2337	0.8015
8.0656	0.1111	94	1.5453	0.8007	0.2828	0.8152
7.7594	0.1135	96	1.5375	0.7641	0.2276	0.7955
7.7594	0.1158	98	1.5281	0.7774	0.2572	0.7870
7.5953	0.1182	100	1.5219	0.7010	0.2525	0.7104
7.5953	0.1206	102	1.5094	0.7608	0.1958	0.7351
7.5953	0.1229	104	1.5	0.8106	0.1936	0.7975
7.7922	0.1253	106	1.4937	0.8040	0.1628	0.7976
7.7922	0.1277	108	1.4875	0.8106	0.1975	0.7873
7.8281	0.1300	110	1.4828	0.8272	0.2505	0.8224
7.8281	0.1324	112	1.4781	0.8239	0.2717	0.8293
7.8281	0.1348	114	1.4672	0.7641	0.1857	0.7289
7.7406	0.1371	116	1.4594	0.8339	0.2291	0.8258
7.7406	0.1395	118	1.4531	0.7542	0.2263	0.7600
7.2938	0.1418	120	1.4469	0.8272	0.2424	0.8212
7.2938	0.1442	122	1.4438	0.8372	0.2186	0.8223
7.2938	0.1466	124	1.4359	0.8339	0.2438	0.8341
7.4875	0.1489	126	1.4312	0.8306	0.2332	0.8319
7.4875	0.1513	128	1.4234	0.8472	0.2397	0.8513
7.3688	0.1537	130	1.4141	0.8538	0.2424	0.8546
7.3688	0.1560	132	1.4109	0.8472	0.2149	0.8391
7.3688	0.1584	134	1.4047	0.8372	0.2084	0.8375
7.5047	0.1608	136	1.4016	0.8306	0.2519	0.8331
7.5047	0.1631	138	1.3953	0.8671	0.2288	0.8594
7.1375	0.1655	140	1.3906	0.8605	0.2781	0.8615
7.1375	0.1678	142	1.3891	0.8671	0.2296	0.8631
7.1375	0.1702	144	1.3844	0.8671	0.2293	0.8613
6.9484	0.1726	146	1.375	0.8738	0.3250	0.8695
6.9484	0.1749	148	1.3703	0.8671	0.3214	0.8641
7.1234	0.1773	150	1.3687	0.8704	0.3023	0.8700
7.1234	0.1797	152	1.3656	0.8704	0.3005	0.8725
7.1234	0.1820	154	1.3594	0.8738	0.2999	0.8750
7.1234	0.1844	156	1.3531	0.8704	0.2873	0.8702
7.1234	0.1868	158	1.3484	0.8970	0.2935	0.8892
6.8	0.1891	160	1.3469	0.8904	0.2925	0.8833
6.8	0.1915	162	1.3438	0.8870	0.4100	0.8825
6.8	0.1939	164	1.3391	0.8704	0.2701	0.8710
6.8906	0.1962	166	1.3328	0.8738	0.3131	0.8713
6.8906	0.1986	168	1.3297	0.8538	0.3605	0.8586
6.9625	0.2009	170	1.3250	0.8904	0.2983	0.8892
6.9625	0.2033	172	1.3250	0.8671	0.2133	0.8549
6.9625	0.2057	174	1.3172	0.8538	0.2925	0.8508
6.8359	0.2080	176	1.3125	0.8970	0.3453	0.8873
6.8359	0.2104	178	1.3125	0.8904	0.3176	0.8821
6.5922	0.2128	180	1.3062	0.8804	0.3479	0.8817
6.5922	0.2151	182	1.3031	0.8804	0.2882	0.8831
6.5922	0.2175	184	1.3000	0.8738	0.2191	0.8734
6.7844	0.2199	186	1.3000	0.8738	0.2228	0.8723
6.7844	0.2222	188	1.2969	0.8472	0.2090	0.8401
6.7938	0.2246	190	1.2938	0.8738	0.2257	0.8724
6.7938	0.2270	192	1.2922	0.8505	0.2152	0.8563
6.7938	0.2293	194	1.2859	0.8804	0.2238	0.8776
6.7125	0.2317	196	1.2828	0.8738	0.2241	0.8700
6.7125	0.2340	198	1.2797	0.8738	0.3150	0.8746
6.7578	0.2364	200	1.2797	0.8870	0.3709	0.8853
6.7578	0.2388	202	1.2719	0.8837	0.3446	0.8816
6.7578	0.2411	204	1.2687	0.8837	0.2497	0.8878
6.7875	0.2435	206	1.2625	0.9003	0.3303	0.9023
6.7875	0.2459	208	1.2609	0.8937	0.3788	0.8882
6.4328	0.2482	210	1.2578	0.9103	0.4136	0.9040
6.4328	0.2506	212	1.2547	0.8937	0.4000	0.8911
6.4328	0.2530	214	1.25	0.9037	0.4105	0.9021
6.4531	0.2553	216	1.2469	0.8804	0.3242	0.8745
6.4531	0.2577	218	1.2453	0.8837	0.2798	0.8841
6.3828	0.2600	220	1.2437	0.8738	0.2950	0.8713
6.3828	0.2624	222	1.2359	0.8904	0.3129	0.8909
6.3828	0.2648	224	1.2359	0.8870	0.2672	0.8921
6.5	0.2671	226	1.2344	0.8870	0.2859	0.8899
6.5	0.2695	228	1.2313	0.8870	0.2380	0.8847
6.2219	0.2719	230	1.2281	0.8904	0.2961	0.8925
6.2219	0.2742	232	1.2281	0.8937	0.2257	0.8862
6.2219	0.2766	234	1.2281	0.8970	0.3334	0.8839
6.3563	0.2790	236	1.2266	0.8937	0.3459	0.8916
6.3563	0.2813	238	1.2219	0.8970	0.3251	0.8977
6.4453	0.2837	240	1.2188	0.8870	0.3275	0.8940
6.4453	0.2861	242	1.2188	0.8904	0.2558	0.8973
6.4453	0.2884	244	1.2109	0.8937	0.2724	0.9010
6.1828	0.2908	246	1.2094	0.8937	0.3133	0.9014
6.1828	0.2931	248	1.2094	0.8937	0.3128	0.9041
6.4188	0.2955	250	1.2078	0.9037	0.2867	0.9086
6.4188	0.2979	252	1.2031	0.8837	0.2600	0.8860
6.4188	0.3002	254	1.1984	0.8937	0.2603	0.8933
6.3266	0.3026	256	1.1984	0.8904	0.2708	0.8887
6.3266	0.3050	258	1.1969	0.9037	0.2449	0.8987
6.275	0.3073	260	1.1938	0.8837	0.2299	0.8834
6.275	0.3097	262	1.1922	0.8738	0.2991	0.8834
6.275	0.3121	264	1.1891	0.8804	0.3236	0.8874
6.2891	0.3144	266	1.1875	0.8771	0.2452	0.8723
6.2891	0.3168	268	1.1859	0.8904	0.2273	0.8877
6.0969	0.3191	270	1.1844	0.8870	0.2830	0.8900
6.0969	0.3215	272	1.1797	0.8771	0.2449	0.8818
6.0969	0.3239	274	1.1781	0.8870	0.2248	0.8794
6.0906	0.3262	276	1.1766	0.8870	0.2132	0.8850
6.0906	0.3286	278	1.1703	0.8638	0.2625	0.8694
6.1203	0.3310	280	1.1703	0.8638	0.2614	0.8702
6.1203	0.3333	282	1.1688	0.8904	0.2567	0.8921
6.1203	0.3357	284	1.1688	0.8638	0.2486	0.8622
6.1047	0.3381	286	1.1656	0.8771	0.3175	0.8835
6.1047	0.3404	288	1.1625	0.8804	0.2962	0.8951
6.1906	0.3428	290	1.1625	0.8704	0.3986	0.8861
6.1906	0.3452	292	1.1594	0.8837	0.2990	0.8951
6.1906	0.3475	294	1.1562	0.9003	0.3502	0.8986
5.9891	0.3499	296	1.1547	0.8970	0.3298	0.8909
5.9891	0.3522	298	1.1500	0.8970	0.3044	0.8935
5.975	0.3546	300	1.1516	0.9037	0.3772	0.9081
5.975	0.3570	302	1.1469	0.9070	0.2912	0.9102
5.975	0.3593	304	1.1469	0.8870	0.2846	0.8942
6.0734	0.3617	306	1.1484	0.8837	0.3022	0.8911
6.0734	0.3641	308	1.1484	0.8804	0.3344	0.8891
5.7953	0.3664	310	1.1469	0.8771	0.3297	0.8879
5.7953	0.3688	312	1.1422	0.8804	0.3267	0.8871
5.7953	0.3712	314	1.1422	0.8904	0.4049	0.8998
6.1188	0.3735	316	1.1422	0.8771	0.3926	0.8864
6.1188	0.3759	318	1.1375	0.8671	0.3850	0.8773
6.0016	0.3783	320	1.1375	0.8870	0.3934	0.8929
6.0016	0.3806	322	1.1359	0.8937	0.3639	0.8985
6.0016	0.3830	324	1.1375	0.9037	0.3998	0.9049
5.775	0.3853	326	1.1297	0.9003	0.3997	0.9038
5.775	0.3877	328	1.1266	0.9070	0.4006	0.9082
5.7734	0.3901	330	1.1266	0.8870	0.2796	0.8877
5.7734	0.3924	332	1.1234	0.9037	0.3378	0.9072
5.7734	0.3948	334	1.1234	0.8937	0.3805	0.9033
6.0078	0.3972	336	1.1219	0.8904	0.4019	0.8996
6.0078	0.3995	338	1.1172	0.8804	0.4228	0.8861
5.6813	0.4019	340	1.1172	0.8837	0.4206	0.8873
5.6813	0.4043	342	1.1125	0.8904	0.3970	0.8951
5.6813	0.4066	344	1.1109	0.8837	0.3945	0.8896
5.6328	0.4090	346	1.1094	0.8771	0.4331	0.8834
5.6328	0.4113	348	1.1078	0.8837	0.2838	0.8840
5.7453	0.4137	350	1.1063	0.8771	0.2845	0.8761
5.7453	0.4161	352	1.1016	0.8837	0.2476	0.8845
5.7453	0.4184	354	1.0984	0.8937	0.3289	0.8949
5.6344	0.4208	356	1.0984	0.8771	0.3607	0.8861
5.6344	0.4232	358	1.0953	0.8804	0.3398	0.8880
5.8422	0.4255	360	1.0953	0.8937	0.3026	0.8957
5.8422	0.4279	362	1.0922	0.8771	0.3319	0.8797
5.8422	0.4303	364	1.0922	0.8837	0.3657	0.8843
5.5203	0.4326	366	1.0875	0.8937	0.2265	0.8955
5.5203	0.4350	368	1.0844	0.9037	0.2822	0.9022
5.6547	0.4374	370	1.0828	0.9037	0.2675	0.9038
5.6547	0.4397	372	1.0844	0.9103	0.3773	0.9086
5.6547	0.4421	374	1.0828	0.9070	0.3748	0.9058
5.675	0.4444	376	1.0812	0.9136	0.4299	0.9144
5.675	0.4468	378	1.0812	0.9136	0.4301	0.9150
5.6672	0.4492	380	1.0812	0.8804	0.3054	0.8884
5.6672	0.4515	382	1.0797	0.8870	0.2763	0.8906
5.6672	0.4539	384	1.0750	0.9136	0.3679	0.9142
5.5578	0.4563	386	1.0766	0.9037	0.2527	0.9013
5.5578	0.4586	388	1.0750	0.9003	0.2320	0.9012
5.6047	0.4610	390	1.0750	0.8804	0.2453	0.8920
5.6047	0.4634	392	1.0734	0.8771	0.2557	0.8871
5.6047	0.4657	394	1.0719	0.8970	0.2015	0.8974
5.8063	0.4681	396	1.0703	0.8937	0.2776	0.8901
5.8063	0.4704	398	1.0688	0.9070	0.2840	0.9025
5.4641	0.4728	400	1.0672	0.9103	0.2477	0.9103
5.4641	0.4752	402	1.0656	0.9037	0.2182	0.9005
5.4641	0.4775	404	1.0641	0.9136	0.2634	0.9111
5.425	0.4799	406	1.0641	0.9136	0.2633	0.9110
5.425	0.4823	408	1.0625	0.9136	0.3308	0.9154
5.5344	0.4846	410	1.0594	0.9070	0.3051	0.9094
5.5344	0.4870	412	1.0594	0.9037	0.2621	0.9059
5.5344	0.4894	414	1.0578	0.9003	0.2616	0.9026
5.2609	0.4917	416	1.0539	0.9103	0.2833	0.9093
5.2609	0.4941	418	1.0523	0.9103	0.3479	0.9117
5.3187	0.4965	420	1.0508	0.9103	0.4007	0.9081
5.3187	0.4988	422	1.0445	0.8970	0.3219	0.8928
5.3187	0.5012	424	1.0445	0.9003	0.3225	0.8958
5.3672	0.5035	426	1.0445	0.9070	0.3311	0.9033
5.3672	0.5059	428	1.0430	0.9070	0.3238	0.9023
5.175	0.5083	430	1.0367	0.9070	0.3512	0.9051
5.175	0.5106	432	1.0359	0.9103	0.3523	0.9101
5.175	0.5130	434	1.0359	0.9136	0.4268	0.9150
5.4148	0.5154	436	1.0312	0.9003	0.3185	0.9051
5.4148	0.5177	438	1.0312	0.8970	0.3762	0.8988
4.9906	0.5201	440	1.0312	0.8837	0.3637	0.8850
4.9906	0.5225	442	1.0266	0.8870	0.3738	0.8911
4.9906	0.5248	444	1.0234	0.8970	0.3922	0.9027
5.1414	0.5272	446	1.0234	0.9037	0.3802	0.9102
5.1414	0.5296	448	1.0211	0.8970	0.3530	0.9061
5.4484	0.5319	450	1.0195	0.9070	0.3323	0.9149
5.4484	0.5343	452	1.0180	0.9037	0.2930	0.9126
5.4484	0.5366	454	1.0180	0.8937	0.3123	0.8955
5.4562	0.5390	456	1.0133	0.8970	0.3094	0.8972
5.4562	0.5414	458	1.0133	0.8904	0.3044	0.8893
5.2609	0.5437	460	1.0125	0.9070	0.3076	0.9069
5.2609	0.5461	462	1.0094	0.9070	0.3093	0.9164
5.2609	0.5485	464	1.0094	0.9070	0.3491	0.9135
5.0156	0.5508	466	1.0094	0.8937	0.2895	0.9049
5.0156	0.5532	468	1.0078	0.9136	0.4011	0.9232
4.9078	0.5556	470	1.0078	0.9136	0.3875	0.9190
4.9078	0.5579	472	1.0078	0.9103	0.4151	0.9119
4.9078	0.5603	474	1.0078	0.8970	0.3269	0.8979
5.1727	0.5626	476	1.0063	0.9169	0.4186	0.9179
5.1727	0.5650	478	1.0031	0.9269	0.4947	0.9304
5.0844	0.5674	480	1.0016	0.9136	0.4398	0.9177
5.0844	0.5697	482	1.0016	0.9169	0.4423	0.9205
5.0844	0.5721	484	0.9984	0.9203	0.4450	0.9231
5.2719	0.5745	486	0.9969	0.9203	0.4445	0.9230
5.2719	0.5768	488	0.9945	0.9236	0.4470	0.9255
5.2859	0.5792	490	0.9945	0.9269	0.4523	0.9278
5.2859	0.5816	492	0.9945	0.9336	0.4534	0.9342
5.2859	0.5839	494	0.9930	0.9302	0.4502	0.9312
5.2141	0.5863	496	0.9891	0.9302	0.4517	0.9345
5.2141	0.5887	498	0.9891	0.9269	0.4496	0.9318
5.1516	0.5910	500	0.9875	0.9136	0.4135	0.9214
5.1516	0.5934	502	0.9859	0.9269	0.4227	0.9319
5.1516	0.5957	504	0.9828	0.9103	0.3058	0.9110
5.0625	0.5981	506	0.9828	0.9070	0.3035	0.9085
5.0625	0.6005	508	0.9805	0.9103	0.3041	0.9119
5.0422	0.6028	510	0.9805	0.9203	0.5561	0.9274
5.0422	0.6052	512	0.9789	0.9136	0.5148	0.9235
5.0422	0.6076	514	0.9766	0.9136	0.5183	0.9248
5.0187	0.6099	516	0.9766	0.9203	0.5195	0.9313
5.0187	0.6123	518	0.9766	0.9203	0.5362	0.9253
5.1828	0.6147	520	0.9750	0.9236	0.4885	0.9298
5.1828	0.6170	522	0.9742	0.9103	0.4815	0.9168
5.1828	0.6194	524	0.9727	0.9103	0.4849	0.9178
5.25	0.6217	526	0.9695	0.9169	0.3892	0.9224
5.25	0.6241	528	0.9656	0.9136	0.3167	0.9154
5.0687	0.6265	530	0.9648	0.9103	0.3146	0.9130
5.0687	0.6288	532	0.9641	0.9203	0.4960	0.9256
5.0687	0.6312	534	0.9617	0.9302	0.7701	0.9349
4.9695	0.6336	536	0.9617	0.9236	0.6919	0.9312
4.9695	0.6359	538	0.9602	0.9269	0.6897	0.9321
4.9727	0.6383	540	0.9602	0.9336	0.6854	0.9365
4.9727	0.6407	542	0.9586	0.9336	0.6363	0.9377
4.9727	0.6430	544	0.9586	0.9236	0.6186	0.9267
5.0266	0.6454	546	0.9586	0.9269	0.4478	0.9294
5.0266	0.6478	548	0.9578	0.9369	0.5283	0.9385
5.0578	0.6501	550	0.9531	0.9336	0.5277	0.9352
5.0578	0.6525	552	0.9531	0.9302	0.4704	0.9318
5.0578	0.6548	554	0.9508	0.9269	0.4616	0.9235
4.9313	0.6572	556	0.9508	0.9203	0.4519	0.9190
4.9313	0.6596	558	0.9508	0.9269	0.4531	0.9258
4.8375	0.6619	560	0.9492	0.9369	0.5069	0.9387
4.8375	0.6643	562	0.9477	0.9302	0.4587	0.9311
4.8375	0.6667	564	0.9461	0.9336	0.5038	0.9360
5.075	0.6690	566	0.9461	0.9269	0.4986	0.9308
5.075	0.6714	568	0.9445	0.9269	0.5188	0.9314
4.8547	0.6738	570	0.9414	0.9236	0.5183	0.9281
4.8547	0.6761	572	0.9414	0.9136	0.5581	0.9177
4.8547	0.6785	574	0.9359	0.9136	0.4589	0.9202
4.8359	0.6809	576	0.9359	0.9070	0.3908	0.9122
4.8359	0.6832	578	0.9359	0.9203	0.3983	0.9257
4.9711	0.6856	580	0.9336	0.9236	0.4306	0.9283
4.9711	0.6879	582	0.9312	0.9203	0.3661	0.9227
4.9711	0.6903	584	0.9312	0.9302	0.4284	0.9280
4.7508	0.6927	586	0.9320	0.9269	0.3853	0.9248
4.7508	0.6950	588	0.9289	0.9269	0.4600	0.9274
4.8516	0.6974	590	0.9320	0.9103	0.4571	0.9152
4.8516	0.6998	592	0.9289	0.9103	0.4164	0.9124
4.8516	0.7021	594	0.9281	0.9169	0.4542	0.9185
4.893	0.7045	596	0.9266	0.9236	0.5330	0.9236
4.893	0.7069	598	0.9258	0.9269	0.5388	0.9285
4.7383	0.7092	600	0.9227	0.9336	0.5449	0.9339
4.7383	0.7116	602	0.9227	0.9336	0.5127	0.9361
4.7383	0.7139	604	0.9227	0.9269	0.5053	0.9299
4.707	0.7163	606	0.9227	0.9302	0.3925	0.9289
4.707	0.7187	608	0.9227	0.9269	0.3640	0.9285
4.9656	0.7210	610	0.9227	0.9236	0.3580	0.9245
4.9656	0.7234	612	0.9227	0.9269	0.5320	0.9282
4.9656	0.7258	614	0.9195	0.9336	0.4541	0.9365
4.9219	0.7281	616	0.9195	0.9336	0.4575	0.9381
4.9219	0.7305	618	0.9195	0.9236	0.4023	0.9301
4.9469	0.7329	620	0.9195	0.9236	0.3790	0.9311
4.9469	0.7352	622	0.9180	0.9269	0.4234	0.9317
4.9469	0.7376	624	0.9180	0.9203	0.3739	0.9269
4.8289	0.7400	626	0.9180	0.9269	0.3784	0.9321
4.8289	0.7423	628	0.9172	0.9369	0.4359	0.9382
4.6977	0.7447	630	0.9172	0.9336	0.4268	0.9348
4.6977	0.7470	632	0.9172	0.9269	0.3929	0.9282
4.6977	0.7494	634	0.9172	0.9302	0.4499	0.9321
4.9359	0.7518	636	0.9156	0.9402	0.4987	0.9420
4.9359	0.7541	638	0.9156	0.9203	0.3686	0.9205
4.6539	0.7565	640	0.9141	0.9302	0.4878	0.9321
4.6539	0.7589	642	0.9141	0.9269	0.4460	0.9296
4.6539	0.7612	644	0.9141	0.9302	0.4824	0.9306
4.7664	0.7636	646	0.9109	0.9236	0.3513	0.9254
4.7664	0.7660	648	0.9094	0.9203	0.3807	0.9244
4.5711	0.7683	650	0.9094	0.9136	0.3721	0.9181
4.5711	0.7707	652	0.9094	0.9103	0.3523	0.9167
4.5711	0.7730	654	0.9070	0.9269	0.4247	0.9339
4.7859	0.7754	656	0.9070	0.9302	0.4270	0.9365
4.7859	0.7778	658	0.9070	0.9236	0.3596	0.9282
4.482	0.7801	660	0.9070	0.9169	0.3112	0.9218
4.482	0.7825	662	0.9062	0.9203	0.3541	0.9239
4.482	0.7849	664	0.9055	0.9169	0.3302	0.9211
4.6813	0.7872	666	0.9055	0.9236	0.3565	0.9266
4.6813	0.7896	668	0.9055	0.9169	0.3365	0.9209
4.6695	0.7920	670	0.9039	0.9236	0.3551	0.9272
4.6695	0.7943	672	0.9031	0.9169	0.3585	0.9214
4.6695	0.7967	674	0.9031	0.9236	0.3413	0.9284
4.8859	0.7991	676	0.9031	0.9269	0.4194	0.9332
4.8859	0.8014	678	0.9031	0.9203	0.3321	0.9258
4.5211	0.8038	680	0.9023	0.9236	0.3546	0.9275
4.5211	0.8061	682	0.9023	0.9236	0.3580	0.9262
4.5211	0.8085	684	0.9023	0.9203	0.3473	0.9232
4.7953	0.8109	686	0.9016	0.9336	0.3596	0.9362
4.7953	0.8132	688	0.9000	0.9302	0.3509	0.9325
4.4867	0.8156	690	0.9000	0.9302	0.3509	0.9325
4.4867	0.8180	692	0.9000	0.9302	0.3580	0.9337
4.4867	0.8203	694	0.9000	0.9302	0.3580	0.9337
4.6016	0.8227	696	0.9000	0.9302	0.3580	0.9337
4.6016	0.8251	698	0.8984	0.9236	0.3547	0.9278
4.5773	0.8274	700	0.8977	0.9236	0.3513	0.9253
4.5773	0.8298	702	0.8977	0.9236	0.3508	0.9287
4.5773	0.8322	704	0.8977	0.9203	0.3503	0.9254
4.7234	0.8345	706	0.8977	0.9203	0.3503	0.9254
4.7234	0.8369	708	0.8969	0.9302	0.3616	0.9349
4.6023	0.8392	710	0.8969	0.9203	0.3482	0.9261
4.6023	0.8416	712	0.8961	0.9203	0.3319	0.9282
4.6023	0.8440	714	0.8945	0.9236	0.3508	0.9287
4.7656	0.8463	716	0.8945	0.9169	0.3262	0.9245
4.7656	0.8487	718	0.8945	0.9169	0.3263	0.9244
4.7328	0.8511	720	0.8945	0.9203	0.3464	0.9269
4.7328	0.8534	722	0.8945	0.9169	0.3479	0.9228
4.7328	0.8558	724	0.8945	0.9236	0.3733	0.9278
4.5523	0.8582	726	0.8945	0.9269	0.3780	0.9300
4.5523	0.8605	728	0.8945	0.9269	0.3780	0.9300
4.5766	0.8629	730	0.8945	0.9203	0.3481	0.9261
4.5766	0.8652	732	0.8938	0.9269	0.4022	0.9295
4.5766	0.8676	734	0.8938	0.9302	0.3844	0.9338
4.5914	0.8700	736	0.8930	0.9269	0.4048	0.9292
4.5914	0.8723	738	0.8938	0.9302	0.3861	0.9332
4.6781	0.8747	740	0.8938	0.9336	0.4906	0.9374
4.6781	0.8771	742	0.8930	0.9269	0.4568	0.9316
4.6781	0.8794	744	0.8922	0.9302	0.4271	0.9364
4.4383	0.8818	746	0.8922	0.9369	0.4584	0.9416
4.4383	0.8842	748	0.8914	0.9336	0.4560	0.9390
4.5914	0.8865	750	0.8914	0.9269	0.4129	0.9290
4.5914	0.8889	752	0.8906	0.9402	0.4939	0.9433
4.5914	0.8913	754	0.8914	0.9369	0.4222	0.9385
4.4742	0.8936	756	0.8906	0.9336	0.4598	0.9374
4.4742	0.8960	758	0.8914	0.9402	0.5009	0.9419
4.5828	0.8983	760	0.8906	0.9336	0.4160	0.9349
4.5828	0.9007	762	0.8898	0.9336	0.3920	0.9368
4.5828	0.9031	764	0.8906	0.9302	0.4554	0.9356
4.7383	0.9054	766	0.8906	0.9269	0.4247	0.9339
4.7383	0.9078	768	0.8898	0.9336	0.4560	0.9390
4.5062	0.9102	770	0.8898	0.9302	0.4537	0.9366
4.5062	0.9125	772	0.8898	0.9302	0.4554	0.9356
4.5062	0.9149	774	0.8898	0.9369	0.4913	0.9408
4.6281	0.9173	776	0.8898	0.9302	0.3862	0.9332
4.6281	0.9196	778	0.8898	0.9269	0.3971	0.9331
4.8289	0.9220	780	0.8898	0.9302	0.4537	0.9366
4.8289	0.9243	782	0.8898	0.9336	0.3632	0.9361
4.8289	0.9267	784	0.8898	0.9302	0.4271	0.9364
4.4016	0.9291	786	0.8898	0.9336	0.4579	0.9382
4.4016	0.9314	788	0.8883	0.9336	0.4520	0.9378
4.6477	0.9338	790	0.8883	0.9369	0.4168	0.9383
4.6477	0.9362	792	0.8875	0.9435	0.4968	0.9459
4.6477	0.9385	794	0.8875	0.9336	0.4579	0.9382
4.793	0.9409	796	0.8867	0.9302	0.4093	0.9312
4.793	0.9433	798	0.8875	0.9369	0.4933	0.9399
4.6469	0.9456	800	0.8875	0.9336	0.4125	0.9334
4.6469	0.9480	802	0.8867	0.9369	0.4168	0.9383
4.6469	0.9504	804	0.8867	0.9336	0.4099	0.9345
4.8617	0.9527	806	0.8867	0.9369	0.4933	0.9399
4.8617	0.9551	808	0.8867	0.9336	0.4905	0.9373
4.7586	0.9574	810	0.8875	0.9369	0.4967	0.9409
4.7586	0.9598	812	0.8867	0.9269	0.4111	0.9299
4.7586	0.9622	814	0.8867	0.9336	0.4162	0.9350
4.6945	0.9645	816	0.8867	0.9369	0.4224	0.9385
4.6945	0.9669	818	0.8867	0.9336	0.4160	0.9349
4.7969	0.9693	820	0.8867	0.9269	0.3821	0.9313
4.7969	0.9716	822	0.8867	0.9369	0.4189	0.9375
4.7969	0.9740	824	0.8867	0.9369	0.4224	0.9385
4.4711	0.9764	826	0.8867	0.9336	0.4162	0.9350
4.4711	0.9787	828	0.8867	0.9336	0.3888	0.9358
4.575	0.9811	830	0.8867	0.9302	0.4135	0.9324
4.575	0.9835	832	0.8867	0.9336	0.4125	0.9334
4.575	0.9858	834	0.8867	0.9369	0.3947	0.9395
4.5711	0.9882	836	0.8867	0.9302	0.4099	0.9308
4.5711	0.9905	838	0.8867	0.9302	0.4135	0.9324
4.7883	0.9929	840	0.8867	0.9302	0.4135	0.9324
4.7883	0.9953	842	0.8867	0.9302	0.4135	0.9324
4.7883	0.9976	844	0.8867	0.9269	0.4111	0.9299
4.5375	1.0	846	0.8867	0.9336	0.4162	0.9350

Framework versions

PEFT 0.18.1
Transformers 4.51.0
Pytorch 2.8.0+cu128
Datasets 3.6.0
Tokenizers 0.21.0

ferrazzipietro/Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged-60k

Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged-60k

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

ferrazzipietro/
Llama-3.1-8B-Instruct-unsup-crf-lora-lowlr-merged-60k