You can deploy this model and start earning money today!

Daewon0808/
mmlu_noaugs_nolaw_llama_lora

Name: mmlu_noaugs_nolaw_llama_lora
Availability: InStock

peft

safetensors

generated_from_trainer

Daewon0808/prm800k_llama_fulltune

adapter

llama3.1

Views

No views yet

mmlu_noaugs_nolaw_llama_lora

This model is a fine-tuned version of Daewon0808/prm800k_llama_fulltune on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.2831
Prm accuracy: 0.8810
Prm precision: 0.8833
Prm recall: 0.9907
Prm specificty: 0.2632
Prm npv: 0.8333
Prm f1: 0.9339
Prm f1 neg: 0.4
Prm f1 auc: 0.6269
Prm f1 auc (fixed): 0.9058

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 2
eval_batch_size: 4
seed: 908932403
distributed_type: multi-GPU
num_devices: 8
gradient_accumulation_steps: 2
total_train_batch_size: 32
total_eval_batch_size: 32
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
lr_scheduler_warmup_ratio: 0.1
num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Prm accuracy	Prm precision	Prm recall	Prm specificty	Prm npv	Prm f1	Prm f1 neg	Prm f1 auc	Prm f1 auc (fixed)
No log	0	0	0.3535	0.8333	0.8772	0.9346	0.2632	0.4167	0.9050	0.3226	0.5989	0.8195
0.3872	0.0022	5	0.3531	0.8254	0.8696	0.9346	0.2105	0.3636	0.9009	0.2667	0.5726	0.8185
0.2769	0.0044	10	0.3534	0.8254	0.8696	0.9346	0.2105	0.3636	0.9009	0.2667	0.5726	0.8207
0.3544	0.0066	15	0.3525	0.8333	0.8707	0.9439	0.2105	0.4	0.9058	0.2759	0.5772	0.8187
0.381	0.0087	20	0.3483	0.8413	0.8718	0.9533	0.2105	0.4444	0.9107	0.2857	0.5819	0.8202
0.2531	0.0109	25	0.3540	0.8492	0.8667	0.9720	0.1579	0.5	0.9163	0.24	0.5649	0.8291
0.2646	0.0131	30	0.3787	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8377
0.2562	0.0153	35	0.3879	0.8492	0.8548	0.9907	0.0526	0.5	0.9177	0.0952	0.5216	0.8510
0.2311	0.0175	40	0.3503	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8549
0.2788	0.0197	45	0.3290	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8542
0.2171	0.0218	50	0.3193	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8586
0.1915	0.0240	55	0.3152	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8652
0.1897	0.0262	60	0.3169	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8721
0.3134	0.0284	65	0.3152	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8719
0.2339	0.0306	70	0.2948	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8716
0.1868	0.0328	75	0.2956	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8721
0.2245	0.0350	80	0.3166	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8714
0.3115	0.0371	85	0.2997	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8699
0.2238	0.0393	90	0.2926	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8650
0.2554	0.0415	95	0.3005	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8689
0.1996	0.0437	100	0.3089	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8662
0.2284	0.0459	105	0.3042	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8665
0.1916	0.0481	110	0.2951	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8633
0.2724	0.0503	115	0.3324	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8689
0.2533	0.0524	120	0.3265	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8667
0.2143	0.0546	125	0.3012	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8620
0.2554	0.0568	130	0.3044	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8593
0.2744	0.0590	135	0.3218	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8586
0.2983	0.0612	140	0.2953	0.8413	0.8718	0.9533	0.2105	0.4444	0.9107	0.2857	0.5819	0.8483
0.1466	0.0634	145	0.2982	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8551
0.1996	0.0655	150	0.3063	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.5743	0.8603
0.2294	0.0677	155	0.2906	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8623
0.2079	0.0699	160	0.2947	0.8492	0.8667	0.9720	0.1579	0.5	0.9163	0.24	0.5649	0.8642
0.2641	0.0721	165	0.3230	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.5743	0.8665
0.1968	0.0743	170	0.2913	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8635
0.2182	0.0765	175	0.3096	0.8492	0.8667	0.9720	0.1579	0.5	0.9163	0.24	0.5649	0.8679
0.1974	0.0787	180	0.3005	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8637
0.2159	0.0808	185	0.2973	0.8492	0.8667	0.9720	0.1579	0.5	0.9163	0.24	0.5649	0.8697
0.2277	0.0830	190	0.2865	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8687
0.1633	0.0852	195	0.3149	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8677
0.2514	0.0874	200	0.2920	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8623
0.2006	0.0896	205	0.3346	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8677
0.2382	0.0918	210	0.3317	0.8492	0.8667	0.9720	0.1579	0.5	0.9163	0.24	0.5649	0.8758
0.1968	0.0939	215	0.2900	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8832
0.2054	0.0961	220	0.2806	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8864
0.3404	0.0983	225	0.2953	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8938
0.2787	0.1005	230	0.2698	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8871
0.1669	0.1027	235	0.2958	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8874
0.2321	0.1049	240	0.2805	0.8492	0.8729	0.9626	0.2105	0.5	0.9156	0.2963	0.5866	0.8864
0.2187	0.1071	245	0.3036	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8915
0.1922	0.1092	250	0.2664	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8903
0.1572	0.1114	255	0.2787	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8886
0.1734	0.1136	260	0.2636	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8933
0.1604	0.1158	265	0.2568	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8947
0.2186	0.1180	270	0.2899	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8967
0.1972	0.1202	275	0.2612	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.6872	0.8906
0.2935	0.1224	280	0.2641	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8915
0.3031	0.1245	285	0.2861	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8913
0.1315	0.1267	290	0.2797	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8842
0.1751	0.1289	295	0.3036	0.8413	0.8783	0.9439	0.2632	0.4545	0.9099	0.3333	0.6035	0.8785
0.1883	0.1311	300	0.3104	0.8651	0.9018	0.9439	0.4211	0.5714	0.9224	0.4848	0.6825	0.8802
0.1866	0.1333	305	0.2967	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.6608	0.8770
0.2127	0.1355	310	0.2726	0.8810	0.9107	0.9533	0.4737	0.6429	0.9315	0.5455	0.7135	0.8746
0.1504	0.1376	315	0.2821	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8770
0.2448	0.1398	320	0.2807	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8665
0.238	0.1420	325	0.3004	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8682
0.224	0.1442	330	0.2880	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8684
0.2272	0.1464	335	0.2839	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8645
0.1526	0.1486	340	0.3235	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8674
0.2546	0.1508	345	0.2988	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8719
0.2541	0.1529	350	0.3045	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8736
0.2245	0.1551	355	0.3484	0.8651	0.8689	0.9907	0.1579	0.75	0.9258	0.2609	0.5743	0.8765
0.2054	0.1573	360	0.2924	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8753
0.1672	0.1595	365	0.3300	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8746
0.2132	0.1617	370	0.3460	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8765
0.1585	0.1639	375	0.2889	0.8571	0.8870	0.9533	0.3158	0.5455	0.9189	0.4	0.6345	0.8775
0.266	0.1660	380	0.3169	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8780
0.1299	0.1682	385	0.3012	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8802
0.1754	0.1704	390	0.2931	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8812
0.216	0.1726	395	0.2954	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8812
0.1511	0.1748	400	0.2964	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8847
0.1905	0.1770	405	0.2925	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8778
0.1919	0.1792	410	0.2830	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8817
0.2822	0.1813	415	0.2893	0.8571	0.8803	0.9626	0.2632	0.5556	0.9196	0.3571	0.6129	0.8775
0.2332	0.1835	420	0.2840	0.8413	0.9065	0.9065	0.4737	0.4737	0.9065	0.4737	0.6901	0.8783
0.1891	0.1857	425	0.2906	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8674
0.2003	0.1879	430	0.3042	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8645
0.1898	0.1901	435	0.2814	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8869
0.1732	0.1923	440	0.2793	0.8571	0.9083	0.9252	0.4737	0.5294	0.9167	0.5	0.6995	0.8800
0.2386	0.1945	445	0.2888	0.8492	0.8793	0.9533	0.2632	0.5	0.9148	0.3448	0.6082	0.8834
0.1893	0.1966	450	0.2812	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8866
0.1655	0.1988	455	0.2809	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8824
0.1326	0.2010	460	0.2956	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.6608	0.8778
0.2156	0.2032	465	0.3274	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8714
0.167	0.2054	470	0.2916	0.8571	0.9083	0.9252	0.4737	0.5294	0.9167	0.5	0.6995	0.8736
0.2049	0.2076	475	0.2854	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.6608	0.8753
0.1389	0.2097	480	0.3034	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8706
0.2303	0.2119	485	0.2978	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8714
0.2091	0.2141	490	0.2840	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.6608	0.8765
0.1349	0.2163	495	0.3112	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8780
0.1785	0.2185	500	0.3118	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8824
0.1314	0.2207	505	0.3048	0.8571	0.8938	0.9439	0.3684	0.5385	0.9182	0.4375	0.6562	0.8788
0.1625	0.2229	510	0.3041	0.8492	0.8860	0.9439	0.3158	0.5	0.9140	0.3871	0.6299	0.8751
0.2441	0.2250	515	0.3105	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8714
0.1336	0.2272	520	0.2838	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8748
0.2267	0.2294	525	0.2664	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8743
0.197	0.2316	530	0.2968	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8837
0.1643	0.2338	535	0.2990	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8869
0.1593	0.2360	540	0.2757	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8802
0.2482	0.2381	545	0.2697	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8879
0.2144	0.2403	550	0.2936	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8869
0.2172	0.2425	555	0.2808	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8817
0.1719	0.2447	560	0.2670	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8837
0.161	0.2469	565	0.2739	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8879
0.2517	0.2491	570	0.3061	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8839
0.1366	0.2513	575	0.2807	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8906
0.2143	0.2534	580	0.2852	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8896
0.12	0.2556	585	0.2661	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8915
0.1645	0.2578	590	0.2812	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8923
0.1558	0.2600	595	0.2705	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.7012	0.8933
0.1339	0.2622	600	0.2960	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8965
0.1364	0.2644	605	0.2815	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8879
0.1214	0.2666	610	0.2702	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8864
0.1976	0.2687	615	0.2761	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8886
0.2114	0.2709	620	0.2848	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8844
0.1338	0.2731	625	0.3026	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8802
0.1545	0.2753	630	0.2863	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8861
0.1296	0.2775	635	0.3017	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8822
0.1367	0.2797	640	0.3060	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8810
0.1542	0.2818	645	0.3138	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8827
0.1215	0.2840	650	0.3298	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8839
0.2271	0.2862	655	0.3012	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8839
0.2426	0.2884	660	0.2712	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8817
0.1764	0.2906	665	0.2926	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8886
0.1809	0.2928	670	0.2821	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8839
0.1383	0.2950	675	0.2917	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8785
0.1884	0.2971	680	0.3064	0.8571	0.8678	0.9813	0.1579	0.6	0.9211	0.25	0.5696	0.8788
0.1575	0.2993	685	0.2973	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8827
0.1548	0.3015	690	0.2871	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8763
0.1462	0.3037	695	0.2916	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8760
0.1639	0.3059	700	0.2933	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8756
0.1374	0.3081	705	0.3296	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8741
0.2589	0.3102	710	0.3365	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8731
0.1418	0.3124	715	0.2916	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8743
0.1996	0.3146	720	0.2851	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8785
0.2	0.3168	725	0.3114	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8807
0.2158	0.3190	730	0.3056	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8792
0.1842	0.3212	735	0.3179	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8817
0.1711	0.3234	740	0.3071	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8822
0.2203	0.3255	745	0.2863	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8883
0.1409	0.3277	750	0.2723	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8886
0.1287	0.3299	755	0.2985	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8896
0.1276	0.3321	760	0.2716	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8901
0.2573	0.3343	765	0.2714	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8947
0.1714	0.3365	770	0.2791	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8920
0.1324	0.3386	775	0.3101	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8847
0.201	0.3408	780	0.3374	0.8571	0.8739	0.9720	0.2105	0.5714	0.9204	0.3077	0.5912	0.8839
0.1415	0.3430	785	0.3065	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8834
0.1954	0.3452	790	0.2849	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8819
0.1652	0.3474	795	0.3033	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8837
0.1163	0.3496	800	0.3670	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8832
0.1396	0.3518	805	0.2928	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8874
0.2548	0.3539	810	0.3139	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8876
0.1346	0.3561	815	0.3420	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8851
0.1787	0.3583	820	0.3047	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8952
0.2214	0.3605	825	0.2955	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8942
0.1099	0.3627	830	0.3059	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8920
0.1636	0.3649	835	0.2819	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.8940
0.3042	0.3671	840	0.2869	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8972
0.1814	0.3692	845	0.2924	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8935
0.1452	0.3714	850	0.2888	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8955
0.1462	0.3736	855	0.2991	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8972
0.1777	0.3758	860	0.2913	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9016
0.1627	0.3780	865	0.2743	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.9053
0.133	0.3802	870	0.2762	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.9021
0.1538	0.3823	875	0.2870	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9011
0.2077	0.3845	880	0.2921	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9038
0.1381	0.3867	885	0.2670	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.7012	0.9029
0.1576	0.3889	890	0.2792	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9033
0.2018	0.3911	895	0.2854	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9024
0.2389	0.3933	900	0.2834	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8994
0.1339	0.3955	905	0.2675	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8950
0.1038	0.3976	910	0.2686	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8979
0.1152	0.3998	915	0.3097	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.9016
0.1902	0.4020	920	0.2854	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8942
0.1931	0.4042	925	0.2677	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8925
0.1412	0.4064	930	0.2661	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8950
0.1815	0.4086	935	0.2927	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8947
0.2168	0.4107	940	0.3155	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8925
0.1654	0.4129	945	0.3339	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8898
0.1601	0.4151	950	0.3732	0.8730	0.8760	0.9907	0.2105	0.8	0.9298	0.3333	0.6006	0.8906
0.1785	0.4173	955	0.3038	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8933
0.1484	0.4195	960	0.2678	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8970
0.1063	0.4217	965	0.2764	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8970
0.1224	0.4239	970	0.2854	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.9009
0.1581	0.4260	975	0.2697	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8977
0.0842	0.4282	980	0.2777	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8962
0.1826	0.4304	985	0.2849	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8935
0.1908	0.4326	990	0.2818	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8970
0.1777	0.4348	995	0.2611	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.9014
0.1186	0.4370	1000	0.2563	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.9024
0.1908	0.4392	1005	0.2679	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9019
0.1765	0.4413	1010	0.2935	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9102
0.1637	0.4435	1015	0.2630	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9120
0.1444	0.4457	1020	0.2491	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.6872	0.9147
0.1453	0.4479	1025	0.2457	0.8571	0.9009	0.9346	0.4211	0.5333	0.9174	0.4706	0.6778	0.9171
0.1243	0.4501	1030	0.2535	0.8730	0.9027	0.9533	0.4211	0.6154	0.9273	0.5	0.6872	0.9107
0.1439	0.4523	1035	0.2795	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9033
0.0759	0.4544	1040	0.3288	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8950
0.1929	0.4566	1045	0.2811	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8977
0.1239	0.4588	1050	0.2734	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8955
0.1848	0.4610	1055	0.3166	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8955
0.2341	0.4632	1060	0.2986	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8918
0.0938	0.4654	1065	0.2867	0.8571	0.8870	0.9533	0.3158	0.5455	0.9189	0.4	0.6345	0.8879
0.1559	0.4676	1070	0.2947	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8856
0.1355	0.4697	1075	0.2981	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8908
0.1927	0.4719	1080	0.2891	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8893
0.1532	0.4741	1085	0.2755	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8913
0.1666	0.4763	1090	0.2786	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8925
0.1349	0.4785	1095	0.2984	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8938
0.1265	0.4807	1100	0.3026	0.8651	0.875	0.9813	0.2105	0.6667	0.9251	0.32	0.5959	0.8982
0.1831	0.4828	1105	0.2884	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8977
0.2162	0.4850	1110	0.2722	0.8651	0.9018	0.9439	0.4211	0.5714	0.9224	0.4848	0.6825	0.8994
0.1975	0.4872	1115	0.2818	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9004
0.1541	0.4894	1120	0.3004	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8962
0.1076	0.4916	1125	0.3036	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8962
0.1641	0.4938	1130	0.2855	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8940
0.1363	0.4960	1135	0.2825	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.6918	0.8866
0.1618	0.4981	1140	0.2830	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8842
0.1601	0.5003	1145	0.3111	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8807
0.165	0.5025	1150	0.3189	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8805
0.1782	0.5047	1155	0.2883	0.8651	0.8814	0.9720	0.2632	0.625	0.9244	0.3704	0.6176	0.8869
0.1668	0.5069	1160	0.2750	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8910
0.1429	0.5091	1165	0.2822	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8906
0.1712	0.5113	1170	0.2947	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8888
0.1502	0.5134	1175	0.2944	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8869
0.196	0.5156	1180	0.2829	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8910
0.1697	0.5178	1185	0.2849	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8928
0.1002	0.5200	1190	0.2749	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8940
0.2078	0.5222	1195	0.2698	0.8651	0.8947	0.9533	0.3684	0.5833	0.9231	0.4516	0.6608	0.8933
0.1475	0.5244	1200	0.2766	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8913
0.1588	0.5265	1205	0.3082	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8898
0.1593	0.5287	1210	0.3337	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8849
0.1351	0.5309	1215	0.3155	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8869
0.1286	0.5331	1220	0.2787	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.8945
0.2776	0.5353	1225	0.2705	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.8972
0.1045	0.5375	1230	0.2756	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8984
0.1231	0.5397	1235	0.2834	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8977
0.152	0.5418	1240	0.2781	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9024
0.168	0.5440	1245	0.2657	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9026
0.1489	0.5462	1250	0.2670	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.9036
0.1167	0.5484	1255	0.2816	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8979
0.1392	0.5506	1260	0.2843	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8979
0.194	0.5528	1265	0.2865	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8972
0.1551	0.5549	1270	0.2913	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8945
0.2301	0.5571	1275	0.2903	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8908
0.1875	0.5593	1280	0.2805	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8942
0.1812	0.5615	1285	0.2769	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8933
0.166	0.5637	1290	0.2771	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8910
0.1627	0.5659	1295	0.2791	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8903
0.2015	0.5681	1300	0.2847	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8933
0.1154	0.5702	1305	0.2792	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8898
0.1219	0.5724	1310	0.2743	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8886
0.0987	0.5746	1315	0.2835	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8893
0.142	0.5768	1320	0.2959	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8888
0.1378	0.5790	1325	0.3122	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8886
0.1397	0.5812	1330	0.3025	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8893
0.2197	0.5834	1335	0.2877	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8967
0.1416	0.5855	1340	0.2816	0.8651	0.8879	0.9626	0.3158	0.6	0.9238	0.4138	0.6392	0.8984
0.1538	0.5877	1345	0.2846	0.8810	0.9035	0.9626	0.4211	0.6667	0.9321	0.5161	0.6918	0.8982
0.2236	0.5899	1350	0.2832	0.8810	0.9107	0.9533	0.4737	0.6429	0.9315	0.5455	0.7135	0.8974
0.1189	0.5921	1355	0.2880	0.8889	0.9115	0.9626	0.4737	0.6923	0.9364	0.5625	0.7182	0.8977
0.1711	0.5943	1360	0.3039	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8896
0.1528	0.5965	1365	0.2969	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8910
0.1422	0.5986	1370	0.2906	0.8730	0.8957	0.9626	0.3684	0.6364	0.9279	0.4667	0.6655	0.8923
0.1791	0.6008	1375	0.2919	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8945
0.1845	0.6030	1380	0.2988	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8957
0.1502	0.6052	1385	0.3054	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8935
0.1172	0.6074	1390	0.3207	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8925
0.1809	0.6096	1395	0.3290	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8908
0.1017	0.6118	1400	0.3029	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8898
0.139	0.6139	1405	0.2937	0.8730	0.8889	0.9720	0.3158	0.6667	0.9286	0.4286	0.6439	0.8920
0.2229	0.6161	1410	0.3060	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8947
0.1518	0.6183	1415	0.3025	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8965
0.1117	0.6205	1420	0.3012	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8965
0.1915	0.6227	1425	0.2903	0.8810	0.8966	0.9720	0.3684	0.7	0.9327	0.4828	0.6702	0.8982
0.1457	0.6249	1430	0.2802	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.8999
0.1816	0.6270	1435	0.2717	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.9043
0.1208	0.6292	1440	0.2770	0.8889	0.9043	0.9720	0.4211	0.7273	0.9369	0.5333	0.6965	0.9001
0.0654	0.6314	1445	0.2918	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9011
0.1588	0.6336	1450	0.3115	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8960
0.1021	0.6358	1455	0.3056	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8950
0.1821	0.6380	1460	0.3012	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8923
0.1025	0.6402	1465	0.2960	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8910
0.1649	0.6423	1470	0.3083	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8920
0.1913	0.6445	1475	0.3262	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8908
0.1249	0.6467	1480	0.3245	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8881
0.0793	0.6489	1485	0.3226	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8856
0.1944	0.6511	1490	0.3179	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8859
0.0809	0.6533	1495	0.3104	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8883
0.1891	0.6555	1500	0.3058	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8847
0.123	0.6576	1505	0.3046	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8886
0.1241	0.6598	1510	0.3091	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8906
0.106	0.6620	1515	0.3151	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8903
0.1673	0.6642	1520	0.3132	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8903
0.2379	0.6664	1525	0.3059	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8935
0.0766	0.6686	1530	0.2952	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8928
0.1749	0.6707	1535	0.2914	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8915
0.1481	0.6729	1540	0.2889	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8930
0.1263	0.6751	1545	0.2912	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8908
0.1459	0.6773	1550	0.2962	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8898
0.1319	0.6795	1555	0.3033	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8910
0.1621	0.6817	1560	0.3110	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8942
0.159	0.6839	1565	0.3008	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8970
0.1314	0.6860	1570	0.2990	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8967
0.1207	0.6882	1575	0.2998	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8977
0.1387	0.6904	1580	0.3077	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8984
0.1258	0.6926	1585	0.3100	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8974
0.1293	0.6948	1590	0.3120	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.8965
0.1778	0.6970	1595	0.3017	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8992
0.1393	0.6991	1600	0.3015	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8977
0.1794	0.7013	1605	0.3079	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8977
0.1286	0.7035	1610	0.3014	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.8967
0.0815	0.7057	1615	0.2914	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.8989
0.1527	0.7079	1620	0.2851	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9001
0.2113	0.7101	1625	0.2854	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9024
0.1445	0.7123	1630	0.2813	0.8968	0.8983	0.9907	0.3684	0.875	0.9422	0.5185	0.6795	0.9014
0.1567	0.7144	1635	0.2742	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.7012	0.9021
0.1585	0.7166	1640	0.2710	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.7012	0.9031
0.1041	0.7188	1645	0.2725	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9031
0.1418	0.7210	1650	0.2851	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9043
0.1052	0.7232	1655	0.3059	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9048
0.1478	0.7254	1660	0.3046	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9029
0.1318	0.7276	1665	0.2926	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9029
0.1286	0.7297	1670	0.2819	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9031
0.1728	0.7319	1675	0.2754	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9038
0.179	0.7341	1680	0.2767	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9038
0.1834	0.7363	1685	0.2784	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9056
0.0917	0.7385	1690	0.2819	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9058
0.1648	0.7407	1695	0.2819	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9056
0.1643	0.7428	1700	0.2837	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9056
0.1601	0.7450	1705	0.2832	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9019
0.166	0.7472	1710	0.2819	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9024
0.2181	0.7494	1715	0.2809	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9009
0.1215	0.7516	1720	0.2802	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8994
0.1667	0.7538	1725	0.2841	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9011
0.1685	0.7560	1730	0.2832	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9006
0.0874	0.7581	1735	0.2828	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9026
0.1203	0.7603	1740	0.2835	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8999
0.1416	0.7625	1745	0.2823	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9024
0.1447	0.7647	1750	0.2834	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9001
0.1604	0.7669	1755	0.2837	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9001
0.1061	0.7691	1760	0.2867	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9001
0.1142	0.7712	1765	0.2915	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9026
0.1451	0.7734	1770	0.3013	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9001
0.1225	0.7756	1775	0.2999	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9036
0.1397	0.7778	1780	0.2980	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9031
0.145	0.7800	1785	0.3029	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9009
0.1435	0.7822	1790	0.3029	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9024
0.2593	0.7844	1795	0.3026	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9006
0.0906	0.7865	1800	0.2977	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9021
0.1646	0.7887	1805	0.2964	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9016
0.1765	0.7909	1810	0.2946	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.8997
0.1068	0.7931	1815	0.2899	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.8984
0.1554	0.7953	1820	0.2895	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.8987
0.1104	0.7975	1825	0.2872	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9009
0.1339	0.7997	1830	0.2858	0.8968	0.9052	0.9813	0.4211	0.8	0.9417	0.5517	0.7012	0.9019
0.1122	0.8018	1835	0.2891	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9019
0.1462	0.8040	1840	0.2974	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9021
0.2075	0.8062	1845	0.3031	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9026
0.128	0.8084	1850	0.2984	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9031
0.1227	0.8106	1855	0.2936	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9029
0.0978	0.8128	1860	0.2907	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9029
0.1302	0.8149	1865	0.2855	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9024
0.1607	0.8171	1870	0.2819	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9024
0.0752	0.8193	1875	0.2778	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9026
0.1379	0.8215	1880	0.2780	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9019
0.1686	0.8237	1885	0.2754	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9056
0.1658	0.8259	1890	0.2769	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9033
0.1014	0.8281	1895	0.2774	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9061
0.1518	0.8302	1900	0.2805	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9068
0.1789	0.8324	1905	0.2835	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9056
0.1566	0.8346	1910	0.2825	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9065
0.1824	0.8368	1915	0.2814	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9070
0.1443	0.8390	1920	0.2793	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9088
0.1132	0.8412	1925	0.2784	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9085
0.1513	0.8433	1930	0.2757	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9065
0.1301	0.8455	1935	0.2729	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9107
0.1649	0.8477	1940	0.2706	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9100
0.2383	0.8499	1945	0.2698	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9117
0.2744	0.8521	1950	0.2715	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9097
0.1386	0.8543	1955	0.2704	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9090
0.1693	0.8565	1960	0.2706	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9085
0.1407	0.8586	1965	0.2765	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9065
0.1374	0.8608	1970	0.2794	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9080
0.1339	0.8630	1975	0.2823	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9078
0.178	0.8652	1980	0.2826	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9083
0.1305	0.8674	1985	0.2837	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9073
0.1334	0.8696	1990	0.2842	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.0857	0.8718	1995	0.2853	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9058
0.1402	0.8739	2000	0.2857	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9078
0.0759	0.8761	2005	0.2860	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9061
0.1237	0.8783	2010	0.2851	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9046
0.1309	0.8805	2015	0.2832	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9051
0.131	0.8827	2020	0.2836	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9043
0.1355	0.8849	2025	0.2794	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9061
0.1113	0.8870	2030	0.2812	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9051
0.135	0.8892	2035	0.2813	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9063
0.105	0.8914	2040	0.2809	0.8889	0.8974	0.9813	0.3684	0.7778	0.9375	0.5	0.6749	0.9041
0.1754	0.8936	2045	0.2831	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9043
0.1256	0.8958	2050	0.2830	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9053
0.1576	0.8980	2055	0.2832	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9056
0.1402	0.9002	2060	0.2843	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9041
0.1555	0.9023	2065	0.2829	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9043
0.19	0.9045	2070	0.2847	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9058
0.1248	0.9067	2075	0.2831	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9053
0.0536	0.9089	2080	0.2838	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9053
0.1319	0.9111	2085	0.2841	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9070
0.0842	0.9133	2090	0.2843	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.126	0.9154	2095	0.2828	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9075
0.1141	0.9176	2100	0.2857	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9070
0.1078	0.9198	2105	0.2859	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9070
0.1355	0.9220	2110	0.2838	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9070
0.1665	0.9242	2115	0.2860	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.1817	0.9264	2120	0.2842	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9078
0.112	0.9286	2125	0.2839	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9070
0.1526	0.9307	2130	0.2841	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9053
0.1089	0.9329	2135	0.2814	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9080
0.1728	0.9351	2140	0.2828	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9056
0.0819	0.9373	2145	0.2823	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9068
0.1429	0.9395	2150	0.2819	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.1929	0.9417	2155	0.2819	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9061
0.2515	0.9438	2160	0.2831	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9056
0.1113	0.9460	2165	0.2820	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9068
0.1218	0.9482	2170	0.2818	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9078
0.101	0.9504	2175	0.2816	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9058
0.1201	0.9526	2180	0.2809	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9078
0.2324	0.9548	2185	0.2828	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9053
0.1318	0.9570	2190	0.2810	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9058
0.0959	0.9591	2195	0.2816	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.1284	0.9613	2200	0.2831	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.121	0.9635	2205	0.2834	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9061
0.1447	0.9657	2210	0.2832	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9063
0.1105	0.9679	2215	0.2840	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9063
0.125	0.9701	2220	0.2832	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9056
0.1484	0.9723	2225	0.2832	0.8810	0.8898	0.9813	0.3158	0.75	0.9333	0.4444	0.6485	0.9078
0.1429	0.9744	2230	0.2844	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9073
0.1367	0.9766	2235	0.2824	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9068
0.2226	0.9788	2240	0.2833	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9061
0.1812	0.9810	2245	0.2826	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9058
0.1267	0.9832	2250	0.2825	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9053
0.1957	0.9854	2255	0.2841	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9041
0.1284	0.9875	2260	0.2833	0.8730	0.8824	0.9813	0.2632	0.7143	0.9292	0.3846	0.6222	0.9068
0.1297	0.9897	2265	0.2848	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9046
0.1893	0.9919	2270	0.2825	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9063
0.1843	0.9941	2275	0.2815	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9061
0.0828	0.9963	2280	0.2835	0.8889	0.8908	0.9907	0.3158	0.8571	0.9381	0.4615	0.6532	0.9083
0.1219	0.9985	2285	0.2831	0.8810	0.8833	0.9907	0.2632	0.8333	0.9339	0.4	0.6269	0.9058

Framework versions

PEFT 0.12.0
Transformers 4.46.0
Pytorch 2.4.0+cu118
Datasets 3.0.0
Tokenizers 0.20.1

Daewon0808/mmlu_noaugs_nolaw_llama_lora

mmlu_noaugs_nolaw_llama_lora

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

Daewon0808/
mmlu_noaugs_nolaw_llama_lora