Loss: 0.4274
Precision: 0.5249
Recall: 0.6863
F1: 0.5948
Accuracy: 0.9455
Classification Report Details: {'B-ART': {'precision': 0.48044692737430167, 'recall': 0.6825396825396826, 'f1-score': 0.5639344262295082, 'support': 252.0}, 'B-CON': {'precision': 0.4517543859649123, 'recall': 0.639751552795031, 'f1-score': 0.5295629820051414, 'support': 161.0}, 'B-LOC': {'precision': 0.7735849056603774, 'recall': 0.825503355704698, 'f1-score': 0.7987012987012987, 'support': 149.0}, 'B-MAT': {'precision': 0.5, 'recall': 0.3, 'f1-score': 0.375, 'support': 40.0}, 'B-PER': {'precision': 0.7729591836734694, 'recall': 0.9017857142857143, 'f1-score': 0.8324175824175825, 'support': 336.0}, 'B-SPE': {'precision': 0.509090909090909, 'recall': 0.9032258064516129, 'f1-score': 0.6511627906976745, 'support': 31.0}, 'I-ART': {'precision': 0.5597269624573379, 'recall': 0.46458923512747874, 'f1-score': 0.5077399380804953, 'support': 353.0}, 'I-CON': {'precision': 0.46846846846846846, 'recall': 0.4406779661016949, 'f1-score': 0.45414847161572053, 'support': 118.0}, 'I-LOC': {'precision': 0.88, 'recall': 0.7795275590551181, 'f1-score': 0.826722338204593, 'support': 254.0}, 'I-MAT': {'precision': 0.3, 'recall': 0.08108108108108109, 'f1-score': 0.1276595744680851, 'support': 37.0}, 'I-PER': {'precision': 0.8205741626794258, 'recall': 0.767337807606264, 'f1-score': 0.793063583815029, 'support': 447.0}, 'I-SPE': {'precision': 0.875, 'recall': 0.6666666666666666, 'f1-score': 0.7567567567567568, 'support': 42.0}, 'O': {'precision': 0.9770081490104773, 'recall': 0.9729964736003092, 'f1-score': 0.974998184766561, 'support': 20701.0}, 'accuracy': 0.945464857554208, 'macro avg': {'precision': 0.6437395426445907, 'recall': 0.6481294539242578, 'f1-score': 0.6301436867506497, 'support': 22921.0}, 'weighted avg': {'precision': 0.9476305823082976, 'recall': 0.945464857554208, 'f1-score': 0.9457924692542702, 'support': 22921.0}}
Classfication Report Seqeval: {'ART': {'precision': 0.4, 'recall': 0.6031746031746031, 'f1-score': 0.4810126582278481, 'support': 252}, 'CON': {'precision': 0.4025423728813559, 'recall': 0.5900621118012422, 'f1-score': 0.47858942065491183, 'support': 161}, 'LOC': {'precision': 0.6646341463414634, 'recall': 0.7315436241610739, 'f1-score': 0.6964856230031949, 'support': 149}, 'MAT': {'precision': 0.3333333333333333, 'recall': 0.225, 'f1-score': 0.26865671641791045, 'support': 40}, 'PER': {'precision': 0.6856435643564357, 'recall': 0.8244047619047619, 'f1-score': 0.7486486486486487, 'support': 336}, 'SPE': {'precision': 0.4107142857142857, 'recall': 0.7419354838709677, 'f1-score': 0.528735632183908, 'support': 31}, 'micro avg': {'precision': 0.5248618784530387, 'recall': 0.6862745098039216, 'f1-score': 0.5948121645796065, 'support': 969}, 'macro avg': {'precision': 0.4828112837711456, 'recall': 0.6193534308187748, 'f1-score': 0.5336881165227371, 'support': 969}, 'weighted avg': {'precision': 0.5377518303952683, 'recall': 0.6862745098039216, 'f1-score': 0.5993059480151685, 'support': 969}}

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 17

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy	Classification Report Details	Classfication Report Seqeval
No log	1.0	249	0.2141	0.4935	0.6254	0.5517	0.9457	{'B-ART': {'precision': 0.4543147208121827, 'recall': 0.7103174603174603, 'f1-score': 0.5541795665634675, 'support': 252.0}, 'B-CON': {'precision': 0.4340425531914894, 'recall': 0.6335403726708074, 'f1-score': 0.5151515151515151, 'support': 161.0}, 'B-LOC': {'precision': 0.8347107438016529, 'recall': 0.6778523489932886, 'f1-score': 0.7481481481481481, 'support': 149.0}, 'B-MAT': {'precision': 0.3333333333333333, 'recall': 0.05, 'f1-score': 0.08695652173913043, 'support': 40.0}, 'B-PER': {'precision': 0.8179271708683473, 'recall': 0.8690476190476191, 'f1-score': 0.8427128427128427, 'support': 336.0}, 'B-SPE': {'precision': 0.45454545454545453, 'recall': 0.6451612903225806, 'f1-score': 0.5333333333333333, 'support': 31.0}, 'I-ART': {'precision': 0.6183574879227053, 'recall': 0.3626062322946176, 'f1-score': 0.45714285714285713, 'support': 353.0}, 'I-CON': {'precision': 0.5617977528089888, 'recall': 0.423728813559322, 'f1-score': 0.4830917874396135, 'support': 118.0}, 'I-LOC': {'precision': 0.8571428571428571, 'recall': 0.7559055118110236, 'f1-score': 0.803347280334728, 'support': 254.0}, 'I-MAT': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 37.0}, 'I-PER': {'precision': 0.937125748502994, 'recall': 0.7002237136465325, 'f1-score': 0.8015364916773368, 'support': 447.0}, 'I-SPE': {'precision': 0.88, 'recall': 0.5238095238095238, 'f1-score': 0.6567164179104478, 'support': 42.0}, 'O': {'precision': 0.9708403160162796, 'recall': 0.9794695908410221, 'f1-score': 0.9751358630308277, 'support': 20701.0}, 'accuracy': 0.9457266262379478, 'macro avg': {'precision': 0.6272413953035604, 'recall': 0.563974036716446, 'f1-score': 0.5736502019372499, 'support': 22921.0}, 'weighted avg': {'precision': 0.9452683145843226, 'recall': 0.9457266262379478, 'f1-score': 0.9437551895104652, 'support': 22921.0}}	{'ART': {'precision': 0.3397590361445783, 'recall': 0.5595238095238095, 'f1-score': 0.4227886056971514, 'support': 252}, 'CON': {'precision': 0.3673469387755102, 'recall': 0.5590062111801242, 'f1-score': 0.4433497536945813, 'support': 161}, 'LOC': {'precision': 0.6643356643356644, 'recall': 0.6375838926174496, 'f1-score': 0.6506849315068493, 'support': 149}, 'MAT': {'precision': 0.3333333333333333, 'recall': 0.05, 'f1-score': 0.08695652173913045, 'support': 40}, 'PER': {'precision': 0.7008086253369272, 'recall': 0.7738095238095238, 'f1-score': 0.7355021216407355, 'support': 336}, 'SPE': {'precision': 0.375, 'recall': 0.5806451612903226, 'f1-score': 0.4556962025316456, 'support': 31}, 'micro avg': {'precision': 0.49348534201954397, 'recall': 0.6253869969040248, 'f1-score': 0.5516613563950841, 'support': 969}, 'macro avg': {'precision': 0.4634305996543356, 'recall': 0.526761433070205, 'f1-score': 0.4658296894683489, 'support': 969}, 'weighted avg': {'precision': 0.520307718971977, 'recall': 0.6253869969040248, 'f1-score': 0.5568706396226663, 'support': 969}}
No log	2.0	498	0.2065	0.5374	0.6749	0.5984	0.9475	{'B-ART': {'precision': 0.5428571428571428, 'recall': 0.6785714285714286, 'f1-score': 0.6031746031746031, 'support': 252.0}, 'B-CON': {'precision': 0.4497816593886463, 'recall': 0.639751552795031, 'f1-score': 0.5282051282051282, 'support': 161.0}, 'B-LOC': {'precision': 0.8518518518518519, 'recall': 0.7718120805369127, 'f1-score': 0.8098591549295775, 'support': 149.0}, 'B-MAT': {'precision': 0.375, 'recall': 0.15, 'f1-score': 0.21428571428571427, 'support': 40.0}, 'B-PER': {'precision': 0.7994652406417112, 'recall': 0.8898809523809523, 'f1-score': 0.8422535211267606, 'support': 336.0}, 'B-SPE': {'precision': 0.4482758620689655, 'recall': 0.8387096774193549, 'f1-score': 0.5842696629213483, 'support': 31.0}, 'I-ART': {'precision': 0.625, 'recall': 0.42492917847025496, 'f1-score': 0.5059021922428331, 'support': 353.0}, 'I-CON': {'precision': 0.4264705882352941, 'recall': 0.4915254237288136, 'f1-score': 0.4566929133858268, 'support': 118.0}, 'I-LOC': {'precision': 0.8514056224899599, 'recall': 0.8346456692913385, 'f1-score': 0.8429423459244533, 'support': 254.0}, 'I-MAT': {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 37.0}, 'I-PER': {'precision': 0.9205882352941176, 'recall': 0.7002237136465325, 'f1-score': 0.795425667090216, 'support': 447.0}, 'I-SPE': {'precision': 0.875, 'recall': 0.6666666666666666, 'f1-score': 0.7567567567567568, 'support': 42.0}, 'O': {'precision': 0.9730730393806799, 'recall': 0.9775856238829042, 'f1-score': 0.9753241120053978, 'support': 20701.0}, 'accuracy': 0.9475153789101697, 'macro avg': {'precision': 0.6260591724775669, 'recall': 0.6203309205684763, 'f1-score': 0.6088532132345089, 'support': 22921.0}, 'weighted avg': {'precision': 0.9472841993188514, 'recall': 0.9475153789101697, 'f1-score': 0.9463590202892118, 'support': 22921.0}}	{'ART': {'precision': 0.4207492795389049, 'recall': 0.5793650793650794, 'f1-score': 0.4874791318864775, 'support': 252}, 'CON': {'precision': 0.3803921568627451, 'recall': 0.6024844720496895, 'f1-score': 0.46634615384615385, 'support': 161}, 'LOC': {'precision': 0.7254901960784313, 'recall': 0.7449664429530202, 'f1-score': 0.7350993377483444, 'support': 149}, 'MAT': {'precision': 0.375, 'recall': 0.15, 'f1-score': 0.21428571428571425, 'support': 40}, 'PER': {'precision': 0.7028423772609819, 'recall': 0.8095238095238095, 'f1-score': 0.752420470262794, 'support': 336}, 'SPE': {'precision': 0.3728813559322034, 'recall': 0.7096774193548387, 'f1-score': 0.4888888888888889, 'support': 31}, 'micro avg': {'precision': 0.5373870172555464, 'recall': 0.6749226006191951, 'f1-score': 0.5983531564501372, 'support': 969}, 'macro avg': {'precision': 0.49622589427887775, 'recall': 0.5993362038744062, 'f1-score': 0.5240866161530622, 'support': 969}, 'weighted avg': {'precision': 0.5552986127017342, 'recall': 0.6749226006191951, 'f1-score': 0.6026796031624452, 'support': 969}}
0.1911	3.0	747	0.2314	0.5238	0.6594	0.5838	0.9467	{'B-ART': {'precision': 0.5071633237822349, 'recall': 0.7023809523809523, 'f1-score': 0.589018302828619, 'support': 252.0}, 'B-CON': {'precision': 0.5260416666666666, 'recall': 0.6273291925465838, 'f1-score': 0.5722379603399433, 'support': 161.0}, 'B-LOC': {'precision': 0.7857142857142857, 'recall': 0.8120805369127517, 'f1-score': 0.7986798679867987, 'support': 149.0}, 'B-MAT': {'precision': 0.43243243243243246, 'recall': 0.4, 'f1-score': 0.4155844155844156, 'support': 40.0}, 'B-PER': {'precision': 0.8263665594855305, 'recall': 0.7648809523809523, 'f1-score': 0.794435857805255, 'support': 336.0}, 'B-SPE': {'precision': 0.49122807017543857, 'recall': 0.9032258064516129, 'f1-score': 0.6363636363636364, 'support': 31.0}, 'I-ART': {'precision': 0.5245398773006135, 'recall': 0.48441926345609065, 'f1-score': 0.5036818851251841, 'support': 353.0}, 'I-CON': {'precision': 0.4765625, 'recall': 0.5169491525423728, 'f1-score': 0.4959349593495935, 'support': 118.0}, 'I-LOC': {'precision': 0.8706896551724138, 'recall': 0.7952755905511811, 'f1-score': 0.831275720164609, 'support': 254.0}, 'I-MAT': {'precision': 0.3333333333333333, 'recall': 0.13513513513513514, 'f1-score': 0.19230769230769232, 'support': 37.0}, 'I-PER': {'precision': 0.9028571428571428, 'recall': 0.7069351230425056, 'f1-score': 0.7929736511919699, 'support': 447.0}, 'I-SPE': {'precision': 0.8571428571428571, 'recall': 0.7142857142857143, 'f1-score': 0.7792207792207793, 'support': 42.0}, 'O': {'precision': 0.9749216300940439, 'recall': 0.9765228732911454, 'f1-score': 0.9757215947485278, 'support': 20701.0}, 'accuracy': 0.9467300728589503, 'macro avg': {'precision': 0.6545379487813072, 'recall': 0.6568784840751538, 'f1-score': 0.6444181786936171, 'support': 22921.0}, 'weighted avg': {'precision': 0.948303699263817, 'recall': 0.9467300728589503, 'f1-score': 0.9468620914323016, 'support': 22921.0}}	{'ART': {'precision': 0.3979848866498741, 'recall': 0.626984126984127, 'f1-score': 0.48690292758089365, 'support': 252}, 'CON': {'precision': 0.45539906103286387, 'recall': 0.6024844720496895, 'f1-score': 0.518716577540107, 'support': 161}, 'LOC': {'precision': 0.6428571428571429, 'recall': 0.7248322147651006, 'f1-score': 0.6813880126182965, 'support': 149}, 'MAT': {'precision': 0.34146341463414637, 'recall': 0.35, 'f1-score': 0.34567901234567905, 'support': 40}, 'PER': {'precision': 0.6938775510204082, 'recall': 0.7083333333333334, 'f1-score': 0.7010309278350516, 'support': 336}, 'SPE': {'precision': 0.41379310344827586, 'recall': 0.7741935483870968, 'f1-score': 0.5393258426966293, 'support': 31}, 'micro avg': {'precision': 0.5237704918032787, 'recall': 0.6594427244582043, 'f1-score': 0.5838282320694381, 'support': 969}, 'macro avg': {'precision': 0.4908958599404519, 'recall': 0.6311379492532246, 'f1-score': 0.5455072167694429, 'support': 969}, 'weighted avg': {'precision': 0.5459506031815203, 'recall': 0.6594427244582043, 'f1-score': 0.5921902724297922, 'support': 969}}
0.1911	4.0	996	0.2622	0.5042	0.6749	0.5772	0.9443	{'B-ART': {'precision': 0.47164948453608246, 'recall': 0.7261904761904762, 'f1-score': 0.571875, 'support': 252.0}, 'B-CON': {'precision': 0.4611872146118721, 'recall': 0.6273291925465838, 'f1-score': 0.531578947368421, 'support': 161.0}, 'B-LOC': {'precision': 0.7544910179640718, 'recall': 0.8456375838926175, 'f1-score': 0.7974683544303798, 'support': 149.0}, 'B-MAT': {'precision': 0.55, 'recall': 0.275, 'f1-score': 0.36666666666666664, 'support': 40.0}, 'B-PER': {'precision': 0.7506426735218509, 'recall': 0.8690476190476191, 'f1-score': 0.8055172413793104, 'support': 336.0}, 'B-SPE': {'precision': 0.47058823529411764, 'recall': 0.7741935483870968, 'f1-score': 0.5853658536585366, 'support': 31.0}, 'I-ART': {'precision': 0.5845588235294118, 'recall': 0.45042492917847027, 'f1-score': 0.5088, 'support': 353.0}, 'I-CON': {'precision': 0.4369747899159664, 'recall': 0.4406779661016949, 'f1-score': 0.4388185654008439, 'support': 118.0}, 'I-LOC': {'precision': 0.8541666666666666, 'recall': 0.8070866141732284, 'f1-score': 0.8299595141700404, 'support': 254.0}, 'I-MAT': {'precision': 0.5, 'recall': 0.13513513513513514, 'f1-score': 0.2127659574468085, 'support': 37.0}, 'I-PER': {'precision': 0.815, 'recall': 0.7293064876957495, 'f1-score': 0.7697756788665879, 'support': 447.0}, 'I-SPE': {'precision': 0.8666666666666667, 'recall': 0.6190476190476191, 'f1-score': 0.7222222222222222, 'support': 42.0}, 'O': {'precision': 0.9766201008925107, 'recall': 0.9726100188396696, 'f1-score': 0.9746109349662366, 'support': 20701.0}, 'accuracy': 0.9442868984773788, 'macro avg': {'precision': 0.6532727441230168, 'recall': 0.6362836300181508, 'f1-score': 0.6242634566596965, 'support': 22921.0}, 'weighted avg': {'precision': 0.9469664708675397, 'recall': 0.9442868984773788, 'f1-score': 0.9446315331283434, 'support': 22921.0}}	{'ART': {'precision': 0.38235294117647056, 'recall': 0.6190476190476191, 'f1-score': 0.4727272727272727, 'support': 252}, 'CON': {'precision': 0.4043478260869565, 'recall': 0.577639751552795, 'f1-score': 0.4757033248081841, 'support': 161}, 'LOC': {'precision': 0.6473988439306358, 'recall': 0.7516778523489933, 'f1-score': 0.6956521739130436, 'support': 149}, 'MAT': {'precision': 0.34615384615384615, 'recall': 0.225, 'f1-score': 0.27272727272727276, 'support': 40}, 'PER': {'precision': 0.6502463054187192, 'recall': 0.7857142857142857, 'f1-score': 0.7115902964959568, 'support': 336}, 'SPE': {'precision': 0.37037037037037035, 'recall': 0.6451612903225806, 'f1-score': 0.4705882352941176, 'support': 31}, 'micro avg': {'precision': 0.5042405551272167, 'recall': 0.6749226006191951, 'f1-score': 0.5772285966460724, 'support': 969}, 'macro avg': {'precision': 0.4668116888561664, 'recall': 0.6007067998310456, 'f1-score': 0.516498095994308, 'support': 969}, 'weighted avg': {'precision': 0.5177768450675545, 'recall': 0.6749226006191951, 'f1-score': 0.582001390877486, 'support': 969}}
0.0418	5.0	1245	0.3029	0.5561	0.6347	0.5928	0.9485	{'B-ART': {'precision': 0.5331125827814569, 'recall': 0.6388888888888888, 'f1-score': 0.5812274368231047, 'support': 252.0}, 'B-CON': {'precision': 0.47029702970297027, 'recall': 0.5900621118012422, 'f1-score': 0.5234159779614325, 'support': 161.0}, 'B-LOC': {'precision': 0.8108108108108109, 'recall': 0.8053691275167785, 'f1-score': 0.8080808080808081, 'support': 149.0}, 'B-MAT': {'precision': 0.47368421052631576, 'recall': 0.225, 'f1-score': 0.3050847457627119, 'support': 40.0}, 'B-PER': {'precision': 0.8373493975903614, 'recall': 0.8273809523809523, 'f1-score': 0.8323353293413174, 'support': 336.0}, 'B-SPE': {'precision': 0.4807692307692308, 'recall': 0.8064516129032258, 'f1-score': 0.6024096385542169, 'support': 31.0}, 'I-ART': {'precision': 0.6084905660377359, 'recall': 0.3654390934844193, 'f1-score': 0.45663716814159294, 'support': 353.0}, 'I-CON': {'precision': 0.5217391304347826, 'recall': 0.4067796610169492, 'f1-score': 0.45714285714285713, 'support': 118.0}, 'I-LOC': {'precision': 0.8577405857740585, 'recall': 0.8070866141732284, 'f1-score': 0.8316430020283976, 'support': 254.0}, 'I-MAT': {'precision': 0.125, 'recall': 0.02702702702702703, 'f1-score': 0.044444444444444446, 'support': 37.0}, 'I-PER': {'precision': 0.900523560209424, 'recall': 0.7695749440715883, 'f1-score': 0.8299155609167672, 'support': 447.0}, 'I-SPE': {'precision': 0.9259259259259259, 'recall': 0.5952380952380952, 'f1-score': 0.7246376811594203, 'support': 42.0}, 'O': {'precision': 0.9710131062852769, 'recall': 0.9806289551229409, 'f1-score': 0.9757973417934482, 'support': 20701.0}, 'accuracy': 0.9484751974172156, 'macro avg': {'precision': 0.6551120105267961, 'recall': 0.6034559295096412, 'f1-score': 0.6132901532423476, 'support': 22921.0}, 'weighted avg': {'precision': 0.9461756618438303, 'recall': 0.9484751974172156, 'f1-score': 0.9463414092526846, 'support': 22921.0}}	{'ART': {'precision': 0.422360248447205, 'recall': 0.5396825396825397, 'f1-score': 0.4738675958188153, 'support': 252}, 'CON': {'precision': 0.4195121951219512, 'recall': 0.5341614906832298, 'f1-score': 0.4699453551912568, 'support': 161}, 'LOC': {'precision': 0.7051282051282052, 'recall': 0.738255033557047, 'f1-score': 0.721311475409836, 'support': 149}, 'MAT': {'precision': 0.3181818181818182, 'recall': 0.175, 'f1-score': 0.22580645161290322, 'support': 40}, 'PER': {'precision': 0.7327586206896551, 'recall': 0.7589285714285714, 'f1-score': 0.7456140350877194, 'support': 336}, 'SPE': {'precision': 0.39622641509433965, 'recall': 0.6774193548387096, 'f1-score': 0.5, 'support': 31}, 'micro avg': {'precision': 0.5560578661844484, 'recall': 0.6346749226006192, 'f1-score': 0.5927710843373494, 'support': 969}, 'macro avg': {'precision': 0.499027917110529, 'recall': 0.5705744983650163, 'f1-score': 0.5227574855200885, 'support': 969}, 'weighted avg': {'precision': 0.567861235019973, 'recall': 0.6346749226006192, 'f1-score': 0.596088565554375, 'support': 969}}
0.0418	6.0	1494	0.3140	0.4915	0.6852	0.5724	0.9440	{'B-ART': {'precision': 0.5043227665706052, 'recall': 0.6944444444444444, 'f1-score': 0.5843071786310517, 'support': 252.0}, 'B-CON': {'precision': 0.4196078431372549, 'recall': 0.6645962732919255, 'f1-score': 0.5144230769230769, 'support': 161.0}, 'B-LOC': {'precision': 0.7094972067039106, 'recall': 0.8523489932885906, 'f1-score': 0.774390243902439, 'support': 149.0}, 'B-MAT': {'precision': 0.45714285714285713, 'recall': 0.4, 'f1-score': 0.4266666666666667, 'support': 40.0}, 'B-PER': {'precision': 0.7493917274939172, 'recall': 0.9166666666666666, 'f1-score': 0.8246318607764391, 'support': 336.0}, 'B-SPE': {'precision': 0.45901639344262296, 'recall': 0.9032258064516129, 'f1-score': 0.6086956521739131, 'support': 31.0}, 'I-ART': {'precision': 0.6090534979423868, 'recall': 0.4192634560906516, 'f1-score': 0.4966442953020134, 'support': 353.0}, 'I-CON': {'precision': 0.4297520661157025, 'recall': 0.4406779661016949, 'f1-score': 0.4351464435146444, 'support': 118.0}, 'I-LOC': {'precision': 0.8666666666666667, 'recall': 0.7677165354330708, 'f1-score': 0.81419624217119, 'support': 254.0}, 'I-MAT': {'precision': 0.2222222222222222, 'recall': 0.16216216216216217, 'f1-score': 0.1875, 'support': 37.0}, 'I-PER': {'precision': 0.7981859410430839, 'recall': 0.7874720357941835, 'f1-score': 0.7927927927927928, 'support': 447.0}, 'I-SPE': {'precision': 0.8571428571428571, 'recall': 0.7142857142857143, 'f1-score': 0.7792207792207793, 'support': 42.0}, 'O': {'precision': 0.9782386446618957, 'recall': 0.9706777450364716, 'f1-score': 0.9744435284418796, 'support': 20701.0}, 'accuracy': 0.9440251297936391, 'macro avg': {'precision': 0.6200185146373833, 'recall': 0.6687336768497837, 'f1-score': 0.6317737508089911, 'support': 22921.0}, 'weighted avg': {'precision': 0.947691706712761, 'recall': 0.9440251297936391, 'f1-score': 0.9448946993287756, 'support': 22921.0}}	{'ART': {'precision': 0.40437158469945356, 'recall': 0.5873015873015873, 'f1-score': 0.4789644012944984, 'support': 252}, 'CON': {'precision': 0.3584905660377358, 'recall': 0.5900621118012422, 'f1-score': 0.44600938967136144, 'support': 161}, 'LOC': {'precision': 0.5706521739130435, 'recall': 0.7046979865771812, 'f1-score': 0.6306306306306305, 'support': 149}, 'MAT': {'precision': 0.32558139534883723, 'recall': 0.35, 'f1-score': 0.3373493975903615, 'support': 40}, 'PER': {'precision': 0.6473317865429234, 'recall': 0.8303571428571429, 'f1-score': 0.727509778357236, 'support': 336}, 'SPE': {'precision': 0.3709677419354839, 'recall': 0.7419354838709677, 'f1-score': 0.49462365591397855, 'support': 31}, 'micro avg': {'precision': 0.4914877868245744, 'recall': 0.6852425180598555, 'f1-score': 0.5724137931034483, 'support': 969}, 'macro avg': {'precision': 0.4462325414129129, 'recall': 0.6340590520680203, 'f1-score': 0.5191812089096778, 'support': 969}, 'weighted avg': {'precision': 0.502242033520905, 'recall': 0.6852425180598555, 'f1-score': 0.5776481935936489, 'support': 969}}
0.0168	7.0	1743	0.3239	0.5225	0.6698	0.5871	0.9456	{'B-ART': {'precision': 0.518840579710145, 'recall': 0.7103174603174603, 'f1-score': 0.5996649916247906, 'support': 252.0}, 'B-CON': {'precision': 0.45217391304347826, 'recall': 0.6459627329192547, 'f1-score': 0.5319693094629157, 'support': 161.0}, 'B-LOC': {'precision': 0.8405797101449275, 'recall': 0.7785234899328859, 'f1-score': 0.8083623693379791, 'support': 149.0}, 'B-MAT': {'precision': 0.4642857142857143, 'recall': 0.325, 'f1-score': 0.38235294117647056, 'support': 40.0}, 'B-PER': {'precision': 0.7936046511627907, 'recall': 0.8125, 'f1-score': 0.8029411764705883, 'support': 336.0}, 'B-SPE': {'precision': 0.5, 'recall': 0.9032258064516129, 'f1-score': 0.6436781609195402, 'support': 31.0}, 'I-ART': {'precision': 0.5337423312883436, 'recall': 0.49291784702549574, 'f1-score': 0.5125184094256259, 'support': 353.0}, 'I-CON': {'precision': 0.4222222222222222, 'recall': 0.4830508474576271, 'f1-score': 0.4505928853754941, 'support': 118.0}, 'I-LOC': {'precision': 0.8433734939759037, 'recall': 0.8267716535433071, 'f1-score': 0.8349900596421471, 'support': 254.0}, 'I-MAT': {'precision': 0.35714285714285715, 'recall': 0.13513513513513514, 'f1-score': 0.19607843137254902, 'support': 37.0}, 'I-PER': {'precision': 0.85, 'recall': 0.7606263982102909, 'f1-score': 0.8028335301062574, 'support': 447.0}, 'I-SPE': {'precision': 0.9354838709677419, 'recall': 0.6904761904761905, 'f1-score': 0.7945205479452054, 'support': 42.0}, 'O': {'precision': 0.9767757575757576, 'recall': 0.973189700980629, 'f1-score': 0.9749794318346804, 'support': 20701.0}, 'accuracy': 0.9455957418960779, 'macro avg': {'precision': 0.6529403924246062, 'recall': 0.6567459432653762, 'f1-score': 0.6411909418995573, 'support': 22921.0}, 'weighted avg': {'precision': 0.9482420702747809, 'recall': 0.9455957418960779, 'f1-score': 0.9463357624521783, 'support': 22921.0}}	{'ART': {'precision': 0.41160949868073876, 'recall': 0.6190476190476191, 'f1-score': 0.49445324881141045, 'support': 252}, 'CON': {'precision': 0.4, 'recall': 0.6086956521739131, 'f1-score': 0.48275862068965525, 'support': 161}, 'LOC': {'precision': 0.7161290322580646, 'recall': 0.7449664429530202, 'f1-score': 0.7302631578947368, 'support': 149}, 'MAT': {'precision': 0.3333333333333333, 'recall': 0.275, 'f1-score': 0.3013698630136986, 'support': 40}, 'PER': {'precision': 0.6684491978609626, 'recall': 0.7440476190476191, 'f1-score': 0.7042253521126761, 'support': 336}, 'SPE': {'precision': 0.4107142857142857, 'recall': 0.7419354838709677, 'f1-score': 0.528735632183908, 'support': 31}, 'micro avg': {'precision': 0.5225442834138486, 'recall': 0.6697626418988648, 'f1-score': 0.5870646766169154, 'support': 969}, 'macro avg': {'precision': 0.49003922464123084, 'recall': 0.6222821361821899, 'f1-score': 0.5403009791176808, 'support': 969}, 'weighted avg': {'precision': 0.5423046709450541, 'recall': 0.6697626418988648, 'f1-score': 0.5946345558162374, 'support': 969}}
0.0168	8.0	1992	0.3573	0.5199	0.6863	0.5916	0.9454	{'B-ART': {'precision': 0.4818941504178273, 'recall': 0.6865079365079365, 'f1-score': 0.5662847790507365, 'support': 252.0}, 'B-CON': {'precision': 0.4380165289256198, 'recall': 0.6583850931677019, 'f1-score': 0.5260545905707196, 'support': 161.0}, 'B-LOC': {'precision': 0.7987012987012987, 'recall': 0.825503355704698, 'f1-score': 0.8118811881188119, 'support': 149.0}, 'B-MAT': {'precision': 0.4642857142857143, 'recall': 0.325, 'f1-score': 0.38235294117647056, 'support': 40.0}, 'B-PER': {'precision': 0.7798408488063661, 'recall': 0.875, 'f1-score': 0.8246844319775596, 'support': 336.0}, 'B-SPE': {'precision': 0.5, 'recall': 0.9032258064516129, 'f1-score': 0.6436781609195402, 'support': 31.0}, 'I-ART': {'precision': 0.585820895522388, 'recall': 0.4447592067988669, 'f1-score': 0.5056360708534622, 'support': 353.0}, 'I-CON': {'precision': 0.4661016949152542, 'recall': 0.4661016949152542, 'f1-score': 0.4661016949152542, 'support': 118.0}, 'I-LOC': {'precision': 0.88, 'recall': 0.7795275590551181, 'f1-score': 0.826722338204593, 'support': 254.0}, 'I-MAT': {'precision': 0.3333333333333333, 'recall': 0.13513513513513514, 'f1-score': 0.19230769230769232, 'support': 37.0}, 'I-PER': {'precision': 0.8304668304668305, 'recall': 0.756152125279642, 'f1-score': 0.7915690866510539, 'support': 447.0}, 'I-SPE': {'precision': 0.90625, 'recall': 0.6904761904761905, 'f1-score': 0.7837837837837838, 'support': 42.0}, 'O': {'precision': 0.9763081395348837, 'recall': 0.9734312352060287, 'f1-score': 0.974867564887158, 'support': 20701.0}, 'accuracy': 0.9454212294402513, 'macro avg': {'precision': 0.6493091873007321, 'recall': 0.6553234875921681, 'f1-score': 0.6381480248782181, 'support': 22921.0}, 'weighted avg': {'precision': 0.9478009909481355, 'recall': 0.9454212294402513, 'f1-score': 0.945804594612976, 'support': 22921.0}}	{'ART': {'precision': 0.39790575916230364, 'recall': 0.6031746031746031, 'f1-score': 0.4794952681388013, 'support': 252}, 'CON': {'precision': 0.3967611336032389, 'recall': 0.6086956521739131, 'f1-score': 0.4803921568627451, 'support': 161}, 'LOC': {'precision': 0.6770186335403726, 'recall': 0.7315436241610739, 'f1-score': 0.7032258064516129, 'support': 149}, 'MAT': {'precision': 0.3055555555555556, 'recall': 0.275, 'f1-score': 0.2894736842105263, 'support': 40}, 'PER': {'precision': 0.6886075949367089, 'recall': 0.8095238095238095, 'f1-score': 0.744186046511628, 'support': 336}, 'SPE': {'precision': 0.39655172413793105, 'recall': 0.7419354838709677, 'f1-score': 0.5168539325842697, 'support': 31}, 'micro avg': {'precision': 0.5199374511336982, 'recall': 0.6862745098039216, 'f1-score': 0.5916370106761565, 'support': 969}, 'macro avg': {'precision': 0.47706673348935175, 'recall': 0.6283121954840613, 'f1-score': 0.5356044824599305, 'support': 969}, 'weighted avg': {'precision': 0.537578996682941, 'recall': 0.6862745098039216, 'f1-score': 0.5991790721296291, 'support': 969}}
0.0082	9.0	2241	0.3648	0.5231	0.6780	0.5906	0.9445	{'B-ART': {'precision': 0.501432664756447, 'recall': 0.6944444444444444, 'f1-score': 0.5823627287853578, 'support': 252.0}, 'B-CON': {'precision': 0.4449152542372881, 'recall': 0.6521739130434783, 'f1-score': 0.5289672544080605, 'support': 161.0}, 'B-LOC': {'precision': 0.7960526315789473, 'recall': 0.8120805369127517, 'f1-score': 0.8039867109634552, 'support': 149.0}, 'B-MAT': {'precision': 0.4482758620689655, 'recall': 0.325, 'f1-score': 0.37681159420289856, 'support': 40.0}, 'B-PER': {'precision': 0.7966573816155988, 'recall': 0.8511904761904762, 'f1-score': 0.823021582733813, 'support': 336.0}, 'B-SPE': {'precision': 0.5, 'recall': 0.9032258064516129, 'f1-score': 0.6436781609195402, 'support': 31.0}, 'I-ART': {'precision': 0.5369774919614148, 'recall': 0.4730878186968839, 'f1-score': 0.5030120481927711, 'support': 353.0}, 'I-CON': {'precision': 0.3821656050955414, 'recall': 0.5084745762711864, 'f1-score': 0.43636363636363634, 'support': 118.0}, 'I-LOC': {'precision': 0.8728070175438597, 'recall': 0.7834645669291339, 'f1-score': 0.8257261410788381, 'support': 254.0}, 'I-MAT': {'precision': 0.2, 'recall': 0.05405405405405406, 'f1-score': 0.0851063829787234, 'support': 37.0}, 'I-PER': {'precision': 0.8593350383631714, 'recall': 0.7516778523489933, 'f1-score': 0.801909307875895, 'support': 447.0}, 'I-SPE': {'precision': 0.8787878787878788, 'recall': 0.6904761904761905, 'f1-score': 0.7733333333333333, 'support': 42.0}, 'O': {'precision': 0.9765647743813682, 'recall': 0.9722718709241099, 'f1-score': 0.9744135944421582, 'support': 20701.0}, 'accuracy': 0.9444614109332053, 'macro avg': {'precision': 0.6303055077223446, 'recall': 0.6516632389802551, 'f1-score': 0.6275917289444984, 'support': 22921.0}, 'weighted avg': {'precision': 0.9475307783389737, 'recall': 0.9444614109332053, 'f1-score': 0.9453113612572395, 'support': 22921.0}}	{'ART': {'precision': 0.4144385026737968, 'recall': 0.6150793650793651, 'f1-score': 0.4952076677316294, 'support': 252}, 'CON': {'precision': 0.38910505836575876, 'recall': 0.6211180124223602, 'f1-score': 0.47846889952153104, 'support': 161}, 'LOC': {'precision': 0.6772151898734177, 'recall': 0.7181208053691275, 'f1-score': 0.6970684039087949, 'support': 149}, 'MAT': {'precision': 0.3125, 'recall': 0.25, 'f1-score': 0.2777777777777778, 'support': 40}, 'PER': {'precision': 0.6912928759894459, 'recall': 0.7797619047619048, 'f1-score': 0.7328671328671328, 'support': 336}, 'SPE': {'precision': 0.4107142857142857, 'recall': 0.7419354838709677, 'f1-score': 0.528735632183908, 'support': 31}, 'micro avg': {'precision': 0.5230891719745223, 'recall': 0.6780185758513931, 'f1-score': 0.590561797752809, 'support': 969}, 'macro avg': {'precision': 0.48254431876945086, 'recall': 0.6210025952506207, 'f1-score': 0.5350209189984624, 'support': 969}, 'weighted avg': {'precision': 0.542307564036553, 'recall': 0.6780185758513931, 'f1-score': 0.5979714031227207, 'support': 969}}
0.0082	10.0	2490	0.3840	0.5067	0.6997	0.5878	0.9432	{'B-ART': {'precision': 0.4661458333333333, 'recall': 0.7103174603174603, 'f1-score': 0.5628930817610063, 'support': 252.0}, 'B-CON': {'precision': 0.4411764705882353, 'recall': 0.6521739130434783, 'f1-score': 0.5263157894736842, 'support': 161.0}, 'B-LOC': {'precision': 0.7425149700598802, 'recall': 0.8322147651006712, 'f1-score': 0.7848101265822784, 'support': 149.0}, 'B-MAT': {'precision': 0.4722222222222222, 'recall': 0.425, 'f1-score': 0.4473684210526316, 'support': 40.0}, 'B-PER': {'precision': 0.7789203084832905, 'recall': 0.9017857142857143, 'f1-score': 0.8358620689655173, 'support': 336.0}, 'B-SPE': {'precision': 0.5, 'recall': 0.8387096774193549, 'f1-score': 0.6265060240963856, 'support': 31.0}, 'I-ART': {'precision': 0.4943181818181818, 'recall': 0.49291784702549574, 'f1-score': 0.49361702127659574, 'support': 353.0}, 'I-CON': {'precision': 0.4264705882352941, 'recall': 0.4915254237288136, 'f1-score': 0.4566929133858268, 'support': 118.0}, 'I-LOC': {'precision': 0.8595744680851064, 'recall': 0.7952755905511811, 'f1-score': 0.8261758691206544, 'support': 254.0}, 'I-MAT': {'precision': 0.17647058823529413, 'recall': 0.08108108108108109, 'f1-score': 0.1111111111111111, 'support': 37.0}, 'I-PER': {'precision': 0.8410757946210269, 'recall': 0.7695749440715883, 'f1-score': 0.8037383177570093, 'support': 447.0}, 'I-SPE': {'precision': 0.8709677419354839, 'recall': 0.6428571428571429, 'f1-score': 0.7397260273972602, 'support': 42.0}, 'O': {'precision': 0.9796336996336996, 'recall': 0.9689386986135935, 'f1-score': 0.9742568486496989, 'support': 20701.0}, 'accuracy': 0.9432398237424197, 'macro avg': {'precision': 0.6191916051731575, 'recall': 0.6617209429304289, 'f1-score': 0.6299287400484354, 'support': 22921.0}, 'weighted avg': {'precision': 0.9483380707896214, 'recall': 0.9432398237424197, 'f1-score': 0.9450816101206192, 'support': 22921.0}}	{'ART': {'precision': 0.387409200968523, 'recall': 0.6349206349206349, 'f1-score': 0.48120300751879697, 'support': 252}, 'CON': {'precision': 0.38823529411764707, 'recall': 0.6149068322981367, 'f1-score': 0.4759615384615385, 'support': 161}, 'LOC': {'precision': 0.6358381502890174, 'recall': 0.738255033557047, 'f1-score': 0.6832298136645962, 'support': 149}, 'MAT': {'precision': 0.34146341463414637, 'recall': 0.35, 'f1-score': 0.34567901234567905, 'support': 40}, 'PER': {'precision': 0.681592039800995, 'recall': 0.8154761904761905, 'f1-score': 0.7425474254742549, 'support': 336}, 'SPE': {'precision': 0.3888888888888889, 'recall': 0.6774193548387096, 'f1-score': 0.4941176470588235, 'support': 31}, 'micro avg': {'precision': 0.5067264573991032, 'recall': 0.6996904024767802, 'f1-score': 0.58777633289987, 'support': 969}, 'macro avg': {'precision': 0.47057116478320293, 'recall': 0.6384963410151198, 'f1-score': 0.5371230740872815, 'support': 969}, 'weighted avg': {'precision': 0.525904956557408, 'recall': 0.6996904024767802, 'f1-score': 0.5968368940506396, 'support': 969}}
0.0044	11.0	2739	0.3887	0.5182	0.6749	0.5863	0.9468	{'B-ART': {'precision': 0.47802197802197804, 'recall': 0.6904761904761905, 'f1-score': 0.564935064935065, 'support': 252.0}, 'B-CON': {'precision': 0.4678111587982833, 'recall': 0.6770186335403726, 'f1-score': 0.5532994923857868, 'support': 161.0}, 'B-LOC': {'precision': 0.7530864197530864, 'recall': 0.8187919463087249, 'f1-score': 0.7845659163987139, 'support': 149.0}, 'B-MAT': {'precision': 0.4827586206896552, 'recall': 0.35, 'f1-score': 0.4057971014492754, 'support': 40.0}, 'B-PER': {'precision': 0.7967479674796748, 'recall': 0.875, 'f1-score': 0.8340425531914893, 'support': 336.0}, 'B-SPE': {'precision': 0.5, 'recall': 0.8709677419354839, 'f1-score': 0.6352941176470588, 'support': 31.0}, 'I-ART': {'precision': 0.5799256505576208, 'recall': 0.44192634560906513, 'f1-score': 0.5016077170418006, 'support': 353.0}, 'I-CON': {'precision': 0.45871559633027525, 'recall': 0.423728813559322, 'f1-score': 0.44052863436123346, 'support': 118.0}, 'I-LOC': {'precision': 0.8858447488584474, 'recall': 0.7637795275590551, 'f1-score': 0.8202959830866807, 'support': 254.0}, 'I-MAT': {'precision': 0.2, 'recall': 0.05405405405405406, 'f1-score': 0.0851063829787234, 'support': 37.0}, 'I-PER': {'precision': 0.8792650918635171, 'recall': 0.7494407158836689, 'f1-score': 0.8091787439613527, 'support': 447.0}, 'I-SPE': {'precision': 0.9032258064516129, 'recall': 0.6666666666666666, 'f1-score': 0.7671232876712328, 'support': 42.0}, 'O': {'precision': 0.9760765550239234, 'recall': 0.9756050432346264, 'f1-score': 0.9758407421724005, 'support': 20701.0}, 'accuracy': 0.9467737009729069, 'macro avg': {'precision': 0.6431907379867751, 'recall': 0.6428812060636333, 'f1-score': 0.6290473644062163, 'support': 22921.0}, 'weighted avg': {'precision': 0.9484089341730328, 'recall': 0.9467737009729069, 'f1-score': 0.9467241732449246, 'support': 22921.0}}	{'ART': {'precision': 0.39425587467362927, 'recall': 0.5992063492063492, 'f1-score': 0.47559055118110244, 'support': 252}, 'CON': {'precision': 0.3884297520661157, 'recall': 0.5838509316770186, 'f1-score': 0.46650124069478904, 'support': 161}, 'LOC': {'precision': 0.6424242424242425, 'recall': 0.7114093959731543, 'f1-score': 0.6751592356687899, 'support': 149}, 'MAT': {'precision': 0.34375, 'recall': 0.275, 'f1-score': 0.3055555555555556, 'support': 40}, 'PER': {'precision': 0.703125, 'recall': 0.8035714285714286, 'f1-score': 0.75, 'support': 336}, 'SPE': {'precision': 0.39285714285714285, 'recall': 0.7096774193548387, 'f1-score': 0.5057471264367817, 'support': 31}, 'micro avg': {'precision': 0.5182250396196514, 'recall': 0.6749226006191951, 'f1-score': 0.5862841774988794, 'support': 969}, 'macro avg': {'precision': 0.47747366867018837, 'recall': 0.6137859207971316, 'f1-score': 0.529758951589503, 'support': 969}, 'weighted avg': {'precision': 0.5364184252323867, 'recall': 0.6749226006191951, 'f1-score': 0.5938644250834995, 'support': 969}}
0.0044	12.0	2988	0.4066	0.5202	0.6770	0.5883	0.9454	{'B-ART': {'precision': 0.5, 'recall': 0.6865079365079365, 'f1-score': 0.5785953177257525, 'support': 252.0}, 'B-CON': {'precision': 0.4430379746835443, 'recall': 0.6521739130434783, 'f1-score': 0.5276381909547738, 'support': 161.0}, 'B-LOC': {'precision': 0.7770700636942676, 'recall': 0.8187919463087249, 'f1-score': 0.7973856209150327, 'support': 149.0}, 'B-MAT': {'precision': 0.5, 'recall': 0.3, 'f1-score': 0.375, 'support': 40.0}, 'B-PER': {'precision': 0.7723785166240409, 'recall': 0.8988095238095238, 'f1-score': 0.8308115543328748, 'support': 336.0}, 'B-SPE': {'precision': 0.5, 'recall': 0.8387096774193549, 'f1-score': 0.6265060240963856, 'support': 31.0}, 'I-ART': {'precision': 0.5703971119133574, 'recall': 0.4475920679886686, 'f1-score': 0.5015873015873016, 'support': 353.0}, 'I-CON': {'precision': 0.4396551724137931, 'recall': 0.4322033898305085, 'f1-score': 0.4358974358974359, 'support': 118.0}, 'I-LOC': {'precision': 0.8777292576419214, 'recall': 0.7913385826771654, 'f1-score': 0.8322981366459627, 'support': 254.0}, 'I-MAT': {'precision': 0.2222222222222222, 'recall': 0.05405405405405406, 'f1-score': 0.08695652173913043, 'support': 37.0}, 'I-PER': {'precision': 0.8341463414634146, 'recall': 0.7651006711409396, 'f1-score': 0.7981330221703618, 'support': 447.0}, 'I-SPE': {'precision': 0.8666666666666667, 'recall': 0.6190476190476191, 'f1-score': 0.7222222222222222, 'support': 42.0}, 'O': {'precision': 0.9761178123334786, 'recall': 0.9733829283609488, 'f1-score': 0.9747484520123839, 'support': 20701.0}, 'accuracy': 0.9454212294402513, 'macro avg': {'precision': 0.636878549204362, 'recall': 0.6367471007837633, 'f1-score': 0.6221369077153552, 'support': 22921.0}, 'weighted avg': {'precision': 0.9470967639833853, 'recall': 0.9454212294402513, 'f1-score': 0.9454921001522737, 'support': 22921.0}}	{'ART': {'precision': 0.4010840108401084, 'recall': 0.5873015873015873, 'f1-score': 0.47665056360708535, 'support': 252}, 'CON': {'precision': 0.3836734693877551, 'recall': 0.5838509316770186, 'f1-score': 0.46305418719211827, 'support': 161}, 'LOC': {'precision': 0.6585365853658537, 'recall': 0.7248322147651006, 'f1-score': 0.6900958466453675, 'support': 149}, 'MAT': {'precision': 0.37037037037037035, 'recall': 0.25, 'f1-score': 0.29850746268656714, 'support': 40}, 'PER': {'precision': 0.6799007444168734, 'recall': 0.8154761904761905, 'f1-score': 0.7415426251691475, 'support': 336}, 'SPE': {'precision': 0.41509433962264153, 'recall': 0.7096774193548387, 'f1-score': 0.5238095238095237, 'support': 31}, 'micro avg': {'precision': 0.5202220459952419, 'recall': 0.6769865841073271, 'f1-score': 0.5883408071748879, 'support': 969}, 'macro avg': {'precision': 0.4847765866672671, 'recall': 0.6118563905957893, 'f1-score': 0.5322767015183015, 'support': 969}, 'weighted avg': {'precision': 0.5336387409595813, 'recall': 0.6769865841073271, 'f1-score': 0.5932184345918139, 'support': 969}}
0.0031	13.0	3237	0.4172	0.5196	0.6852	0.5910	0.9446	{'B-ART': {'precision': 0.49019607843137253, 'recall': 0.6944444444444444, 'f1-score': 0.5747126436781609, 'support': 252.0}, 'B-CON': {'precision': 0.4517543859649123, 'recall': 0.639751552795031, 'f1-score': 0.5295629820051414, 'support': 161.0}, 'B-LOC': {'precision': 0.75, 'recall': 0.825503355704698, 'f1-score': 0.7859424920127795, 'support': 149.0}, 'B-MAT': {'precision': 0.4838709677419355, 'recall': 0.375, 'f1-score': 0.4225352112676056, 'support': 40.0}, 'B-PER': {'precision': 0.7659033078880407, 'recall': 0.8958333333333334, 'f1-score': 0.8257887517146777, 'support': 336.0}, 'B-SPE': {'precision': 0.5283018867924528, 'recall': 0.9032258064516129, 'f1-score': 0.6666666666666666, 'support': 31.0}, 'I-ART': {'precision': 0.5416666666666666, 'recall': 0.47875354107648727, 'f1-score': 0.5082706766917293, 'support': 353.0}, 'I-CON': {'precision': 0.4322033898305085, 'recall': 0.4322033898305085, 'f1-score': 0.4322033898305085, 'support': 118.0}, 'I-LOC': {'precision': 0.8805309734513275, 'recall': 0.7834645669291339, 'f1-score': 0.8291666666666667, 'support': 254.0}, 'I-MAT': {'precision': 0.25, 'recall': 0.08108108108108109, 'f1-score': 0.12244897959183673, 'support': 37.0}, 'I-PER': {'precision': 0.8229665071770335, 'recall': 0.7695749440715883, 'f1-score': 0.7953757225433526, 'support': 447.0}, 'I-SPE': {'precision': 0.84375, 'recall': 0.6428571428571429, 'f1-score': 0.7297297297297297, 'support': 42.0}, 'O': {'precision': 0.977450551586723, 'recall': 0.9715955750929907, 'f1-score': 0.9745142691021852, 'support': 20701.0}, 'accuracy': 0.9445922952750753, 'macro avg': {'precision': 0.6321995935023825, 'recall': 0.6533299025898501, 'f1-score': 0.6305321678077723, 'support': 22921.0}, 'weighted avg': {'precision': 0.94732813464729, 'recall': 0.9445922952750753, 'f1-score': 0.9453071737303523, 'support': 22921.0}}	{'ART': {'precision': 0.40633245382585753, 'recall': 0.6111111111111112, 'f1-score': 0.4881141045958796, 'support': 252}, 'CON': {'precision': 0.39662447257383965, 'recall': 0.5838509316770186, 'f1-score': 0.47236180904522607, 'support': 161}, 'LOC': {'precision': 0.631578947368421, 'recall': 0.7248322147651006, 'f1-score': 0.6749999999999998, 'support': 149}, 'MAT': {'precision': 0.3333333333333333, 'recall': 0.275, 'f1-score': 0.3013698630136986, 'support': 40}, 'PER': {'precision': 0.6806930693069307, 'recall': 0.8184523809523809, 'f1-score': 0.7432432432432433, 'support': 336}, 'SPE': {'precision': 0.4074074074074074, 'recall': 0.7096774193548387, 'f1-score': 0.5176470588235293, 'support': 31}, 'micro avg': {'precision': 0.5195618153364632, 'recall': 0.6852425180598555, 'f1-score': 0.5910102358700489, 'support': 969}, 'macro avg': {'precision': 0.47599494730263164, 'recall': 0.6204873429767416, 'f1-score': 0.5329560131202628, 'support': 969}, 'weighted avg': {'precision': 0.5315102330820337, 'recall': 0.6852425180598555, 'f1-score': 0.5959355920415378, 'support': 969}}
0.0031	14.0	3486	0.4180	0.5189	0.6945	0.5940	0.9446	{'B-ART': {'precision': 0.48467966573816157, 'recall': 0.6904761904761905, 'f1-score': 0.5695581014729951, 'support': 252.0}, 'B-CON': {'precision': 0.42338709677419356, 'recall': 0.6521739130434783, 'f1-score': 0.5134474327628362, 'support': 161.0}, 'B-LOC': {'precision': 0.7469879518072289, 'recall': 0.8322147651006712, 'f1-score': 0.7873015873015873, 'support': 149.0}, 'B-MAT': {'precision': 0.5, 'recall': 0.35, 'f1-score': 0.4117647058823529, 'support': 40.0}, 'B-PER': {'precision': 0.7729591836734694, 'recall': 0.9017857142857143, 'f1-score': 0.8324175824175825, 'support': 336.0}, 'B-SPE': {'precision': 0.5185185185185185, 'recall': 0.9032258064516129, 'f1-score': 0.6588235294117647, 'support': 31.0}, 'I-ART': {'precision': 0.5842293906810035, 'recall': 0.46175637393767704, 'f1-score': 0.5158227848101266, 'support': 353.0}, 'I-CON': {'precision': 0.40298507462686567, 'recall': 0.4576271186440678, 'f1-score': 0.42857142857142855, 'support': 118.0}, 'I-LOC': {'precision': 0.8300395256916996, 'recall': 0.8267716535433071, 'f1-score': 0.8284023668639053, 'support': 254.0}, 'I-MAT': {'precision': 0.3, 'recall': 0.08108108108108109, 'f1-score': 0.1276595744680851, 'support': 37.0}, 'I-PER': {'precision': 0.8162790697674419, 'recall': 0.785234899328859, 'f1-score': 0.8004561003420753, 'support': 447.0}, 'I-SPE': {'precision': 0.8484848484848485, 'recall': 0.6666666666666666, 'f1-score': 0.7466666666666667, 'support': 42.0}, 'O': {'precision': 0.9785731677623569, 'recall': 0.9707260518815516, 'f1-score': 0.9746338151130081, 'support': 20701.0}, 'accuracy': 0.9446359233890319, 'macro avg': {'precision': 0.631317191809676, 'recall': 0.6599800180339137, 'f1-score': 0.6304250520064935, 'support': 22921.0}, 'weighted avg': {'precision': 0.9480854094440608, 'recall': 0.9446359233890319, 'f1-score': 0.9455495397517018, 'support': 22921.0}}	{'ART': {'precision': 0.40691489361702127, 'recall': 0.6071428571428571, 'f1-score': 0.48726114649681523, 'support': 252}, 'CON': {'precision': 0.3745173745173745, 'recall': 0.6024844720496895, 'f1-score': 0.4619047619047618, 'support': 161}, 'LOC': {'precision': 0.6436781609195402, 'recall': 0.7516778523489933, 'f1-score': 0.6934984520123839, 'support': 149}, 'MAT': {'precision': 0.36666666666666664, 'recall': 0.275, 'f1-score': 0.3142857142857143, 'support': 40}, 'PER': {'precision': 0.6873449131513648, 'recall': 0.8244047619047619, 'f1-score': 0.7496617050067659, 'support': 336}, 'SPE': {'precision': 0.41818181818181815, 'recall': 0.7419354838709677, 'f1-score': 0.5348837209302325, 'support': 31}, 'micro avg': {'precision': 0.5188897455666923, 'recall': 0.6945304437564499, 'f1-score': 0.5939982347749337, 'support': 969}, 'macro avg': {'precision': 0.4828839711756309, 'recall': 0.6337742378862116, 'f1-score': 0.5402492501061124, 'support': 969}, 'weighted avg': {'precision': 0.5338762541950048, 'recall': 0.6945304437564499, 'f1-score': 0.6001309615441159, 'support': 969}}
0.0018	15.0	3735	0.4224	0.5339	0.6821	0.5990	0.9462	{'B-ART': {'precision': 0.49854227405247814, 'recall': 0.6785714285714286, 'f1-score': 0.5747899159663865, 'support': 252.0}, 'B-CON': {'precision': 0.44396551724137934, 'recall': 0.639751552795031, 'f1-score': 0.5241730279898219, 'support': 161.0}, 'B-LOC': {'precision': 0.8053691275167785, 'recall': 0.8053691275167785, 'f1-score': 0.8053691275167785, 'support': 149.0}, 'B-MAT': {'precision': 0.52, 'recall': 0.325, 'f1-score': 0.4, 'support': 40.0}, 'B-PER': {'precision': 0.7757731958762887, 'recall': 0.8958333333333334, 'f1-score': 0.8314917127071824, 'support': 336.0}, 'B-SPE': {'precision': 0.5185185185185185, 'recall': 0.9032258064516129, 'f1-score': 0.6588235294117647, 'support': 31.0}, 'I-ART': {'precision': 0.5780141843971631, 'recall': 0.46175637393767704, 'f1-score': 0.5133858267716536, 'support': 353.0}, 'I-CON': {'precision': 0.45217391304347826, 'recall': 0.4406779661016949, 'f1-score': 0.44635193133047213, 'support': 118.0}, 'I-LOC': {'precision': 0.8883928571428571, 'recall': 0.7834645669291339, 'f1-score': 0.8326359832635983, 'support': 254.0}, 'I-MAT': {'precision': 0.3, 'recall': 0.08108108108108109, 'f1-score': 0.1276595744680851, 'support': 37.0}, 'I-PER': {'precision': 0.8325242718446602, 'recall': 0.767337807606264, 'f1-score': 0.7986030267753201, 'support': 447.0}, 'I-SPE': {'precision': 0.8484848484848485, 'recall': 0.6666666666666666, 'f1-score': 0.7466666666666667, 'support': 42.0}, 'O': {'precision': 0.9762273651592912, 'recall': 0.9740109173469881, 'f1-score': 0.9751178817555314, 'support': 20701.0}, 'accuracy': 0.9461629073775141, 'macro avg': {'precision': 0.6490758517905955, 'recall': 0.6479035867952069, 'f1-score': 0.63346678497102, 'support': 22921.0}, 'weighted avg': {'precision': 0.9478403945327264, 'recall': 0.9461629073775141, 'f1-score': 0.9462677087890037, 'support': 22921.0}}	{'ART': {'precision': 0.41483516483516486, 'recall': 0.5992063492063492, 'f1-score': 0.4902597402597403, 'support': 252}, 'CON': {'precision': 0.3958333333333333, 'recall': 0.5900621118012422, 'f1-score': 0.4738154613466334, 'support': 161}, 'LOC': {'precision': 0.6928104575163399, 'recall': 0.7114093959731543, 'f1-score': 0.7019867549668874, 'support': 149}, 'MAT': {'precision': 0.4074074074074074, 'recall': 0.275, 'f1-score': 0.32835820895522394, 'support': 40}, 'PER': {'precision': 0.6892230576441103, 'recall': 0.8184523809523809, 'f1-score': 0.7482993197278912, 'support': 336}, 'SPE': {'precision': 0.41818181818181815, 'recall': 0.7419354838709677, 'f1-score': 0.5348837209302325, 'support': 31}, 'micro avg': {'precision': 0.5339256865912763, 'recall': 0.6821465428276574, 'f1-score': 0.5990031717263253, 'support': 969}, 'macro avg': {'precision': 0.5030485398196957, 'recall': 0.6226776203006824, 'f1-score': 0.5462672010311015, 'support': 969}, 'weighted avg': {'precision': 0.549365600003526, 'recall': 0.6821465428276574, 'f1-score': 0.6043034731144957, 'support': 969}}
0.0018	16.0	3984	0.4260	0.5289	0.6883	0.5982	0.9457	{'B-ART': {'precision': 0.48863636363636365, 'recall': 0.6825396825396826, 'f1-score': 0.5695364238410596, 'support': 252.0}, 'B-CON': {'precision': 0.4517543859649123, 'recall': 0.639751552795031, 'f1-score': 0.5295629820051414, 'support': 161.0}, 'B-LOC': {'precision': 0.7834394904458599, 'recall': 0.825503355704698, 'f1-score': 0.803921568627451, 'support': 149.0}, 'B-MAT': {'precision': 0.5, 'recall': 0.3, 'f1-score': 0.375, 'support': 40.0}, 'B-PER': {'precision': 0.7721518987341772, 'recall': 0.9077380952380952, 'f1-score': 0.8344733242134063, 'support': 336.0}, 'B-SPE': {'precision': 0.509090909090909, 'recall': 0.9032258064516129, 'f1-score': 0.6511627906976745, 'support': 31.0}, 'I-ART': {'precision': 0.5589225589225589, 'recall': 0.4702549575070821, 'f1-score': 0.5107692307692308, 'support': 353.0}, 'I-CON': {'precision': 0.4482758620689655, 'recall': 0.4406779661016949, 'f1-score': 0.4444444444444444, 'support': 118.0}, 'I-LOC': {'precision': 0.88, 'recall': 0.7795275590551181, 'f1-score': 0.826722338204593, 'support': 254.0}, 'I-MAT': {'precision': 0.3, 'recall': 0.08108108108108109, 'f1-score': 0.1276595744680851, 'support': 37.0}, 'I-PER': {'precision': 0.8218527315914489, 'recall': 0.7740492170022372, 'f1-score': 0.7972350230414746, 'support': 447.0}, 'I-SPE': {'precision': 0.875, 'recall': 0.6666666666666666, 'f1-score': 0.7567567567567568, 'support': 42.0}, 'O': {'precision': 0.9772429521083021, 'recall': 0.9728998599101493, 'f1-score': 0.9750665698378117, 'support': 20701.0}, 'accuracy': 0.9456829981239911, 'macro avg': {'precision': 0.6435667040433459, 'recall': 0.6495319846194729, 'f1-score': 0.6309470020697792, 'support': 22921.0}, 'weighted avg': {'precision': 0.9478934993084417, 'recall': 0.9456829981239911, 'f1-score': 0.9460579371949186, 'support': 22921.0}}	{'ART': {'precision': 0.40641711229946526, 'recall': 0.6031746031746031, 'f1-score': 0.4856230031948882, 'support': 252}, 'CON': {'precision': 0.4025423728813559, 'recall': 0.5900621118012422, 'f1-score': 0.47858942065491183, 'support': 161}, 'LOC': {'precision': 0.6728395061728395, 'recall': 0.7315436241610739, 'f1-score': 0.7009646302250804, 'support': 149}, 'MAT': {'precision': 0.3333333333333333, 'recall': 0.225, 'f1-score': 0.26865671641791045, 'support': 40}, 'PER': {'precision': 0.687192118226601, 'recall': 0.8303571428571429, 'f1-score': 0.7520215633423182, 'support': 336}, 'SPE': {'precision': 0.4107142857142857, 'recall': 0.7419354838709677, 'f1-score': 0.528735632183908, 'support': 31}, 'micro avg': {'precision': 0.5289452815226011, 'recall': 0.6883384932920537, 'f1-score': 0.5982062780269058, 'support': 969}, 'macro avg': {'precision': 0.48550645477131343, 'recall': 0.6203454943108383, 'f1-score': 0.5357651610031695, 'support': 969}, 'weighted avg': {'precision': 0.5412193484703104, 'recall': 0.6883384932920537, 'f1-score': 0.6023632012090052, 'support': 969}}
0.0015	17.0	4233	0.4274	0.5249	0.6863	0.5948	0.9455	{'B-ART': {'precision': 0.48044692737430167, 'recall': 0.6825396825396826, 'f1-score': 0.5639344262295082, 'support': 252.0}, 'B-CON': {'precision': 0.4517543859649123, 'recall': 0.639751552795031, 'f1-score': 0.5295629820051414, 'support': 161.0}, 'B-LOC': {'precision': 0.7735849056603774, 'recall': 0.825503355704698, 'f1-score': 0.7987012987012987, 'support': 149.0}, 'B-MAT': {'precision': 0.5, 'recall': 0.3, 'f1-score': 0.375, 'support': 40.0}, 'B-PER': {'precision': 0.7729591836734694, 'recall': 0.9017857142857143, 'f1-score': 0.8324175824175825, 'support': 336.0}, 'B-SPE': {'precision': 0.509090909090909, 'recall': 0.9032258064516129, 'f1-score': 0.6511627906976745, 'support': 31.0}, 'I-ART': {'precision': 0.5597269624573379, 'recall': 0.46458923512747874, 'f1-score': 0.5077399380804953, 'support': 353.0}, 'I-CON': {'precision': 0.46846846846846846, 'recall': 0.4406779661016949, 'f1-score': 0.45414847161572053, 'support': 118.0}, 'I-LOC': {'precision': 0.88, 'recall': 0.7795275590551181, 'f1-score': 0.826722338204593, 'support': 254.0}, 'I-MAT': {'precision': 0.3, 'recall': 0.08108108108108109, 'f1-score': 0.1276595744680851, 'support': 37.0}, 'I-PER': {'precision': 0.8205741626794258, 'recall': 0.767337807606264, 'f1-score': 0.793063583815029, 'support': 447.0}, 'I-SPE': {'precision': 0.875, 'recall': 0.6666666666666666, 'f1-score': 0.7567567567567568, 'support': 42.0}, 'O': {'precision': 0.9770081490104773, 'recall': 0.9729964736003092, 'f1-score': 0.974998184766561, 'support': 20701.0}, 'accuracy': 0.945464857554208, 'macro avg': {'precision': 0.6437395426445907, 'recall': 0.6481294539242578, 'f1-score': 0.6301436867506497, 'support': 22921.0}, 'weighted avg': {'precision': 0.9476305823082976, 'recall': 0.945464857554208, 'f1-score': 0.9457924692542702, 'support': 22921.0}}	{'ART': {'precision': 0.4, 'recall': 0.6031746031746031, 'f1-score': 0.4810126582278481, 'support': 252}, 'CON': {'precision': 0.4025423728813559, 'recall': 0.5900621118012422, 'f1-score': 0.47858942065491183, 'support': 161}, 'LOC': {'precision': 0.6646341463414634, 'recall': 0.7315436241610739, 'f1-score': 0.6964856230031949, 'support': 149}, 'MAT': {'precision': 0.3333333333333333, 'recall': 0.225, 'f1-score': 0.26865671641791045, 'support': 40}, 'PER': {'precision': 0.6856435643564357, 'recall': 0.8244047619047619, 'f1-score': 0.7486486486486487, 'support': 336}, 'SPE': {'precision': 0.4107142857142857, 'recall': 0.7419354838709677, 'f1-score': 0.528735632183908, 'support': 31}, 'micro avg': {'precision': 0.5248618784530387, 'recall': 0.6862745098039216, 'f1-score': 0.5948121645796065, 'support': 969}, 'macro avg': {'precision': 0.4828112837711456, 'recall': 0.6193534308187748, 'f1-score': 0.5336881165227371, 'support': 969}, 'weighted avg': {'precision': 0.5377518303952683, 'recall': 0.6862745098039216, 'f1-score': 0.5993059480151685, 'support': 969}}

Framework versions

Transformers 4.45.2
Pytorch 2.4.1
Datasets 3.0.1
Tokenizers 0.20.1

nstrn-mo/bert-finetuned-arc-ner-default-tunned

bert-finetuned-arc-ner-default-tunned

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

nstrn-mo/
bert-finetuned-arc-ner-default-tunned