legal-bert-small

• Loss: 0.1837
• Accuracy: 0.9548
• Precision: 0.7491
• Recall: 0.7882
• F1: 0.7682
• Classification Report: precision recall f1-score support

     LOC       0.84      0.86      0.85      1668
    MISC       0.59      0.63      0.61       702
     ORG       0.64      0.67      0.66      1661
     PER       0.83      0.90      0.87      1617

  micro avg 0.75 0.79 0.77 5648 macro avg 0.73 0.77 0.75 5648 weighted avg 0.75 0.79 0.77 5648

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 32
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 3

Training results

     LOC       0.83      0.80      0.81      1668
    MISC       0.59      0.62      0.60       702
     ORG       0.56      0.58      0.57      1661
     PER       0.75      0.92      0.83      1617

     LOC       0.81      0.88      0.84      1668
    MISC       0.59      0.64      0.61       702
     ORG       0.68      0.59      0.63      1661
     PER       0.83      0.90      0.86      1617

     LOC       0.84      0.86      0.85      1668
    MISC       0.59      0.63      0.61       702
     ORG       0.64      0.67      0.66      1661
     PER       0.83      0.90      0.87      1617

Framework versions

• Transformers 4.30.2
• Pytorch 2.0.0
• Datasets 2.1.0
• Tokenizers 0.13.3