ontology-notice-of-dismissal
This model is a fine-tuned version of
scales-okn/docket-language-model on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0309
- Accuracy: 0.9958
- F1: 0.9937
- Precision: 0.9875
- Recall: 1.0
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 4
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 2
- total_train_batch_size: 8
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.06
- num_epochs: 5
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
|---|
| 0.1089 | 0.59 | 100 | 0.0332 | 0.9917 | 0.9873 | 0.9873 | 0.9873 |
| 0.0007 | 1.18 | 200 | 0.0375 | 0.9917 | 0.9875 | 0.9753 | 1.0 |
| 0.0037 | 1.76 | 300 | 0.0365 | 0.9958 | 0.9937 | 0.9875 | 1.0 |
| 0.0369 | 2.35 | 400 | 0.0338 | 0.9958 | 0.9937 | 0.9875 | 1.0 |
| 0.0001 | 2.94 | 500 | 0.0309 | 0.9958 | 0.9937 | 0.9875 | 1.0 |
| 0.0001 | 3.53 | 600 | 0.0341 | 0.9958 | 0.9937 | 0.9875 | 1.0 |
| 0.0001 | 4.12 | 700 | 0.0317 | 0.9958 | 0.9937 | 0.9875 | 1.0 |
| 0.0001 | 4.7 | 800 | 0.0316 | 0.9958 | 0.9937 | 0.9875 | 1.0 |
Framework versions
- Transformers 4.23.1
- Pytorch 1.13.0+cu117
- Datasets 2.6.1
- Tokenizers 0.13.1
Public release information
This model is released by the SCALES Open Knowledge Network under the GNU General
Public License v3.0. It is derived from scales-okn/docket-language-model and is
intended for research and development involving legal-document classification or
information extraction. It is not legal advice.
The organization has reviewed the release decision and confirmed that the model's
training data and resulting weights are legally and ethically releasable. Users are
responsible for evaluating accuracy, bias, privacy, and fitness for their own use.
The repository includes PyTorch .bin artifacts. Hugging Face's server-side security
scan reported no file issues before publication. As with any serialized model
artifact, load it only with maintained libraries and in an appropriately isolated
environment.
