t5-dialogue-classification-3
This model is a fine-tuned version of
google/flan-t5-small on an unknown dataset.
It achieves the following results on the evaluation set:
-
Loss: 0.6790
-
Classification Report: precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8400 0.9545 0.8936 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 1.0000 0.6667 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7100 100
macro avg 0.4514 0.4761 0.4402 100
weighted avg 0.6892 0.7100 0.6853 100
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20
Training results
| Training Loss | Epoch | Step | Validation Loss | Classification Report |
|---|
| No log | 1.0 | 172 | 0.5176 | precision recall f1-score support |
ALLERGY 1.0000 0.2500 0.4000 4ASSESSMENT 0.2500 0.2500 0.2500 4
CC 0.4286 0.7500 0.5455 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.5000 0.3333 0.4000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8696 0.9091 0.8889 22
GENHX 0.7083 0.8500 0.7727 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7143 0.7143 0.7143 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.6667 1.0000 0.8000 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.6900 100
macro avg 0.4173 0.4347 0.4004 100
weighted avg 0.6814 0.6900 0.6680 100
|
| No log | 2.0 | 344 | 0.5183 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4ASSESSMENT 1.0000 0.2500 0.4000 4
CC 0.3750 0.7500 0.5000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.5000 0.3333 0.4000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8800 1.0000 0.9362 22
GENHX 0.7391 0.8500 0.7907 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7500 0.8571 0.8000 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 1.0000 0.3333 0.5000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7300 100
macro avg 0.4976 0.4630 0.4343 100
weighted avg 0.7341 0.7300 0.6967 100
|
| 0.0335 | 3.0 | 516 | 0.5484 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8800 1.0000 0.9362 22
GENHX 0.6800 0.8500 0.7556 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7500 0.8571 0.8000 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.3750 0.7500 0.5000 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8571 0.5455 0.6667 11
accuracy 0.7000 100
macro avg 0.3966 0.4376 0.4016 100
weighted avg 0.6475 0.7000 0.6590 100
|
| 0.0335 | 4.0 | 688 | 0.5881 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 1.0000 0.2500 0.4000 4
CC 0.7500 0.7500 0.7500 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.5000 0.3333 0.4000 3
EXAM 0.2000 1.0000 0.3333 1
FAM/SOCHX 0.8750 0.9545 0.9130 22
GENHX 0.7391 0.8500 0.7907 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.8333 0.7143 0.7692 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7200 100
macro avg 0.4781 0.4744 0.4386 100
weighted avg 0.7290 0.7200 0.7001 100
|
| 0.0335 | 5.0 | 860 | 0.5719 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 1.0000 0.2500 0.4000 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.5000 0.3333 0.4000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8462 1.0000 0.9167 22
GENHX 0.7727 0.8500 0.8095 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.8333 0.7143 0.7692 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7500 100
macro avg 0.5441 0.5100 0.4939 100
weighted avg 0.7564 0.7500 0.7280 100
|
| 0.0168 | 6.0 | 1032 | 0.6716 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2143 0.7500 0.3333 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.9167 1.0000 0.9565 22
GENHX 0.8824 0.7500 0.8108 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.3333 0.7500 0.4615 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.6800 100
macro avg 0.3618 0.3967 0.3570 100
weighted avg 0.6812 0.6800 0.6627 100
|
| 0.0168 | 7.0 | 1204 | 0.5918 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8462 1.0000 0.9167 22
GENHX 0.7727 0.8500 0.8095 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.5000 1.0000 0.6667 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 0.7500 0.6000 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7100 100
macro avg 0.3971 0.4517 0.4035 100
weighted avg 0.6691 0.7100 0.6776 100
|
| 0.0168 | 8.0 | 1376 | 0.6426 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.3333 0.7500 0.4615 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.7391 0.8500 0.7907 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4286 0.7500 0.5455 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.3333 0.3333 0.3333 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.6800 100
macro avg 0.3374 0.3744 0.3401 100
weighted avg 0.6542 0.6800 0.6548 100
|
| 0.0098 | 9.0 | 1548 | 0.6204 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8462 1.0000 0.9167 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6667 0.8571 0.7500 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7300 100
macro avg 0.4561 0.4855 0.4463 100
weighted avg 0.6953 0.7300 0.6968 100
|
| 0.0098 | 10.0 | 1720 | 0.6086 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.3333 0.2500 0.2857 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8750 0.9545 0.9130 22
GENHX 0.7273 0.8000 0.7619 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.8333 0.7143 0.7692 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.3333 0.3333 0.3333 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4183 0.4469 0.4156 100
weighted avg 0.6820 0.7000 0.6777 100
|
| 0.0098 | 11.0 | 1892 | 0.6412 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8400 0.9545 0.8936 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6667 0.8571 0.7500 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.3985 0.4416 0.4013 100
weighted avg 0.6648 0.7000 0.6676 100
|
| 0.0056 | 12.0 | 2064 | 0.5978 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8750 0.9545 0.9130 22
GENHX 0.7619 0.8000 0.7805 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6667 0.8571 0.7500 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8000 1.0000 0.8889 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7100 100
macro avg 0.4512 0.4666 0.4376 100
weighted avg 0.6836 0.7100 0.6816 100
|
| 0.0056 | 13.0 | 2236 | 0.6510 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.7273 0.8000 0.7619 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4265 0.4594 0.4256 100
weighted avg 0.6774 0.7000 0.6756 100
|
| 0.0056 | 14.0 | 2408 | 0.6665 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8750 0.9545 0.9130 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4232 0.4594 0.4231 100
weighted avg 0.6796 0.7000 0.6761 100
|
| 0.0054 | 15.0 | 2580 | 0.6430 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.6000 0.7500 0.6667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.5000 0.5000 0.5000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.7273 0.8000 0.7619 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4265 0.4594 0.4256 100
weighted avg 0.6774 0.7000 0.6756 100
|
| 0.0054 | 16.0 | 2752 | 0.6588 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.7619 0.8000 0.7805 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7100 100
macro avg 0.4565 0.4761 0.4448 100
weighted avg 0.6954 0.7100 0.6880 100
|
| 0.0054 | 17.0 | 2924 | 0.6742 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.3333 0.5000 0.4000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.5000 1.0000 0.6667 1
FAM/SOCHX 0.8400 0.9545 0.8936 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 1.0000 0.6667 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4181 0.4594 0.4219 100
weighted avg 0.6726 0.7000 0.6736 100
|
| 0.0026 | 18.0 | 3096 | 0.6810 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8400 0.9545 0.8936 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5714 1.0000 0.7273 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4467 0.4594 0.4299 100
weighted avg 0.6871 0.7000 0.6797 100
|
| 0.0026 | 19.0 | 3268 | 0.6769 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8400 0.9545 0.8936 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 1.0000 0.6667 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7000 100
macro avg 0.4431 0.4594 0.4269 100
weighted avg 0.6842 0.7000 0.6773 100
|
| 0.0026 | 20.0 | 3440 | 0.6790 | precision recall f1-score support
ALLERGY 1.0000 0.5000 0.6667 4ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.5000 0.7500 0.6000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 1.0000 0.5000 0.6667 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.3333 1.0000 0.5000 1
FAM/SOCHX 0.8400 0.9545 0.8936 22
GENHX 0.8000 0.8000 0.8000 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6250 0.7143 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 1.0000 0.6667 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8750 0.6364 0.7368 11
accuracy 0.7100 100
macro avg 0.4514 0.4761 0.4402 100
weighted avg 0.6892 0.7100 0.6853 100
|
Framework versions
- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.1
- Tokenizers 0.15.0
