classification-flan-t5-large-enriched – AI Model by sarahahtee | AlphaNeural AI

You can deploy this model and start earning money today!

sarahahtee/
classification-flan-t5-large-enriched

like

0

generated_from_trainer

google/flan-t5-large

Views

No views yet

classification-flan-t5-large-enriched

This model is a fine-tuned version of google/flan-t5-large on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.3456
Classification Report: precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11

accuracy 0.6500 100 macro avg 0.3476 0.3545 0.3244 100 weighted avg 0.6303 0.6500 0.6070 100

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 7
eval_batch_size: 7
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
No log	1.0	172	1.2904	precision recall f1-score support

ALLERGY 0.0000 0.0000 0.0000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.5000 0.1818 0.2667 22 Follow-up 0.0000 0.0000 0.0000 0 GENHX 0.1948 0.7500 0.3093 20 GYNHX 0.0000 0.0000 0.0000 1 HEALTH 0.0000 0.0000 0.0000 0 HEALTHCARE 0.0000 0.0000 0.0000 0 HISTORY 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICAL 0.0000 0.0000 0.0000 0 MEDICATIONS 0.0000 0.0000 0.0000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PAST-HELEN 0.0000 0.0000 0.0000 0 PAST-HELSOX 0.0000 0.0000 0.0000 0 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.0000 0.0000 0.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11

 accuracy                         0.1900       100
macro avg     0.0257    0.0345    0.0213       100

weighted avg 0.1490 0.1900 0.1205 100 | | No log | 2.0 | 344 | 0.8167 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7143 0.4545 0.5556 22 Follow-UP 0.0000 0.0000 0.0000 0 GENHX 0.2586 0.7500 0.3846 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICAL 0.0000 0.0000 0.0000 0 MEDICALHX 0.0000 0.0000 0.0000 0 MEDICATION 0.0000 0.0000 0.0000 0 MEDICATIONS 0.5000 0.4286 0.4615 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.5000 0.1250 0.2000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SSRI 0.0000 0.0000 0.0000 0 SURGICAL 0.0000 0.0000 0.0000 0

 accuracy                         0.3000       100
macro avg     0.1143    0.0772    0.0770       100

weighted avg 0.3239 0.3000 0.2635 100 | | 1.7766 | 3.0 | 516 | 0.6617 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8235 0.6364 0.7179 22 GENHX 0.3455 0.9500 0.5067 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICALHX 0.0000 0.0000 0.0000 0 MEDICATIONS 0.4545 0.7143 0.5556 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.5000 0.2500 0.3333 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SSRI 0.0000 0.0000 0.0000 0 SURGICAL 0.0000 0.0000 0.0000 0

 accuracy                         0.4100       100
macro avg     0.1358    0.1218    0.1093       100

weighted avg 0.3621 0.4100 0.3408 100 | | 1.7766 | 4.0 | 688 | 0.5475 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8235 0.6364 0.7179 22 GENHX 0.3600 0.9000 0.5143 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5455 0.8571 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.1250 0.2500 0.1667 4 PASTSURGICAL 0.5714 0.5000 0.5333 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SURGICAL 0.0000 0.0000 0.0000 0

 accuracy                         0.4400       100
macro avg     0.1631    0.1616    0.1428       100

weighted avg 0.3821 0.4400 0.3728 100 | | 1.7766 | 5.0 | 860 | 0.4635 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9000 0.8182 0.8571 22 GENHX 0.4186 0.9000 0.5714 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3000 0.7500 0.4286 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11

 accuracy                         0.5500       100
macro avg     0.2352    0.2231    0.2022       100

weighted avg 0.4815 0.5500 0.4788 100 | | 0.3502 | 6.0 | 1032 | 0.4271 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 1.0000 0.9091 0.9524 22 GENHX 0.5000 0.8500 0.6296 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5000 1.0000 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.0909 0.1667 11

 accuracy                         0.5900       100
macro avg     0.2818    0.2470    0.2171       100

weighted avg 0.6150 0.5900 0.5254 100 | | 0.3502 | 7.0 | 1204 | 0.4207 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 1.0000 0.8182 0.9000 22 GENHX 0.5517 0.8000 0.6531 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5385 1.0000 0.7000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.1818 1.0000 0.3077 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

 accuracy                         0.5800       100
macro avg     0.3255    0.2902    0.2595       100

weighted avg 0.6364 0.5800 0.5401 100 | | 0.3502 | 8.0 | 1376 | 0.4131 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.4857 0.8500 0.6182 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5385 1.0000 0.7000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6100       100
macro avg     0.3020    0.2966    0.2728       100

weighted avg 0.5827 0.6100 0.5534 100 | | 0.2592 | 9.0 | 1548 | 0.3828 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.2500 0.2222 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5152 0.8500 0.6415 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5833 1.0000 0.7368 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6200       100
macro avg     0.3069    0.3079    0.2806       100

weighted avg 0.5886 0.6200 0.5628 100 | | 0.2592 | 10.0 | 1720 | 0.3815 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.1667 0.2500 0.2000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5312 0.8500 0.6538 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6200       100
macro avg     0.3085    0.3079    0.2820       100

weighted avg 0.5942 0.6200 0.5672 100 | | 0.2592 | 11.0 | 1892 | 0.3728 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6300       100
macro avg     0.3204    0.3322    0.2996       100

weighted avg 0.6095 0.6300 0.5821 100 | | 0.2124 | 12.0 | 2064 | 0.3739 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6300       100
macro avg     0.3388    0.3480    0.3146       100

weighted avg 0.6166 0.6300 0.5850 100 | | 0.2124 | 13.0 | 2236 | 0.3561 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6300       100
macro avg     0.3204    0.3322    0.2996       100

weighted avg 0.6095 0.6300 0.5821 100 | | 0.2124 | 14.0 | 2408 | 0.3784 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5862 0.8500 0.6939 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6400       100
macro avg     0.3295    0.3344    0.3049       100

weighted avg 0.6285 0.6400 0.5964 100 | | 0.1926 | 15.0 | 2580 | 0.3545 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9545 0.9545 0.9545 22 GENHX 0.5862 0.8500 0.6939 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7000 1.0000 0.8235 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6500       100
macro avg     0.3266    0.3365    0.3064       100

weighted avg 0.6196 0.6500 0.5981 100 | | 0.1926 | 16.0 | 2752 | 0.3393 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.1818 0.5000 0.2667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.6250 0.7500 0.6818 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11

 accuracy                         0.6300       100
macro avg     0.3262    0.3340    0.3028       100

weighted avg 0.6332 0.6300 0.5982 100 | | 0.1926 | 17.0 | 2924 | 0.3464 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9545 0.9545 0.9545 22 GENHX 0.5769 0.7500 0.6522 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11

 accuracy                         0.6500       100
macro avg     0.3312    0.3402    0.3122       100

weighted avg 0.6338 0.6500 0.6131 100 | | 0.1771 | 18.0 | 3096 | 0.3489 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11

 accuracy                         0.6500       100
macro avg     0.3476    0.3545    0.3244       100

weighted avg 0.6303 0.6500 0.6070 100 | | 0.1771 | 19.0 | 3268 | 0.3489 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11

 accuracy                         0.6500       100
macro avg     0.3476    0.3545    0.3244       100

weighted avg 0.6303 0.6500 0.6070 100 | | 0.1771 | 20.0 | 3440 | 0.3456 | precision recall f1-score support

ALLERGY 1.0000 0.2500 0.4000 4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11

 accuracy                         0.6500       100
macro avg     0.3476    0.3545    0.3244       100

weighted avg 0.6303 0.6500 0.6070 100 |

Framework versions

PEFT 0.8.2
Transformers 4.37.2
Pytorch 2.1.0+cu121
Datasets 2.17.1
Tokenizers 0.15.2