TalkTix/

roberta-base-priority-type-generator-55k

Model Details

Training Data

Training Procedure

Model Performance

• Confusion Matrix Analysis

  

  • High: The model has performed well in classifying high-priority items, with 1800 correct predictions. However, there are 28 instances where high priority is confused with low, 460 with medium, and 84 with very high.
  • Low: There is some confusion in the low-priority classification, with 140 instances classified correctly, but 360 instances confused with medium priority and 200 with very high. The model rarely misclassifies low as high priority.
  • Medium: The model has classified medium priority with moderate accuracy, with 700 correct predictions. However, there's notable confusion with high priority (150 instances) and very high priority (36 instances).
  • Very High: This category shows significant confusion. While the model correctly identifies 410 very high priority instances, it also confuses 5 with low, 160 with high, and 200 with medium.

• Learning Curve Analysis

  

  • Training Loss: This line starts at approximately 0.94 and steadily decreases to around 0.82, indicating that the model is effectively learning from the training data.
  • Validation Loss: The validation loss begins just below 0.90 and decreases slightly after the first epoch, then levels off around 0.86. This behavior suggests that the model is not overfitting since the validation loss is not increasing as the model trains. However, the plateauing of the validation loss also suggests that the model may not be improving significantly after the first epoch.

• Interprating Model's Output:

  • LABEL_0 stands for High
  • LABEL_1 stands for Low
  • LABEL_2 stands for Medium
  • LAVEL_3 stands for Very High