This model is designed to classify customer service inquiries into five categories: Technical Issues, Billing & Payment, Product Inquiries, Account Management, and Policy Questions.
The model was trained on a balanced dataset of 53000 entries composed of anonymized customer service inquiries. Each category contained a similar number of examples to prevent class imbalance.
https://github.com/amosproj/amos2023ws01-ticket-chat-ai/tree/main/Backend/app/model/test_data/test_data_with_gpt
The model was fine-tuned over four epochs for a sequence classification task. We utilized a batch size of 4 and an Adam optimizer with a learning rate of 2e-5.
The model's performance was evaluated using a confusion matrix and a learning curve, as detailed below: