The EmoSense-ID is a model designed to identify and analyze emotions in Indonesian texts based on Plutchik's eight basic emotions: Anticipation, Anger, Disgust, Fear, Joy, Sadness, Surprise, and Trust.
This model is developed using the NusaBERT-base and trained using Indonesian tweets categorized into eight emotion categories. The evaluation results of this model can be utilized to analyze emotions in social media, providing insights into users' emotional responses.
Bias
Keep in mind that this model is trained using certain data which may cause bias in the emotion classification process. Therefore, it is important to consider and account for such biases when using this model.
Evaluation Results
The model was trained using the Hyperparameter Tuning technique with Optuna. In this process, Optuna conducted five trials to determine the optimal combination of learning rate (1e-6 to 1e-4) and weight decay (1e-6 to 1e-2). Each trial trained the BERT model with different hyperparameter configurations on the training dataset and then evaluated using the validation dataset. After all the experiments are completed, the best hyperparameter combination is used to train the final model.
Epoch
Training Loss
Validation Loss
Accuracy
F1
Precision
Recall
1
0.758400
0.583508
0.829932
0.830203
0.833136
0.829932
2
0.370100
0.394630
0.866213
0.865496
0.870364
0.866213
3
0.231500
0.355294
0.884354
0.884585
0.888140
0.884354
4
0.071000
0.322376
0.902494
0.902801
0.904842
0.902494
5
0.129900
0.308596
0.900227
0.900340
0.902132
0.900227
Citation
@misc{Ardiyanto_Mikhael_2024,
author = {Mikhael Ardiyanto},
title = {EmoSense-ID},
year = {2024},
URL = {Aardiiiiy/EmoSense-ID-Indonesian-Emotion-Classifier},
publisher = {Hugging Face}
}
