Views
No views yet
distilroberta and fine-tuned with 10 categories using Transfer Learning for classifying emotion in English language examples in a curated dataset deriving emotional clusters using dimensions of Subjectivity, Relativity, and Generativity. An additional dimension of Clarity was removed, while still Compassion, using rate of change to linearize the data, was used to map seven population clusters of ontological experiences categorized and represented by emojis as Trust or Love, Happiness or Pleasure, Jealousy or Envy, Shame or Guilt, Anger or Disgust, Fear or Anxiety, and Sadness or Trauma. Edge cases, neutrality, and simple sentiments, such as positive and negative, are also used as null cases in classification theorized by OME.| Description | Label |
|---|---|
| Trust or Love | 🥰 |
| Happiness or Pleasure | 🤩 |
| Positive | 🙂 |
| Neutral | 😐 |
| Negative | 🙁 |
| Jealousy or Envy | 😒 |
| Shame or Guilt | 😦 |
| Anger or Disgust | 😠 |
| Fear or Anxiety | 😨 |
| Sadness or Trauma | 😭 |
python run_classification.py \
--model_name_or_path distilbert/distilroberta-base \
--dataset_name databoyface/omemoji-src-v0.1 \
--shuffle_train_dataset true \
--metric_name accuracy \
--text_column_name text \
--label_column_name label \
--do_train \
--do_eval \
--do_predict \
--max_seq_length 256 \
--per_device_train_batch_size 64 \
--learning_rate 1e-5 \
--num_train_epochs 15 \
--output_dir ./distilroberta-base-omemoji-v0.1/ ***** train metrics *****
epoch = 15.0
total_flos = 8835777GF
train_loss = 0.5051
train_runtime = 3:11:42.38
train_samples = 9548
train_samples_per_second = 12.451
train_steps_per_second = 0.196
***** eval metrics *****
{
"epoch": 15.0,
"eval_accuracy": 0.9549248747913188,
"eval_loss": 0.14957648515701294,
"eval_runtime": 60.9791,
"eval_samples": 2396,
"eval_samples_per_second": 39.292,
"eval_steps_per_second": 4.92
}