You can deploy this model and start earning money today!

deanngkl/
vit-tiny-fer

Name: vit-tiny-fer
Rating: 2.5 (10 reviews)

tensorboard

onnx

deanngkl/ferplus-7cls

deanngkl/raf-db-7emotions

deanngkl/affectnet_no_contempt

WinKawaks/vit-tiny-patch16-224

quantized

apache-2.0

Views

No views yet

Vision Transformer for Facial Expression Classifier

A deep learning project that fine-tunes a Vision Transformer (ViT-Tiny) model for 7-class facial emotion classification using cleaned versions of FER+, AffectNet, and RAF-DB datasets.

📌 Project Highlights

🔍 7-class emotion classification: ['anger', 'disgust', 'fear', 'happiness', 'neutral', 'sadness', 'surprise']
🧠 Model: ViT-Tiny (timm implementation)
🎯 Achieved 82% validation accuracy on a blended hold-out set (8 377 images)
📚 Cleaned & uploaded datasets to Hugging Face Datasets
🧪 Integrated CutMix, cosine decay scheduler, and AMP for training

📦 Datasets

Dataset	Link	Notes
FER+	Hugging Face	Filtered to 7 basic emotions
AffectNet	Hugging Face	Removed 'contempt' class
RAF-DB	Hugging Face	Added proper emotion labels

The total amount of datasets

html

Loaded 75398 training samples from 3 sources
Loaded 8377 validation samples from 3 sources
Training-set distribution:
  0: 0 : 9738
  1: 1 : 3385
  2: 2 : 4313
  3: 3 : 18315
  4: 4 : 20987
  5: 5 : 9289
  6: 6 : 9371
Emotion batch torch.Size([64, 3, 224, 224])

🙋‍♂️ Author

Dean Ng Kwan Lung

Blog : Portfolio
LinkedIn : LinkedIn
GitHub : GitHub
Email : kwanlung123@gmail.com

deanngkl/vit-tiny-fer

Vision Transformer for Facial Expression Classifier

📌 Project Highlights

📦 Datasets

Dean Ng Kwan Lung

deanngkl/
vit-tiny-fer