Views
No views yet
google/flan-t5-base model for Aspect-Category-Opinion-Sentiment (ACOS) tuple extraction from university course reviews.1(aspect | category | opinion | sentiment)
2
3## Live Demo
4
5- Streamlit Demo: https://huggingface.co/spaces/lijinzheyy/acos-extraction-system
6- Fine-tuned Model: https://huggingface.co/lijinzheyy/acos-flan-t5-course-evaluation
7
8##Example input:
9
10The lecturer explains the concepts clearly but the assignments are too difficult.
11
12##Example output:
13
14(lecturer | faculty comprehensiveness | explains the concepts clearly | positive) ; (assignments | course difficulty | too difficult | negative)
15
16##Model
17
18Base model: google/flan-t5-base
19Fine-tuning method: full fine-tuning
20Optimizer: AdamW
21Epochs: 8
22Batch size: 8
23fp16: disabled
24bf16: disabled
25Evaluation
26
27Test set: all-domain OATS-ABSA test set
28
29Model Precision Recall F1
30Random Baseline - - 0.0000
31TF-IDF + kNN Baseline - - 0.0579
32Old deployed model with post-processing 0.2504 0.2147 0.2312
33Final retrained model with post-processing 0.3341 0.2957 0.3137
34Deployment
35
36The model is used in a Streamlit demo deployed on Hugging Face Spaces:
37
38Demo: https://huggingface.co/spaces/lijinzheyy/acos-extraction-system
39GitHub: https://github.com/JinzheLi-AI/ACOS-Extraction-System
40Limitations
41
42The model can still make errors in opinion extraction, category prediction, and sentiment classification. It is designed for course review analysis and may not generalize well to unrelated domains.
43
44##Future Work
45
46Future versions may compare full fine-tuning with LoRA fine-tuning using the same train/dev/test split, post-processing pipeline, and tuple-level exact match evaluation.