Model Card for Aspect Extraction and Opinion Analysis
This model card serves as a template for new models. It has been generated using
this raw template.
Model Details
Model Description
Aspect Extraction and Opinion Analysis is an academic project developed as part of the CSE6242 course offered by Dr. Polo Chau at Georgia Institute of Technology. This model performs aspect-based sentiment analysis on Amazon product reviews, extracting relevant aspects, grouping them, and determining their respective polarities.
- Developed by: Suraj Mohanrao Hulke
- Experience: 3.5 years in AI/ML
- Funded by [optional]: N/A
- Shared by [optional]: N/A
- Model type: Aspect-Based Sentiment Analysis
- Language(s) (NLP): English
- License: [More Information Needed]
- Finetuned from model [optional]: N/A
Model Sources [optional]
- Repository: GitHub Repository
- Paper [optional]: N/A
- Demo [optional]: N/A
Uses
Direct Use
This model can be directly used to perform sentiment analysis on product reviews to extract aspects and determine their sentiment.
Downstream Use [optional]
The model can be fine-tuned for specific datasets or integrated into larger systems for enhanced sentiment analysis capabilities.
Out-of-Scope Use
The model should not be used for sentiment analysis in languages other than English or for analyzing non-product-related reviews.
Bias, Risks, and Limitations
The model may exhibit biases present in the training data and may not accurately reflect the sentiment for ambiguous or context-dependent reviews.
Recommendations
Users should be aware of potential biases and validate the sentiment analysis results with additional checks or human reviews.
How to Get Started with the Model
Use the code below to get started with the model.
[More Information Needed]
Training Details
Training Data
The training data consists of Amazon product reviews from 1995-2015, available on S3 buckets. The massive size of the dataset presented its own set of challenges.
Training Procedure
The training involves extracting aspect-modifier pairs using dependency parsing and clustering aspects based on word vectors to determine polarity scores.
Preprocessing [optional]
[More Information Needed]
Training Hyperparameters
- Training regime: [More Information Needed]
Speeds, Sizes, Times [optional]
Training time is approximately 7-8 hours for 1M reviews.
Evaluation
Testing Data, Factors & Metrics
Testing Data
[More Information Needed]
Factors
[More Information Needed]
Metrics
[More Information Needed]
Results
[More Information Needed]
Summary
The model showed promise in extracting relevant aspects and determining sentiment but requires improvement in handling ambiguous or context-dependent reviews.
Model Examination [optional]
[More Information Needed]
Environmental Impact
Carbon emissions can be estimated using the
Machine Learning Impact calculator presented in
Lacoste et al. (2019).
- Hardware Type: [More Information Needed]
- Hours used: 7-8 hours
- Cloud Provider: AWS
- Compute Region: [More Information Needed]
- Carbon Emitted: [More Information Needed]
Technical Specifications [optional]
Model Architecture and Objective
[More Information Needed]
Compute Infrastructure
[More Information Needed]
Hardware
[More Information Needed]
Software
[More Information Needed]
Citation [optional]
BibTeX:
[More Information Needed]
APA:
[More Information Needed]
Glossary [optional]
[More Information Needed]
More Information [optional]
[More Information Needed]
Model Card Authors [optional]
Suraj Mohanrao Hulke
Model Card Contact
[More Information Needed]
About the Project
Aspect Extraction and Opinion Analysis is an academic project as a part of the CSE6242 course offered by Dr. Polo Chau at Georgia Institute of Technology.
Important Links of the Project
- Repository: GitHub Repository
- Project Poster: [Link]
- Project Report: [Link]
Project Overview
Opinion mining or sentiment analysis is the computational analysis of a person’s emotion towards entities like products and services. It can be done at three levels: document, sentence, and aspect. We have implemented an aspect-based analysis system to extract various aspects of an entity from Amazon product reviews, group them, and determine their respective polarities.
Why this Project?
Consumers and sellers spend a significant amount of time reading through long reviews to find out what is perceived as good and bad about a product. Amazon's current feature that lets users filter reviews by popular keywords is still tedious and time-consuming. This project aims to simplify this process by automatically identifying opinions on different aspects of a product.
Solution Overview
We broke down the process into submodules:
- Getting the Data Ready: Amazon has made all product reviews from 1995-2015 available on S3 buckets, facilitating the data collection process but presenting challenges due to the massive size of the dataset.
- Identifying Aspects: The objective of this step was to extract instances of product aspects and modifiers expressing opinions about those aspects using dependency parser trees in Python's spaCy package.
- Grouping Aspects into Clusters and Giving Polarity Scores: The extracted aspects were grouped into clusters using word vectors, and polarity scores were assigned based on modifiers.
- Visualizing the Results: An interactive UI was developed to help users gain insights from reviews.
Our Model
Aspect Extraction
The objective of this step was to extract instances of product aspects and modifiers that express opinions about particular aspects. We used dependency parser trees in Python's spaCy package to extract pairs of words based on specific syntactic dependency paths.
Clustering and Polarity Score
Every product has multiple reviews, resulting in numerous aspect-modifier pairs. Different words may be used for similar aspects of a product. We grouped similar aspects into clusters and averaged the polarity scores of the modifiers for each cluster to provide a quantifiable explanation of the opinions.
- Word Vectors and Clustering: We used word vectors to define each word in terms of vectors, enabling us to model relationships intuitively. Clustering was performed using the K-Means algorithm in Scikit-Learn, providing optimal results with four clusters.
- Polarity Scores: Polarity scores were determined using the VADER Sentiment Analysis tool from the NLTK library. Although this metric worked well for unambiguous positive or negative words, it struggled with equivocal adjectives requiring context for interpretation.
Database and Visualization
We hosted the model results on a Microsoft SQL Server database to handle the massive amount of data and facilitate updates. The UI, built using Flask, jQuery, HTML, and D3.js, provides a detailed analysis of the aspects and polarity score results from our model.
Conclusions & Future Work
Conclusions
The model effectively groups similar aspects and determines sentiment but needs improvement in extracting aspects and handling context-dependent polarity scores.
Future Work
- Improving dependency rules.
- Incorporating contextual knowledge for polarity scores.
- Developing a web-plugin for the UI.
- Optimizing the model to reduce training time.
