The Token-Level Stereotype Classifier is a transformer-based model developed to detect and classify different types of stereotypes present in the text at the token level. It is designed to recognize stereotypical and anti-stereotypical stereotypes towards gender, race, profession, and religion. The model can help in developing applications aimed at mitigating stereotypical language use and promoting fairness and inclusivity in natural language processing tasks.
The model is built using the pretrained Distilbert model. It is fine-tuned on MGS Dataset for the task of token-level classification.
The model can be used as a part of the Hugging Face's pipeline for Named Entity Recognition (NER).
1from transformers import pipeline
2
3nlp = pipeline("ner", model="wu981526092/Token-Level-Stereotype-Detector", tokenizer="wu981526092/Token-Level-Stereotype-Detector")
4result = nlp("Text containing potential stereotype...")
5
6print(result)