This model card provides details about the DistilBERT-based classifier designed to detect fear speech (FS) in German language Telegram posts. The classifier was developed to study the prevalence and dynamics of FS in the communication of radical and extremist actors on Telegram.
Model Details Model Description
The distilbert_fearspeech_classifier is a fine-tuned DistilBERT model aimed at identifying and classifying fear speech in social media posts, particularly those from radical and extremist groups. It has been trained on a dataset of annotated Telegram posts from far-right, COVID-19 protest, and conspiracy-focused actors.
Developed by: Simon Greipl, Julian Hohner, Heidi Schulze, Patrick Schwabl, Diana Rieger
Model type: DistilBERT for text classification
Language(s) (NLP): German
License: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License
The model is used directly to classify Telegram posts into fear speech (FS) and non-fear speech (no FS) categories. This is particularly useful for researchers studying online radicalization and the dynamics of fear speech in social media.
Downstream Use
The model can be fine-tuned for specific tasks related to hate speech detection, communication studies, and social media analysis.
Out-of-Scope Use
This model should not be used for labeling and penalizing individuals or groups without context or understanding of the nuances in their communication. Misuse could lead to unjust outcomes.
Bias, Risks, and Limitations
The model was trained on data from specific Telegram channels and groups known for their extremist content. Inherent biases in the data may affect the model's predictions. Misuse of the model could lead to labeling and penalizing individuals or groups without proper context.
Users should be aware of the risks, biases, and limitations of the model. Further research and contextual understanding are recommended before using the model for critical decision-making.
How to Get Started with the Model
Use the following code to get started with the model:
python
1from transformers import AutoTokenizer, AutoModelForSequenceClassification
2import torch
34# Load the model and tokenizer5tokenizer = AutoTokenizer.from_pretrained("PatrickSchwabl/distilbert_fearspeech_classifier")6model = AutoModelForSequenceClassification.from_pretrained("PatrickSchwabl/distilbert_fearspeech_classifier")78# Tokenize input text9inputs = tokenizer("Your text here", return_tensors="pt")1011# Get model predictions12outputs = model(**inputs)13predictions = torch.nn.functional.softmax(outputs.logits, dim=-1)1415# Print predictions16print(predictions)17
Training Details Training Data
The model was trained on a dataset of manually annotated Telegram posts from radical and extremist groups. The dataset includes posts related to six crisis-specific topics: COVID-19, Conspiracy Narratives, Russian Invasion of Ukraine (RioU), Energy Crisis, Inflation, and Migration.
Training Procedure
Preprocessing
Data cleaning involved removing emojis, numbers, and hyperlinks.
Posts shorter than ten characters and longer than 1000 characters were excluded.
The evaluation metrics include precision, recall, and F1-score, which are essential for understanding the model's performance in classifying fear speech.
Results
Validation Set Precision: 0.82
Validation Set Recall: 0.82
Validation Set F1-Score: 0.82
Test Set Precision: 0.79
Test Set Recall: 0.79
Test Set F1-Score: 0.79
Summary
The model demonstrated robust performance with balanced precision and recall metrics above 0.76.
BibTex
@article{Greipl2024,
title={"You are doomed!" Crisis-specific and Dynamic Use of Fear Speech in Protest and Extremist Radical Social Movements},
author={Simon Greipl, Julian Hohner, Heidi Schulze, Patrick Schwabl, Diana Rieger},
journal={Journal of Quantitative Description: Digital Media},
volume={4},
year={2024},
doi={10.51685/jqd.2024.icwsm.8}
}
