Views
No views yet
| Language | Code | F1 Score |
|---|---|---|
| English | en | 0.9071 |
| Russian | ru | 0.9022 |
| Ukrainian | uk | 0.9075 |
| German | de | 0.6528 |
| Spanish | es | 0.7430 |
| Arabic | ar | 0.6207 |
| Amharic | am | 0.6676 |
| Hindi | hi | 0.7171 |
| Chinese | zh | 0.6483 |
| Italian | it | 0.5975 |
| French | fr | 0.9125 |
| Hinglish | hin | 0.7051 |
| Hebrew | he | 0.8911 |
| Japanese | ja | 0.9058 |
| Tatar | tt | 0.5834 |
1import torch
2from transformers import AutoTokenizer, AutoModelForSequenceClassification
3
4tokenizer = AutoTokenizer.from_pretrained('textdetox/glot500-toxicity-classifier')
5model = AutoModelForSequenceClassification.from_pretrained('textdetox/glot500-toxicity-classifier')
6
7batch = tokenizer.encode("You are amazing!", return_tensors="pt")
8
9output = model(batch)
10# idx 0 for neutral, idx 1 for toxic