research and experimentation with text classifiers
Limitations
This model should not be treated as a perfect moderation system.
Offensiveness can depend heavily on context, intent, quotation, sarcasm, reclaimed language, and the surrounding conversation. The model may therefore produce incorrect predictions for ambiguous or context-dependent text.
For example, a sentence discussing an offensive word may still receive a non-trivial offensive score even when the sentence itself is not an insult.
The model also operates on individual text inputs and does not have access to conversation history unless it is explicitly provided as input.
Example Predictions
Some example inference results:
text
1"b****" # censored
2→ offensive (0.988)
34"you are stupid"
5→ offensive (0.965)
67"the word \"stupid\" is offensive"
8→ offensive (0.695)
910"beach"
11→ clean (0.922)
These examples are illustrative and should not be interpreted as a formal benchmark.
License
See the repository/model files for the applicable license.
Author
Created by akaruineko.
This model is the 2.0 continuation of the bad-good-classifier-ru_en project.