This is an artifact of the SNAILS project. We finetuned google/canine-s to perform the task of word naturalness classification.
Full (unabbreviated) words are "Regular" naturalness (labeled as N1). Somewhat abbreviated words are "Low" naturalness (labeled as N2).
Very abbreviated or indecipherable words are "Least" naturalness (labeled as N3).
Inference using this model requires a token tagging pre-processing step. This is provided in tokenprocessing.py.
To most easily use this model, download the snails_naturalness_classifier.py and tokenprocessing.py files in this
repository and run snails_naturalness_classifier.py.