Pretrained model on English language using a causal language modeling (CLM) objective. It was introduced in
this paper
and first released at
this page.
You can use the raw model for text generation or fine-tune it to a downstream task.
The training data used for this model contains a lot of unfiltered content from the internet, which is far from neutral. Because large-scale language models like GPT-2 do not distinguish fact from fiction, use-cases that require the generated text to be true are not supported, and the model reflects the biases inherent in its training data. This bias will also affect all fine-tuned versions of this model.
This model is licensed under the MIT license.
