This is the largest release of GPT-NoSleep; a finetuned version of
GPT2-XL on the 'reddit-nosleep-posts' dataset.
Smaller releases include:
This was trained on the 'reddt-nosleep-posts' dataset, on Google Colab.
This model was trained for 2 epochs with learning rate 1e-2.
Special thanks for Skyler for helping to train this large of a model!
This likely contains the same biases and limitations as the original GPT2 that it is based on, and additionally heavy biases from the dataset.
It can generate output that is not meant for all audiences, seeing as it's purpose is to generate horror stories.
This model is meant for fun, nothing else.