An in-domain GPT-2, pre-trained from scratch on the IMDb dataset text.
This model is based on the
GPT-2
architecture and was pre-trained from scratch (in-domain) using the text in IMDb dataset, excluding its test split.
Intermediate checkpoints from the pre-training process are available and can be accessed using specific tags,
which correspond to training epochs and steps:
1from transformers import AutoModelForCausalLM
2
3model = AutoModelForMaskedLM.from_pretrained("<model-name>", revision="<checkpoint-tag>")
For more details on the training procedure, please refer to the base model's documentation:
Training procedure.
All texts from IMDb dataset, excluding the test partition.
For typical use cases and limitations, please refer to the base model's guidance:
Inteded uses & limitations.
This model inherits potential risks and limitations from the base model. Refer to:
Limitations and bias.
