This example demonstrates how to implement text generation with a miniature GPT model. The model consists of a single Transformer block with causal masking in its attention layer.
IMDB sentiment classification dataset for training. The model generates new movie reviews for a given prompt.