This is a GPT2 Model, but only with the architecture, no pre-trained weights, biases, attention, etc.

This is useful for researchers who want to play with training the model (not tuning).

Generated via the github repo Model Architecture Generator

First go into the directory of the model,

path_model_out is just the output path of the newly randomnized model.