This model trains
T5-V1_1-base on the Qazaq dataset of
Oscar. Note that the original configuration is slightly change (dropout is set to 0).
The official
run_t5_mlm_flax.py is copied into the repository and is run using the hyperparameters as defined in
run_t5.sh.