This model is a fine-tuned version of distilbert-base-uncased on a small subset of the imdb dataset.
This is an experiment that follows the HuggingFace NLP tutorial on masked language modeling and domain adaptation.
Training hyperparameters
The following hyperparameters were used during training:
learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
