This model was finetuned on squad dataset.
Use TFDistilBertForQuestionAnswering to import model.
Requires DistilBertTokenizerFast to generate tokens that are accepted by this model.
Model description
Base DistilBERT model finetuned using squad dataset for NLP tasks such as context based question answering.
Training procedure
Trained for 3 epochs.
Training hyperparameters
The following hyperparameters were used during training:
optimizer: Adam with learning_rate=5e-5
training_precision: float32
Training results
Loss on final epoch: 0.6417 & validation loss: 1.2772
evaluation yet to be done.
