Fine-tuned distilbert model. Trained on train set of BC5CDR-disease dataset taken from
BLURB.
Train set of BC5CDR-disease dataset.
Classical fine-tuning.
learning_rate=5e-5
per_device_train_batch_size=16
per_device_eval_batch_size=16
num_train_epochs=3
weight_decay=0.01
Test set of BC5CDR-disease dataset.
