DialoGPT-small finetuned in the Maptask Corpus. The
repository with additionally pre-processed Maptask dialogues of concatenated utterances per speaker, 80/10/10 train/val/test split and metadata, is a fork of the
Nathan Duran's repository. For finetuning the
train_dialogpt.ipynb notebook from Nathan Cooper's
Tutorial was used to finetune the model with slight modifications in Google Collab.
History dialogue context = 5. Number of utterances: 14712 (train set), 1964 (test set), 2017 (val set). Fine-tuning for 3 epochs with batch size 2.
Evaluation perplexity in Maptask from 410.7796 (pre-trainded model) to 19.7469 (fine-tuned model).
