timestamp [string]: The publication datetime of the article.
tags [list of strings]: List of tags associated to the article.
The following are the counts of records in the dataset:
Total dataset size: 192368
Divided into training (100K), validation (1K), test dataset (1K)
Preprocessing:
prefix = "summarize: "
max_input_length = 512
max_target_length = 64
Keeping articles with text length at least 500 & title length at least 20
After preprocessing: training (85639), validation (833), test dataset (850)
Model description
The model used was T5-base.
Training procedure
Full finetuning
from transformers import Seq2SeqTrainingArguments
from transformers import Seq2SeqTrainer
Training hyperparameters
The following hyperparameters were used during training:
