This dataset contains articles and corresponding summaries for training and evaluating summarization models. The articles are taken from the CNN/DailyMail dataset, and additional custom examples are included.
The dataset was compiled using the CNN/DailyMail dataset version 3.0.0. The articles were chosen based on their relevance to summarization tasks. Custom examples were added to provide additional training data.
1from datasets import load_from_disk
2
3# Load the custom dataset
4train_dataset = load_from_disk('./results/custom_dataset/train')
5test_dataset = load_from_disk('./results/custom_dataset/test')
6
