mattpscott/

airoboros-summarization

This is my adaptation and cleaned version of the Booksum dataset to work with Airoboros by Jon Durbin huggingface I created this dataset for the purposes of improving the LLM capabilities with summarization. It's a core feature that I feel many applications rely on, yet we're still relying on older Longformer, RoBERTa, or BART solutions. This dataset has been altered from the original as follows:

Cleaned up bad formatting, extra quotes at the beginning of summaries, extra line breaks, and… See the full description on the dataset page: https://huggingface.co/datasets/mattpscott/airoboros-summarization.