This repository contains the code ,models and datasets for our paper NExtLong: Toward Effective Long-Context Training without Long Documents.
[Github]
Overview
NExtLong Models
NExtLong Datasets
Datasets list
How to use NExtLong datasets
Large language models (LLMs) with extended context windows have made significant strides yet remain a… See the full description on the dataset page:
https://huggingface.co/datasets/caskcsg/NExtLong-64K-dataset.