zai-org/

LongWriter-6k

🤗 [LongWriter Dataset] • 💻 [Github Repo] • 📃 [LongWriter Paper]

LongWriter-6k dataset contains 6,000 SFT data with ultra-long output ranging from 2k-32k words in length (both English and Chinese). The data can support training LLMs to extend their maximum output window size to 10,000+ words.

We open-sourced the following list of models trained on LongWriter-6k:

Model Huggingface Repo Description

LongWriter-glm4-9b 🤗… See the full description on the dataset page: https://huggingface.co/datasets/zai-org/LongWriter-6k.