sail/

sailcraft_lm_resource

This repository provides the data processing model for large language model training.

Project Website: sailorllm.github.io Codebase: github.com/sail-sg/sailcraft Technical Report: arxiv.org/pdf/2404.03608.pdf

Thanks to the contributors of the following projects:

text-dedup exact-dedup bigscience-data-preparation bigscience-data-tooling

If you use this repository or sailor… See the full description on the dataset page: https://huggingface.co/datasets/sail/sailcraft_lm_resource.