For detailed usage and codes, please visit the Github project.
[2023.10.8] We release the long instruction-following dataset, LongAlpaca-12k and the corresponding models, LongAlpaca-7B, LongAlpaca-13B, and LongAlpaca-70B.
(The previous sft models, Llama-2-13b-chat-longlora-32k-sft and Llama-2-70b-chat-longlora-32k-sft, have been depreciated.)
[2023.10.3] We add support GPTNeoX models. Please refer to this PR for… See the full description on the dataset page:
https://huggingface.co/datasets/Yukang/LongAlpaca-12k.
