Here is the continual pre-training dataset. The Llama-3-SynE model is available here.
🌟🌟 2024/12/17: We released the code used for continual pre-training and data preparation. The code contains detailed documentation comments.
✨✨ 2024/08/12: We released the continual pre-training dataset.
✨✨ 2024/08/10: We released the Llama-3-SynE model.
✨ 2024/07/26: We released the technical report, welcome to check it… See the full description on the dataset page:
https://huggingface.co/datasets/RUC-AIBOX/Llama-3-SynE-Dataset.