NOTE: The adapted checkpoints are only guaranteed to have the samemodel configurationandmodel parametersas the official released models. The other parameters (such astask hyperparametersandoptimizer hyperparameters) are just a template.Therefore, these adapted checkpoints are only suitable to be used as an initialization for fine-tuning in the downstream tasks, NOT for continuing pre-training.