Views
No views yet
olmo1b_hf_{checkpoint}_{train_dataset}_{epoch}_{lr}.
To load a specific model checkpoint, use the following command.model = AutoModelForCausalLM.from_pretrained(
model_name_or_path="KaiserWhoLearns/PTvsSFT_OLMo1b",
trust_remote_code=trust_remote_code,
revision="your revision"
)@article{sun2024amuro,
title={Amuro \& char: Analyzing the relationship between pre-training and fine-tuning of large language models},
author={Sun, Kaiser and Dredze, Mark},
journal={arXiv preprint arXiv:2408.06663},
year={2024}
}