Views
No views yet
yat-sb+ca 261M ablation
(seed 0 is the canonical published checkpoint). Same architecture, same data, same
hyper-params — only the random seed differs. Useful for variance estimation
when comparing architectures.1from transformers import AutoModelForCausalLM, AutoTokenizer
2m = AutoModelForCausalLM.from_pretrained(
3 "mlnomad/yatnmn-softplus-sb-ca-d12-chinchilla-261M-seed1-pytorch",
4 trust_remote_code=True,
5)
6tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")