You can deploy this model and start earning money today!

blackhao0426/
dagformer-scaling-300m-baseline

Name: dagformer-scaling-300m-baseline
Availability: InStock

safetensors

olmo2

Views

No views yet

dagformer-scaling-300m-baseline

Dense OLMo-2 300M baseline for DAGFormer scaling study. Public.

Chinchilla tokens, trained on Dolma v1_7 (books + c4-filtered)
Final ckpt at repo root in HF format (AutoModelForCausalLM-loadable)
All saved ckpts under ckpts/ (raw .pt, includes optimizer state)

Load final (recommended)

python

from transformers import AutoModelForCausalLM, AutoTokenizer
m = AutoModelForCausalLM.from_pretrained("blackhao0426/dagformer-scaling-300m-baseline")
tok = AutoTokenizer.from_pretrained("blackhao0426/dagformer-scaling-300m-baseline")