Views
No views yet
Pstar seed 1337Pstar1337amosluna/babylm-2026-pstar-seed1337eng=0.159, nld=0.258, zho=0.58365536000010117.415275096893 sruns/2026-06-01_Pstar_seed133724 intermediate checkpoints as branches following
the BabyLM 2026 naming convention: chck_1M, chck_2M, ..., chck_10M, chck_20M, ..., chck_100M, chck_200M, ..., chck_600M. The eval pipeline at
babylm-org/babylm-eval pulls
these revisions automatically with:1bash multilingual/scripts/zeroshot_model_fast_all.sh \
2 --model_name amosluna/babylm-2026-pstar-seed13371from transformers import AutoModelForCausalLM, AutoTokenizer
2
3tok = AutoTokenizer.from_pretrained("amosluna/babylm-2026-pstar-seed1337")
4model = AutoModelForCausalLM.from_pretrained("amosluna/babylm-2026-pstar-seed1337") # final checkpoint
5# Intermediate checkpoint:
6# model = AutoModelForCausalLM.from_pretrained("amosluna/babylm-2026-pstar-seed1337", revision="chck_100M")normalized_excess_loss (v1, delta-based) and
cross_lingual_deficit (v2, level-based).1@inproceedings{taam2026,
2 title = {Typology-Aware Adaptive Mixing for Multilingual BabyLMs},
3 author = {Luna, Amos and collaborators},
4 year = {2026},
5 booktitle = {Proceedings of the BabyLM Workshop at EMNLP 2026}
6}