Views
No views yet
TAAM seed 42TAAM42amosluna/babylm-2026-taam-seed42eng=0.367, nld=0.555, zho=0.07865536000010177.314262628555 sruns/2026-05-13_TAAM_seed4224 intermediate checkpoints as branches following
the BabyLM 2026 naming convention: chck_1M, chck_2M, ..., chck_10M, chck_20M, ..., chck_100M, chck_200M, ..., chck_600M. The eval pipeline at
babylm-org/babylm-eval pulls
these revisions automatically with:1bash multilingual/scripts/zeroshot_model_fast_all.sh \
2 --model_name amosluna/babylm-2026-taam-seed421from transformers import AutoModelForCausalLM, AutoTokenizer
2
3tok = AutoTokenizer.from_pretrained("amosluna/babylm-2026-taam-seed42")
4model = AutoModelForCausalLM.from_pretrained("amosluna/babylm-2026-taam-seed42") # final checkpoint
5# Intermediate checkpoint:
6# model = AutoModelForCausalLM.from_pretrained("amosluna/babylm-2026-taam-seed42", revision="chck_100M")normalized_excess_loss (v1, delta-based) and
cross_lingual_deficit (v2, level-based).1@inproceedings{taam2026,
2 title = {Typology-Aware Adaptive Mixing for Multilingual BabyLMs},
3 author = {Luna, Amos and collaborators},
4 year = {2026},
5 booktitle = {Proceedings of the BabyLM Workshop at EMNLP 2026}
6}