SnakModel is a 7B-parameter, autoregressive language model specifically designed for Danish. There are both an instruction-tuned variant, as well as a base version for further fine-tuning. Our models build upon Llama 2, which we continuously pre-train on a diverse collection of Danish corpora.
Developers
🧭 NLPnorth research unit at the IT University of Copenhagen, Denmark.🌊 AAU-NLP research unit at Aalborg University Copenhagen, Denmark.
Mike Zhang*, Max Müller-Eberstein*… See the full description on the dataset page:
https://huggingface.co/datasets/NLPnorth/snakmodel-pretraining-data-v0.1.
