This is a German Tinyllama 1B language model trained from scratch using the
Tinyllama codebase on the German portion of
RedPajama V2.
Find more details on our
page and our
preprint!
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained("LSX-UniWue/LLaMmlein_1B")
4
5tokenizer = AutoTokenizer.from_pretrained("LSX-UniWue/LLaMmlein_1B")
We evaluated our results on the
SuperGLEBer benchmark.
Data Take Down
