Occiglot-7B-DE-EN is a generative language model with 7B parameters for German and English and trained by the Occiglot Research Collective. It is based on Mistral-7B-v0.1 and trained on 114B tokens of additional multilingual and code data with a block size of 8,192 tokens per sample. Note that the model is a general-purpose base model and was not instruction-fine-tuned nor optimized for chat or other applications.
