Danish-Swedish Merged Model

1. danish-foundation-models/munin-7b-alpha, continued pretraining on Danish data;
2. timpal0l/Mistral-7B-v0.1-flashback-v2, continued pretraining on Swedish data.

Model Details

• Merged by: Dan Saattrup Nielsen
• Model type: Decoder model, based on mistralai/Mistral-7B-v0.1
• Language(s): Danish and Swedish
• License: CC-BY-4.0
• Merge configuration:
  python

  1dict( 2 models=[ 3 dict( 4 model="danish-foundation-models/munin-7b-alpha", 5 parameters=dict( 6 weight=1.0, 7 ), 8 ), 9 dict( 10 model="timpal0l/Mistral-7B-v0.1-flashback-v2", 11 parameters=dict( 12 weight=1.0, 13 ), 14 ), 15 ], 16 merge_method="ties", 17 base_model="mistralai/Mistral-7B-v0.1", 18 parameters=dict( 19 int8_mask=True, 20 normalize=True, 21 ), 22 dtype="bfloat16", 23)