Danish-Swedish Merged Model

1. danish-foundation-models/munin-7b-alpha, continued pretraining on Danish data;
2. timpal0l/Mistral-7B-v0.1-flashback-v2, continued pretraining on Swedish data.

Model Details

• Merged by: Dan Saattrup Nielsen
• Model type: Decoder model, based on mistralai/Mistral-7B-v0.1
• Language(s): Danish and Swedish
• License: CC-BY-4.0
• Merge configuration:
  python

  1dict( 2 models=[ 3 dict( 4 model="danish-foundation-models/munin-7b-alpha", 5 parameters=dict( 6 weight=1.0, 7 density=0.3, 8 ), 9 ), 10 dict( 11 model="timpal0l/Mistral-7B-v0.1-flashback-v2", 12 parameters=dict( 13 weight=1.0, 14 density=0.3, 15 ), 16 ), 17 ], 18 merge_method="dare_ties", 19 random_seed=4242 20 base_model="mistralai/Mistral-7B-v0.1", 21 parameters=dict( 22 int8_mask=True, 23 normalize=True, 24 ), 25 dtype="bfloat16", 26)