This is a merge of pre-trained language models created using
mergekit.
This model was merged using the task_swapping merge method using
Aryanne/SuperHeartBerg as a base.
1base_model:
2 model:
3 path: Aryanne/SuperHeartBerg
4dtype: bfloat16
5merge_method: task_swapping
6slices:
7- sources:
8 - layer_range: [0, 32]
9 model:
10 model:
11 path: KoboldAI/Llama-3.1-8B-BookAdventures
12 parameters:
13 diagonal_offset: 7.0
14 weight: 0.666
15 - layer_range: [0, 32]
16 model:
17 model:
18 path: Aryanne/SuperHeartBerg
19
