This is a merge of pre-trained language models created using
mergekit.
This model was merged using the task_anysize merge method using
senseable/WestLake-7B-v2 as a base.
1base_model:
2 model:
3 path: senseable/WestLake-7B-v2
4dtype: bfloat16
5merge_method: task_anysize
6slices:
7- sources:
8 - layer_range: [0, 32]
9 model:
10 model:
11 path: chargoddard/piano-medley-7b
12 parameters:
13 weight: 0.55
14 - layer_range: [0, 32]
15 model:
16 model:
17 path: senseable/WestLake-7B-v2
Detailed results can be found
here
