Will probably merge it with more models in the future.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the passthrough merge method.
1dtype: bfloat16
2merge_method: passthrough
3slices:
4- sources:
5 - layer_range: [0, 10]
6 model: Aryanne/Astrea-RP-v1.5-3B
7- sources:
8 - layer_range: [10, 14]
9 model: jeiku/Refined_3B
10- sources:
11 - layer_range: [7, 14]
12 model: Aryanne/Astrea-RP-v1-3B
13- sources:
14 - layer_range: [13, 19]
15 model: jeiku/Refined_3B
16- sources:
17 - layer_range: [18, 25]
18 model: Aryanne/Astrea-RP-v1-3B
19- sources:
20 - layer_range: [18, 22]
21 model: jeiku/Refined_3B
22- sources:
23 - layer_range: [22, 32]
24 model: Aryanne/Astrea-RP-v1.5-3B
I think zephyr license applies to this merge, for non commercial use.
