image/png
This model seems to be stable. No repetition issues were found.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the Passthrough merge method.
1merge_method: passthrough
2dtype: bfloat16
3slices:
4 - sources:
5 - model: yamatazen/EtherealAurora-12B
6 layer_range: [0,10]
7 - sources:
8 - model: yamatazen/EtherealAurora-12B
9 layer_range: [2,12]
10 - sources:
11 - model: yamatazen/EtherealAurora-12B
12 layer_range: [10,20]
13 - sources:
14 - model: yamatazen/EtherealAurora-12B
15 layer_range: [12,22]
16 - sources:
17 - model: yamatazen/EtherealAurora-12B
18 layer_range: [20,30]
19 - sources:
20 - model: yamatazen/EtherealAurora-12B
21 layer_range: [22,32]
22 - sources:
23 - model: yamatazen/EtherealAurora-12B
24 layer_range: [30,40]
