Max Ctx. Tokens - 4096
Amount to Gen. - 280
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the passthrough merge method.
1slices:
2 - sources:
3 - model: Undi95/PsyMedRP-v1-13B
4 layer_range: [0, 16]
5 - sources:
6 - model: Undi95/Xwin-MLewd-13B-V0.2
7 layer_range: [8, 24]
8 - sources:
9 - model: Undi95/PsyMedRP-v1-13B
10 layer_range: [17, 32]
11 - sources:
12 - model: Undi95/Xwin-MLewd-13B-V0.2
13 layer_range: [25, 40]
14merge_method: passthrough
15dtype: float16
