Quantization made by Richard Erkhov.
In the same vein as the legendary
Psyonic-Cetacean-20B, I have attempted to create a 13B model that is equal parts creative and chaotic, while still remaining coherent enough for roleplaying purposes.
Seven different Llama-2 13B models were hand-picked and merged via TIES to create three separate components for the final stack.
Emotional intelligence and coherency were the primary focus of the late-stage manual testing that led to selecting this model.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the passthrough merge method.
1slices:
2 - sources:
3 - model: FallenMerick/XNoroChronos-Orca2-Noromaid
4 layer_range: [0, 16]
5 - sources:
6 - model: FallenMerick/EstopianMaid-Orca2-MlewdBoros
7 layer_range: [16, 24]
8 - sources:
9 - model: FallenMerick/Psyfighter2-Orca2-Erebus3
10 layer_range: [24, 40]
11merge_method: passthrough
12dtype: bfloat16