This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
Model Stock merge method using
yamatazen/EtherealAurora-12B-v2 as a base.
1merge_method: model_stock
2base_model: yamatazen/EtherealAurora-12B-v2
3
4models:
5
6 - model: SicariusSicariiStuff/Impish_Nemo_12B
7 - model: SicariusSicariiStuff/Impish_Longtail_12B
8 - model: G:\Merged-Models\Hex-Core-12B
9 - model: G:\Merged-Models\Warp-Lotus-12B
10
11parameters:
12 normalize: true
13
14tokenizer:
15 source: base
16
17dtype: bfloat16
18out_dtype: bfloat16
19
