This is a merge of pre-trained language models created using
mergekit.
This model was merged using the breadcrumbs_ties merge method using
Aleteian/base-ground-2 as a base.
1models:
2 - model: Aleteian/base-ground-2
3 parameters:
4 weight: 0.5
5
6 - model: LatitudeGames/Wayfarer-12B
7 parameters:
8 density: 0.95
9 weight: 0.3
10 gamma: 0.01
11
12 - model: elinas/Chronos-Gold-12B-1.0
13 parameters:
14 density: 0.9
15 weight: 0.2
16 gamma: 0.01
17
18merge_method: breadcrumbs_ties
19base_model: Aleteian/base-ground-2
20dtype: bfloat16
21
22tokenizer_source: "union"
23chat_template: "chatml"
24
