This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
DARE TIES merge method using
TeeZee/DarkForest-20B-v2.0 as a base.
1models:
2 - model: TeeZee/DarkForest-20B-v2.0
3 - model: athirdpath/Harmonia-20B
4 parameters:
5 weight: 0.5
6 density: 1.0
7 - model: TeeZee/BigMaid-20B-v1.0
8 parameters:
9 weight: 0.5
10 density: 1.0
11merge_method: dare_ties
12base_model: TeeZee/DarkForest-20B-v2.0
13parameters:
14 int8_mask: true
15dtype: bfloat16
16name: maiden_unquirked
