Personality, creativity, narrative drive, humor, and slightly unhinged energy.
This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
DELLA merge method using
Entropicengine/Pinecone-Titan-70b as a base.
1models:
2 - model: models/Pinecone-Titan-70b
3 name: titan
4 parameters:
5 weight: 0.5
6 density: 0.25
7 epsilon: 0.05
8 - model: models/GoldDiamondGold-L33-70b
9 name: gold
10 parameters:
11 weight: 0.25
12 density: 0.35
13 epsilon: 0.05
14 - model: models/Sao10K-Euryale-v2.1-70B-labmod
15 name: euryale
16 parameters:
17 weight: 0.25
18 density: 0.35
19 epsilon: 0.05
20merge_method: della
21base_model: models/Pinecone-Titan-70b
22parameters:
23 lambda: 0.7
24dtype: float32
25out_dtype: bfloat16
26tokenizer:
27 source: union
28 target: base
29
