Views
No views yet
1models:
2 - model: soramikaduki/Antler-RP-ja-westlake-chatvector
3 parameters:
4 density: 0.5
5 weight:
6 - filter: mlp
7 value: 0.5
8 - value: 0.5
9 # No parameters necessary for base model
10 - model: soramikaduki/Starling-RP-ja-westlake-chatvector
11 parameters:
12 density: 0.5
13 weight:
14 - filter: mlp
15 value: 0.5
16 - value: 0.5
17merge_method: dare_ties
18base_model: soramikaduki/Antler-RP-ja-westlake-chatvector
19parameters:
20 int8_mask: true
21dtype: bfloat16
22tokenizer_source: union
23custom_methods:
24 model.embed_tokens:
25 method: tokenizer_permutation
26 parameters:
27 weight:
28 soramikaduki/Antler-RP-ja-westlake-chatvector: 0.5
29 soramikaduki/Starling-RP-ja-westlake-chatvector: 0.5
30 lm_head:
31 method: tokenizer_permutation
32 parameters:
33 weight:
34 soramikaduki/Antler-RP-ja-westlake-chatvector: 0.5
35 soramikaduki/Starling-RP-ja-westlake-chatvector: 0.5| Model | StarAntler-RP-WestLake-chatvector (This model) |
|---|---|
| Parameters | 7B(Mistral) |
| ELYZAtasks100 average score | 3.16 |