Inspired to learn how to merge by the Nevoria series from
SteelSkull.
This model is the final result of the Genetic Lemonade series.
This model is the second result of the Genetic Lemonade series.
Designed for RP and creative writing, all three models are focused around striking a balance between writing style, creativity and intelligence. The basic differences between the models are below.
Llam@ception recommended for sane defaults if unsure, import them to SillyTavern and they're plug n play.
Temperature last, neutralize other samplers. This model natively strikes a balance of creativity & intelligence.
Llama-3-Instruct-Names but you will need to uncheck "System same as user".
This model was merged using the
SCE merge method.
The base aims to build a strong general purpose model using high performing models that are trained on various datasets from different languages / cultures. This is to reduce the chance of the same datasets appearing multiple times to build natural creativity into L3.3
The second merge aims to impart specific RP / creative writing knowledge, again focusing on trying to find high performing models that use or likely use different datasets.
1models:
2 - model: OpenBuddy/openbuddy-llama3.3-70b-v24.1-131k
3 - model: nbeerbower/llama3.1-kartoffeldes-70B
4 - model: tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.3
5 - model: SicariusSicariiStuff/Negative_LLAMA_70B
6select_topk: .15
7merge_method: sce
8base_model: meta-llama/Llama-3.3-70B-Instruct
9out_dtype: bfloat16
10dype: float32
11tokenizer:
12 source: base
1models:
2 - model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
3 - model: LatitudeGames/Wayfarer-Large-70B-Llama-3.3
4 - model: crestf411/L3.1-nemotron-sunfall-v0.7.0
5 - model: SicariusSicariiStuff/Negative_LLAMA_70B
6 - model: Sao10K/L3.3-70B-Euryale-v2.3
7merge_method: sce
8base_model: ./Base_6_v2
9select_topk: 0.15
10out_dtype: bfloat16
11dype: float32
12tokenizer:
13 source: union