This is a merge of pre-trained language models created using
mergekit.
Helium3, but the base is Stheno. A bit stupid. If Helium3-baseLlama is too dry and regular Helium3 is too horny, this might be a good middle ground.
Emphasis on "might."
This model was merged using the
Model Stock merge method using
Sao10K/L3-8B-Stheno-v3.2 as a base.
1models:
2 - model: inflatebot/helide-beta-r4
3 - model: inflatebot/helide-beta-r1
4 - model: inflatebot/helide-beta-r0
5
6merge_method: model_stock
7base_model: Sao10K/L3-8B-Stheno-v3.2
8dtype: bfloat16
9
