This is a merge of pre-trained language models created using
mergekit.
Helium3, but the base model is Llama-3. Ended up being too dry, but if He3's too horny for you, try this one.
This model was merged using the
Model Stock merge method using
NousResearch/Meta-Llama-3-8B as a base.
1models:
2 - model: inflatebot/helide-beta-r4
3 - model: inflatebot/helide-beta-r1
4 - model: inflatebot/helide-beta-r0
5
6merge_method: model_stock
7base_model: NousResearch/Meta-Llama-3-8B
8dtype: bfloat16
9