This is a novel merge of pre-trained language models created using
mergekit.
This model was merged using the DeLERP merge method using
grimjim/mistralai-Mistral-Nemo-Base-2407 as a base.
DeLERP is a novel merge method, a variation on LERP, implemented within the mergekit framework.
More details will be released later.
1models:
2 - model: grimjim/mistralai-Mistral-Nemo-Instruct-2407
3 - model: grimjim/mistralai-Mistral-Nemo-Base-2407
4merge_method: delerp
5base_model: grimjim/mistralai-Mistral-Nemo-Base-2407
6parameters:
7 t:
8 - value: 0.5
9dtype: bfloat16
10