This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
TIES merge method using
mistralai/Mistral-7B-Instruct-v0.2 as a base.
1
2models:
3 - model: mistralai/Mistral-7B-Instruct-v0.2
4 # No additional parameters needed for the base model
5 - model: meta-math/MetaMath-Mistral-7B
6 parameters:
7 density: 0.7 # A higher density for MetaMath to prioritize its parameters for math questions
8 weight: 0.7 # Higher weight to MetaMath to ensure its influence on math-related answers is strong
9merge_method: ties
10base_model: mistralai/Mistral-7B-Instruct-v0.2
11parameters:
12 normalize: true
13dtype: float16
14
