This is a merge of pre-trained language models created using
mergekit.
This model was merged using the
linear merge method.
1models:
2 - model: meta-llama/Llama-2-7b-hf
3 parameters:
4 weight: 1.0
5 - model: meta-llama/CodeLlama-7b-hf
6 parameters:
7 weight: 0.5
8merge_method: linear
9dtype: float16
10
I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.
If you want to support my efforts please visit my ko-fi page:
https://ko-fi.com/devquasar
Also feel free to visit my website
https://devquasar.com/