This is a merge of pre-trained language models created using mergekit.

This model is currently ranked #3 on the Open LLM Leaderboard among models up to 8B parameters and #5 among models up to 13B parameters!

This model was merged using the SLERP merge method.

The following models were included in the merge:

The following YAML configuration was used to produce this model:

Detailed results can be found here