Gemma2-9B-AdvancedFuse is an experimental, open-source large language model (LLM) with 9 billion parameters.
It aims to combine the strengths of
FuseAI/FuseChat-Gemma-2-9B-Instruct and
jsgreenawalt/gemma-2-9B-it-advanced-v2.1 through additive linear merging,
further fine-tuned on a 12K row dataset from
agentlans/crash-course
for enhanced chat and instruct performance, including math and multilingual prompts.
Detailed results can be found
here!
Summarized results can be found
here!