This repository includes one of the checkpoints used in the paper "Activation-Informed Merging of Large Language Models". Specifics of this model are as follows:
Merging Method: WIDEN
Models Used In Merging
Base Model: unsloth/llama-2-13b
Math: vanillaOVO/WizardMath-13B-V1.0
Instruction Tuned: WizardLMTeam/WizardLM-13B-V1.2
AIM: False
Benchmark results and paper details can be found at the official GitHub.
