You can deploy this model and start earning money today!

MoonRide/
Llama-3.2-3B-Khelavaster

Name: Llama-3.2-3B-Khelavaster
Availability: InStock

Views

No views yet

Intro

Experimental merge of multiple Llama 3.2 3B models, guided by MoonRide-Index-v7. Created with mergekit.

Merge Details

Merge Method

This model was merged using the SCE merge method using meta-llama/Llama-3.2-3B as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: bunnycore/Llama-3.2-3B-Mix-Skill
  - model: bunnycore/Llama-3.2-3B-Sci-Think
  - model: FuseAI/FuseChat-Llama-3.2-3B-Instruct
  - model: theprint/ReWiz-Llama-3.2-3B
base_model: meta-llama/Llama-3.2-3B
tokenizer:
  source: meta-llama/Llama-3.2-3B-Instruct
merge_method: sce
parameters:
  normalize: true
dtype: float32
out_dtype: float16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	20.14
IFEval (0-Shot)	49.25
BBH (3-Shot)	22.69
MATH Lvl 5 (4-Shot)	16.16
GPQA (0-shot)	3.69
MuSR (0-shot)	5.50
MMLU-PRO (5-shot)	23.57

MoonRide/Llama-3.2-3B-Khelavaster