merge

Name: Llama-3.1-8B-TitanFusion-v3
Availability: InStock

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using bunnycore/Llama-3.1-8B-TitanFusion as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: DreadPoor/Aspire-8B-model_stock
  - model: arcee-ai/Llama-3.1-SuperNova-Lite
  - model: mlabonne/Hermes-3-Llama-3.1-8B-lorablated
  - model: bunnycore/Llama-3.1-8B-TitanFusion
  - model: vicgalle/Configurable-Llama-3.1-8B-Instruct
  - model: DreadPoor/Heart_Stolen-8B-Model_Stock
merge_method: model_stock
base_model: bunnycore/Llama-3.1-8B-TitanFusion
normalize: false
int8_mask: true
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	24.02
IFEval (0-Shot)	48.10
BBH (3-Shot)	32.07
MATH Lvl 5 (4-Shot)	12.99
GPQA (0-shot)	7.83
MuSR (0-shot)	11.94
MMLU-PRO (5-shot)	31.17

bunnycore/Llama-3.1-8B-TitanFusion-v3