mergekit
merge base_model:
bunnycore/HyperLlama-3.1-8B
mlabonne/NeuralDaredevil-8B-abliterated
Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
mlabonne/Hermes-3-Llama-3.1-8B-lorablated
darkc0de/BuddyGlass_v0.2_Xortron7MethedUpSwitchedUp model-index:
name: BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp results:
- task: type: text-generation name: Text Generation dataset: name: IFEval (0-Shot) type: HuggingFaceH4/ifeval args: num_few_shot: 0 metrics:
  - type: inst_level_strict_acc and prompt_level_strict_acc value: 43.58 name: strict accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=darkc0de/BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: BBH (3-Shot) type: BBH args: num_few_shot: 3 metrics:
  - type: acc_norm value: 31.87 name: normalized accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=darkc0de/BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MATH Lvl 5 (4-Shot) type: hendrycks/competition_math args: num_few_shot: 4 metrics:
  - type: exact_match value: 11.1 name: exact match source: url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=darkc0de/BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: GPQA (0-shot) type: Idavidrein/gpqa args: num_few_shot: 0 metrics:
  - type: acc_norm value: 6.49 name: acc_norm source: url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=darkc0de/BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MuSR (0-shot) type: TAUR-Lab/MuSR args: num_few_shot: 0 metrics:
  - type: acc_norm value: 9.49 name: acc_norm source: url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=darkc0de/BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp name: Open LLM Leaderboard
- task: type: text-generation name: Text Generation dataset: name: MMLU-PRO (5-shot) type: TIGER-Lab/MMLU-Pro config: main split: test args: num_few_shot: 5 metrics:
  - type: acc value: 29.7 name: accuracy source: url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=darkc0de/BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp name: Open LLM Leaderboard

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: mlabonne/Hermes-3-Llama-3.1-8B-lorablated
  - model: mlabonne/NeuralDaredevil-8B-abliterated
  - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
  - model: bunnycore/HyperLlama-3.1-8B
  - model: darkc0de/BuddyGlass_v0.2_Xortron7MethedUpSwitchedUp
merge_method: model_stock
base_model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	22.04
IFEval (0-Shot)	43.58
BBH (3-Shot)	31.87
MATH Lvl 5 (4-Shot)	11.10
GPQA (0-shot)	6.49
MuSR (0-shot)	9.49
MMLU-PRO (5-shot)	29.70

RichardErkhov/darkc0de_-_BuddyGlass_v0.3_Xortron7MethedUpSwitchedUp-awq

Original model description: