models:
  - model: mistralai/Mistral-7B-v0.1
    # no parameters necessary for base model
  - model: EmbeddedLLM/Mistral-7B-Merge-14-v0.3
    parameters:
      weight: 0.3
      density: 0.5
  - model: Weyaxi/OpenHermes-2.5-neural-chat-v3-3-openchat-3.5-1210-Slerp
    parameters:
      weight: 0.2
      density: 0.5
  - model: openchat/openchat-3.5-0106
    parameters:
      weight: 0.2
      density: 0.5
  - model: mlabonne/NeuralMarcoro14-7B
    parameters:
      weight: 0.3
      density: 0.5
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1

parameters:
  int8_mask: true
tokenizer_source: union
dtype: bfloat16

lucyknada/EmbeddedLLM_Mistral-7B-Merge-14-v0.5-exl2-6bpw

exl2 quant (measurement.json included)

original readme below

Update 2024-01-21

Model Description

Open LLM Leaderboard

Chat Template

Merge Configuration

lucyknada/
EmbeddedLLM_Mistral-7B-Merge-14-v0.5-exl2-6bpw