Thanks mradermacher for the quants

GGUF
GGUF imatrix

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using upstage/SOLAR-10.7B-v1.0 as a base.

Models Merged

The following models were included in the merge:

Himitsui/Kaiju-11B
TheDrummer/Moistral-11B-v3
Himitsui/MedMitsu-Instruct-11B
migtissera/Synthia-v3.0-11B

Configuration

The following YAML configuration was used to produce this model:

yaml

models:
  - model: Himitsui/MedMitsu-Instruct-11B
    parameters:
      weight: 0.16
      density: 0.42
  - model: Himitsui/Kaiju-11B
    parameters:
      weight: 0.22
      density: 0.54
  - model: migtissera/Synthia-v3.0-11B
    parameters:
      weight: 0.28
      density: 0.66
  - model: TheDrummer/Moistral-11B-v3
    parameters:
      weight: 0.34
      density: 0.78
merge_method: dare_ties
base_model: upstage/SOLAR-10.7B-v1.0
parameters:
  int8_mask: true
dtype: bfloat16

v000000/SyntheticMoist-11B