You can deploy this model and start earning money today!

mistral-dareties-v92

Name: mistral-dareties-v0-2
Rating: 2.5 (8 reviews)

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using Open-Orca/Mistral-7B-SlimOrca as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

yaml

base_model: Open-Orca/Mistral-7B-SlimOrca
dtype: bfloat16
merge_method: dare_ties
models:
  - model: cognitivecomputations/openchat-3.5-0106-laser
    parameters:
      density: 0.74
      weight: [0, 0.2, 0.4]
  - model: Nexusflow/Starling-LM-7B-beta
    parameters:
      density: 0.74
      weight: [0.3, 0.4]
  - model: cognitivecomputations/samantha-1.1-westlake-7b-laser
    parameters:
      density: 0.74
      weight: [0.3, 0.4]
  - model: cognitivecomputations/dolphin-2.2.1-mistral-7b 
    parameters:
      density: 0.74
      weight: [0.3, 0.4]
parameters:
  int8_mask: true
  normalize: true

yeirr/mistral-dareties-v0-2

mistral-dareties-v92

Merge Details

Merge Method

Models Merged

Configuration

yeirr/
mistral-dareties-v0-2