E-Cameron 3.2 1B

Name: E-Cameron-3.2-1B
Availability: InStock

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using UmbrellaInc/Dr.Cameron-3.2-1B as a base.

Models Merged

The following models were included in the merge:

UmbrellaInc/Executer-Virus-3.2-1B
Novaciano/Think-Doctor.Death-3.2-1B

Configuration

The following YAML configuration was used to produce this model:

yaml

merge_method: dare_ties
dtype: float32
out_dtype: float32

base_model: UmbrellaInc/Dr.Cameron-3.2-1B

models:
  - model: UmbrellaInc/Executer-Virus-3.2-1B
    parameters:
      weight: 0.5
      density: 0.7

  - model: Novaciano/Think-Doctor.Death-3.2-1B
    parameters:
      weight: 0.5
      density: 0.8

parameters:
int8_mask: true
normalize: true
rescale: true
rescale_factor: 1.15
prune_threshold: 0.03

tie_word_embeddings: true
tie_output_embeddings: true

UmbrellaInc/E-Cameron-3.2-1B

E-Cameron 3.2 1B

Merge Details

Merge Method

Models Merged

Configuration

UmbrellaInc/
E-Cameron-3.2-1B