bruhzair/ignore-merge-13 (ReadyArt/Forgotten-Safeword-70B-v5.0 upscaled to 105B)
bruhzair/ignore-merge-14 (SicariusSicariiStuff/Negative_LLAMA_70B upscaled to 105B)
(ReadyArt/Forgotten-Abomination-70B-v5.0 upscaled to 105B)
bruhzair/Fallen-x-Fallen-L3.3-105b (TheDrummer/Fallen-Llama-3.3-R1-70B-v1 upscaled to 105B)
BASE: bruhzair/ignore-merge-15 (allura-org/Bigger-Body-70b upscaled to 105B)

Configuration

The following YAML configuration was used to produce this model:

yaml

base_model: /workspace/cache/models--bruhzair--ignore-merge-15/snapshots/e60ee5422f827ab08ac0f591cf18fb7f43f629e8
dtype: float32
merge_method: sce
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-13/snapshots/1356a403c9283a04e7b4e3ab1ffa617664dab442
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-14/snapshots/259046c200390f96271624317827e23cbe7198d7
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/abom
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/fallen2
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-15/snapshots/e60ee5422f827ab08ac0f591cf18fb7f43f629e8
        parameters:
          select_topk: 0.5
out_dtype: bfloat16
tokenizer:
  source: base

bruhzair/Test-Model-6-105b

Purpose

Models Merged

Configuration

bruhzair/
Test-Model-6-105b