bruhzair/ignore-merge-15 (allura-org/Bigger-Body-70b upscaled to 105B)
bruhzair/ignore-merge-12 (ArliAI/Llama-3.3-70B-ArliAI-RPMax-v1.4 upscaled to 105B)
bruhzair/ignore-merge-1 (Sao10K/L3.3-70B-Euryale-v2.3 upscaled to 105B)
bruhzair/EVA-x-EVA-105b (EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1 upscaled to 105B)
BASE: bruhzair/ignore-merge-23 (Sao10K/Llama-3.3-70B-Vulpecula-r1 upscaled to 105B)

Configuration

The following YAML configuration was used to produce this model:

yaml

base_model: /workspace/vulp2
dtype: bfloat16
merge_method: sce
modules:
  default:
    slices:
    - sources:
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-12/snapshots/4085cc634918098de514474c65eef633cbcf5ac5
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-6/snapshots/87658005d40b593ba3e87e92e5fb3f28321266a1
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-1/snapshots/0994ed36502b7c1942553cae165a5813acfc7f4b
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/cache/models--bruhzair--ignore-merge-15/snapshots/e60ee5422f827ab08ac0f591cf18fb7f43f629e8
        parameters:
          select_topk: 0.5
      - layer_range: [0, 120]
        model: /workspace/vulp2
        parameters:
          select_topk: 0.5
parameters:
  normalize: 0.0
tokenizer:
  source: base

bruhzair/Test-Model-7-105b

Purpose

Models Merged

Configuration

bruhzair/
Test-Model-7-105b