apt update
apt install pipx
git clone https://github.com/arcee-ai/mergekit.git
cd mergekit && pipx install -e .

mergekit-yaml config.yaml Llama-3.1-Nemotron-lorablated-70B --allow-crimes --lora-merge-cache=./cache

See @mlabonne's Llama-3.1-70B-Instruct-lorablated for more details on how the LoRA was extracted.

Configuration

The following YAML configuration was used to produce this model:

yaml

base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF+mlabonne/Llama-3-70B-Instruct-abliterated-LORA
dtype: bfloat16
merge_method: task_arithmetic
parameters:
  normalize: false
slices:
- sources:
  - layer_range: [0, 80]
    model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF+mlabonne/Llama-3-70B-Instruct-abliterated-LORA
    parameters:
      weight: 1.0

Acknowlegements

Thanks to @mlabonne, @grimjim, and @failspy for pioneering this technique for uncensoring models.

Compute provided by Hetzner and funded by Schneewolf Labs.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	33.69
IFEval (0-Shot)	71.47
BBH (3-Shot)	48.06
MATH Lvl 5 (4-Shot)	23.34
GPQA (0-shot)	0.89
MuSR (0-shot)	14.92
MMLU-PRO (5-shot)	43.46

nbeerbower/Llama-3.1-Nemotron-lorablated-70B

Llama-3.1-Nemotron-lorablated-70B

Method

Configuration

Acknowlegements

Open LLM Leaderboard Evaluation Results

nbeerbower/
Llama-3.1-Nemotron-lorablated-70B