Mistral 7B Heretic 3x - Uncensored LoRA Adapter

Results

How it was made

1. Ran Heretic v1.2.0 with 200 Optuna optimization trials
2. Base model quantized to 4-bit (BNB_4BIT) on RTX 5060 (8GB VRAM)
3. Best trial weights multiplied by 3x for stronger ablation
4. Saved as LoRA adapter (targets: attn.o_proj, mlp.down_proj)

Usage

Full Chat App

Requirements

• NVIDIA GPU with 8GB+ VRAM
• PyTorch with CUDA support
• transformers, peft, bitsandbytes

Details

• Base model: mistralai/Mistral-7B-Instruct-v0.3
• Method: Directional ablation via Heretic v1.2.0
• Optimization: 200 Optuna trials, best trial #61
• Ablation multiplier: 3x
• Quantization: BNB 4-bit
• LoRA targets: attn.o_proj, mlp.down_proj
• Hardware: NVIDIA RTX 5060 (8GB VRAM)