WaRP-Safety-Llama3_8B_Instruct

Model Details

• Base Model: meta-llama/Llama-3.1-8B-Instruct
• Training Method: Safety-First WaRP (3-Phase pipeline)
• Training Date: 2026-05-06

Training Procedure

Phase 1: Basis Construction

• Collected activations from FFN layers using safety data
• Computed SVD to obtain orthonormal basis vectors
• Identified 419 important neurons in layer 31

Phase 2: Importance Scoring

• Calculated importance scores using gradient-based methods
• Generated masks for important directions
• Used teacher forcing on safety responses

Phase 3: Incremental Learning

• Fine-tuned on utility task (GSM8K) with gradient masking
• Protected important directions to maintain safety
• Improved utility while preserving safety mechanisms

Usage

Safety Features

• ✅ Protected safety mechanisms through gradient masking
• ✅ Maintained refusal capability for harmful requests
• ✅ Improved utility on reasoning tasks
• ✅ Balanced safety-utility tradeoff

Datasets

• Safety Data: LibrAI/do-not-answer
• Utility Data: openai/gsm8k

Citation

@article{warp-safety,
  title={Safety-First WaRP: Weight space Rotation Process for LLM Safety Alignment},
  author={Min-Seong Kim},
  year={2026}
}

License

Disclaimer