You can deploy this model and start earning money today!

hurtmongoose/
Jailbreak-Detection-Models

Name: Jailbreak-Detection-Models
Rating: 2.5 (6 reviews)

safetensors

distilbert

Views

No views yet

Jailbreak Detection Model 🚀

This model is fine-tuned to detect jailbreak prompts / unsafe instructions.

📊 Training Metrics

Training steps: 0
Final Training Loss: N/A
Final Eval Loss: 0.07551019638776779

📈 Training Curve

🛠 How to Use

python

from transformers import AutoModelForSequenceClassification, AutoTokenizer

model = AutoModelForSequenceClassification.from_pretrained("hurtmongoose/Jailbreak-Detection-Models")
tokenizer = AutoTokenizer.from_pretrained("hurtmongoose/Jailbreak-Detection-Models")

inputs = tokenizer("This is a test jailbreak prompt", return_tensors="pt")
outputs = model(**inputs)
print(outputs.logits)
📌 Notes

Trained on jailbreak detection dataset

Can be improved with more adversarial prompts