Jawbreaker MiniCPM5-1B LoRA v4
This is the final Jawbreaker LoRA adapter for openbmb/MiniCPM5-1B.
Jawbreaker is a local-first scam defense app for someone you love. It turns a suspicious text, email, or DM into a simple safety card: risk level, warning signs, scam pattern, and the safest next step before someone replies, clicks, or pays.
Links
Base + Adapter
- Base model:
openbmb/MiniCPM5-1B
- Adapter:
build-small-hackathon/jawbreaker-minicpm5-1b-lora-v4
- Runtime target: Hugging Face ZeroGPU via Gradio
Final Completed Evaluation
Guarded eval on eval/hard_v5_eval.jsonl:
- Cases: 394
- Risk-level accuracy: 96.19%
- Scam-type accuracy: 96.19%
- Mean tactic recall: 96.55%
- Dangerous classified as safe: 0
- Dangerous downgraded to needs-check: 0
- Suspicious classified as safe: 0
- Unsafe action violations: 0
- Invalid predictions: 0
- Model errors: 0
The larger 470-case v6 stress run timed out before completion, so it is retained as future evaluation material rather than final evidence.
Intended Behavior
The adapter is trained to produce a strict Jawbreaker JSON contract for consumer scam-defense analysis. The app validates model output and applies a safety guardrail before rendering a plain-English card.
Primary scenarios:
- Package and delivery phishing
- Bank, PayPal, Coinbase, and account-security scams
- Family impersonation and urgent money requests
- Fake recruiters and task/job scams
- Prize, lottery, and refund scams
- Benign or ambiguous messages that should not be over-escalated
Safety Notes
Jawbreaker is a hackathon safety assistant, not professional fraud, legal, financial, or cybersecurity advice. It should encourage safer next steps: do not click suspicious links, do not reply to pressure messages, and verify through official apps, websites, or known phone numbers.
The public dataset and eval files are synthetic/sanitized and do not include raw private chats, phone numbers, or personal message metadata.
