Human-LLM Generated Phishing-Legitimate Emails (Kaggle)
4,000 emails across 4 classes: Human-Phishing, Human-Legitimate, LLM-Phishing, LLM-Legitimate (1,000 each).
Split: 80% train / 10% val / 10% test (stratified).

Usage

python

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_model = AutoModelForCausalLM.from_pretrained(
    "unsloth/qwen3-14b-unsloth-bnb-4bit",
    load_in_4bit=True,
    device_map="auto",
)
model = PeftModel.from_pretrained(base_model, "ellachang/phishing-detector-14b-lora")
tokenizer = AutoTokenizer.from_pretrained("ellachang/phishing-detector-14b-lora")

prompt = """Analyze the following email and determine if it is a phishing email or a legitimate email. Provide your classification.

### Input:
{email_text}

### Response:"""

inputs = tokenizer(prompt.format(email_text="<your email here>"), return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=20, temperature=0)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Training Details

Method: QLoRA (4-bit quantization + LoRA)
LoRA rank: r=16, alpha=16
Target modules: q_proj, k_proj, v_proj, o_proj
Hardware: NVIDIA RTX 4090 (24GB VRAM)
Framework: Unsloth + TRL SFTTrainer

Project

Part of a term project on LLM-based phishing detection with RAG and Chain-of-Thought analysis.
Source code: [GitHub repo link]