Views
No views yet
Mercy-62/bart-base-pii-masker-lora is built on top of facebook/bart-base and fine-tuned using the PEFT LoRA approach for lightweight adaptation."Customer John Smith applied for a credit card on May 10, 2023."Customer [NAME] applied for a credit card on [DATE].| Component | Value |
|---|---|
| Base Model | facebook/bart-base |
| Adapter Type | LoRA (Low-Rank Adaptation) |
| Frameworks | PyTorch, Transformers, PEFT |
| Task | Text-to-Text Generation |
| Language | English |
1from peft import PeftModel
2from transformers import AutoModelForSeq2SeqLM, AutoTokenizer
3
4# Load model
5base_model = AutoModelForSeq2SeqLM.from_pretrained("facebook/bart-base")
6model = PeftModel.from_pretrained(base_model, "Mercy-62/bart-base-pii-masker-lora")
7tokenizer = AutoTokenizer.from_pretrained("facebook/bart-base")
8
9def test_pii_masking(model, tokenizer, samples):
10 device = model.device
11 for text in samples:
12 inputs = tokenizer(text, return_tensors="pt", truncation=True).to(device)
13 outputs = model.generate(**inputs, max_length=80)
14 print(f"\nInput: {text}")
15 print("Output:", tokenizer.decode(outputs[0], skip_special_tokens=True))
16
17pii_samples = [
18 "Customer John Smith applied for a credit card on May 10, 2023.",
19 "Contact number: +92-300-1234567, Email: sara.khan@gmail.com",
20]
21
22test_pii_masking(model, tokenizer, pii_samples)