Views
No views yet
token-classification -- Named entity recognition for PII categories with context-aware redaction decisionsmicrosoft/deberta-v3-base -- Efficient inference for high-throughput document processing| Source | Records | Description |
|---|---|---|
| Redacted Court Filings | ~200K | Filings with clerk-applied redactions (before/after pairs) |
| PII-Annotated Legal Docs | ~100K | Expert-annotated documents with PII labels |
| Court Redaction Orders | ~20K | Judicial orders specifying what to redact |
| FRCP 5.2 / Rule 2.425 Case Law | ~5K opinions | Rulings on redaction requirements |
| Synthetic PII Documents | ~500K | Generated documents with known PII for training |
SSN -- Social Security Number --> ALWAYS redact (show last 4 only)TAX_ID -- Taxpayer ID --> ALWAYS redactFINANCIAL_ACCOUNT -- Bank/credit account numbers --> ALWAYS redact (last 4 only)MINOR_NAME -- Name of minor child --> ALWAYS redact (use initials)DOB_MINOR -- Date of birth of minor --> ALWAYS redactHOME_ADDRESS -- Home address --> Redact unless needed for servicePHONE -- Phone number --> Redact unless in business contextEMAIL -- Email address --> Preserve if needed for certificate of serviceMEDICAL -- Medical information --> Redact in public filingsPARTY_NAME -- Named party --> PRESERVE (required in caption)ATTORNEY_INFO -- Attorney contact --> PRESERVE (required in filing)CASE_NUMBER -- Case number --> PRESERVECOURT_INFO -- Court identification --> PRESERVEOriginal: "John Smith, SSN 123-45-6789, residing at 123 Main St"
Redacted: "John Smith, SSN XXX-XX-6789, residing at [ADDRESS REDACTED]"| Metric | Target | Description |
|---|---|---|
| PII Detection Recall | >= 98% | Must catch nearly all PII |
| SSN/Financial Recall | 100% | Zero tolerance for missed financial PII |
| Minor Name Recall | 100% | Zero tolerance for exposed minor information |
| False Redaction Rate | <= 2% | Must not redact legally required information |
| Court Rule Compliance | >= 95% | Redaction matches applicable court rule |
| Throughput | >= 50 pages/sec | Fast enough for bulk document processing |
STAGE 6 (Final Draft) --> pii-redactor processes document before filing
Input: final document text
Output: redacted version + redaction log
Redaction log shows: what was redacted, which rule required it, original value (encrypted)| Version | Date | Notes |
|---|---|---|
| v0.1 | 2026-04-10 | Initial model card, repo created |