Focused on chemical mentions in the BC5CDR domain, capturing pharmaceutical compounds and therapeutic agents in context with diseases.Enables pharmacovigilance, adverse event mining, and chemical–disease relation pipelines when paired with downstream relation extraction.
OpenMed ZeroShot NER is an advanced, domain-adapted Named Entity Recognition (NER) model designed specifically for medical, biomedical, and clinical text mining. Leveraging state-of-the-art zero-shot learning, this model empowers researchers, clinicians, and data scientists to extract expert-level biomedical entities—such as diseases, chemicals, genes, species, and clinical findings—directly from unstructured text, without the need for task-specific retraining.
Built on the robust GLiNER architecture and fine-tuned on curated biomedical corpora, OpenMed ZeroShot NER delivers high-precision entity recognition for critical healthcare and life sciences applications. Its zero-shot capability means you can flexibly define and extract any entity type relevant to your workflow, from standard biomedical categories to custom clinical concepts, supporting rapid adaptation to new research domains and regulatory requirements.
Whether you are working on clinical NLP, biomedical research, electronic health record (EHR) de-identification, or large-scale literature mining, OpenMed ZeroShot NER provides a production-ready, open-source solution that combines expert-level accuracy with unmatched flexibility. Join the OpenMed community to accelerate your medical text analytics with cutting-edge, zero-shot NER technology.
🎯 Key Features
Zero-Shot Capability: Can recognize any entity type without specific training
High Precision: Optimized for biomedical entity recognition
Domain-Specific: Fine-tuned on curated BC5CDR_CHEM dataset
Production-Ready: Validated on clinical benchmarks
Easy Integration: Compatible with Hugging Face Transformers ecosystem
Flexible Entity Recognition: Add custom entity types without retraining
🏷️ Supported Entity Types
This zero-shot model can identify and classify biomedical entities, including but not limited to these entity types. You can also add custom entity types without retraining the model:
CHE
💡 Zero-Shot Flexibility: As a GliNER-based model, you can specify any entity types you want to detect, even if they weren't part of the original training. Simply provide the entity labels when using the model, and it will adapt to recognize them.
📊 Dataset
BC5CDR-Chem focuses on chemical entity recognition from the BioCreative V Chemical-Disease Relation extraction task.
The BC5CDR-Chem corpus is part of the BioCreative V Chemical-Disease Relation (CDR) extraction challenge, specifically targeting chemical entity recognition in biomedical texts. This dataset contains 1,500 PubMed abstracts with 4,409 annotated chemical entities, designed to support automated drug discovery and pharmacovigilance applications. The corpus emphasizes chemical compounds, drugs, and therapeutic substances that are relevant for understanding chemical-disease relationships. It serves as a critical resource for developing NER systems that can identify chemical entities for downstream tasks like adverse drug reaction detection and drug repurposing research.
📊 Performance Metrics
Current Model Performance
Finetuned F1 vs. Base Model (on test dataset excluded from training): 0.77
Rankings are sorted by finetuned F1 and show ΔF1% over base model. Test dataset is excluded from training.
OpenMed ZeroShot Clinical & Biomedical NER vs. Original GLiNER models
Figure: OpenMed ZeroShot Clinical & Biomedical NER vs. Original GLiNER models.
🚀 Quick Start
Installation
pip install -q "gliner[tokenizers]"
Usage
python
1from transformers import pipeline
23# Load the model and tokenizer4# Model: https://huggingface.co/OpenMed/OpenMed-ZeroShot-NER-Pharma-Tiny-60M5model_name ="OpenMed/OpenMed-ZeroShot-NER-Pharma-Tiny-60M"67from gliner import GLiNER
8model = GLiNER.from_pretrained(model_name)910# Example usage with default entity types11text ="Administration of metformin reduced glucose levels significantly."1213labels =['CHE']14entities = model.predict_entities(text, labels, flat_ner=True, threshold=0.5)15for entity in entities:16print(entity)
Zero-Shot Usage with Custom Entity Types
💡 Tip: If you want to extract entities that are not present in the original training set (i.e., use custom or rare entity types), you may get better results by lowering the threshold parameter in model.predict_entities. For example, try threshold=0.3 or even lower, depending on your use case:
python
1# You can specify custom entity types for zero-shot recognition - for instance:2custom_entities =["MISC","CHE","PERSON","LOCATION","MEDICATION","PROCEDURE"]34entities = model.predict_entities(text, custom_entities, flat_ner=True, threshold=0.1)5for entity in entities:6print(entity)
Lowering the threshold makes the model more permissive and can help it recognize new or less common entity types, but may also increase false positives. Adjust as needed for your application.
📚 Dataset Information
Dataset: BC5CDR_CHEM
Description: Chemical Entity Recognition - Chemical entities from the BC5CDR dataset
Training Details
Base Model: gliner-x-small
Training Framework: Hugging Face Transformers
Optimization: AdamW optimizer with learning rate scheduling
Validation: Cross-validation on held-out test set
💡 Use Cases
This model is particularly useful for:
Clinical Text Mining: Extracting entities from medical records
Biomedical Research: Processing scientific literature
Drug Discovery: Identifying chemical compounds and drugs
Healthcare Analytics: Analyzing patient data and outcomes
Academic Research: Supporting biomedical NLP research
Custom Entity Recognition: Zero-shot detection of domain-specific entities
Licensed under the Apache License 2.0. See LICENSE for details.
🤝 Contributing
I welcome contributions of all kinds! Whether you have ideas, feature requests, or want to join my mission to advance open-source Healthcare AI, I'd love to hear from you.
Follow OpenMed Org on Hugging Face 🤗 and click "Watch" to stay updated on my latest releases and developments.
Citation
If you use this model in your research or applications, please cite the following paper:
latex
1@misc{panahi2025openmedneropensourcedomainadapted,
2 title={OpenMed NER: Open-Source, Domain-Adapted State-of-the-Art Transformers for Biomedical NER Across 12 Public Datasets},
3 author={Maziyar Panahi},
4 year={2025},
5 eprint={2508.01630},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2508.01630},
9}
Proper citation helps support and acknowledge my work. Thank you!
