Views
No views yet
B-SPECIESI-SPECIES0.730.750.720.95| Rank | Model | F1 Score | Precision | Recall | Accuracy |
|---|---|---|---|---|---|
| 🥇 1 | OpenMed-NER-OrganismDetect-BioMed-335M | 0.8639 | 0.8557 | 0.8722 | 0.9715 |
| 🥈 2 | OpenMed-NER-OrganismDetect-PubMed-335M | 0.8550 | 0.8370 | 0.8737 | 0.9698 |
| 🥉 3 | OpenMed-NER-OrganismDetect-PubMed-109M | 0.8458 | 0.8287 | 0.8637 | 0.9690 |
| 4 | OpenMed-NER-OrganismDetect-MultiMed-335M | 0.8441 | 0.8352 | 0.8532 | 0.9670 |
| 5 | OpenMed-NER-OrganismDetect-SuperClinical-434M | 0.8435 | 0.8291 | 0.8585 | 0.9670 |
| 6 | OpenMed-NER-OrganismDetect-PubMed-109M | 0.8349 | 0.8082 | 0.8634 | 0.9685 |
| 7 | OpenMed-NER-OrganismDetect-MultiMed-568M | 0.8313 | 0.8053 | 0.8592 | 0.9703 |
| 8 | OpenMed-NER-OrganismDetect-ElectraMed-335M | 0.8288 | 0.8176 | 0.8404 | 0.9631 |
| 9 | OpenMed-NER-OrganismDetect-BioPatient-108M | 0.8154 | 0.8140 | 0.8169 | 0.9591 |
| 10 | OpenMed-NER-OrganismDetect-ElectraMed-33M | 0.8121 | 0.7772 | 0.8503 | 0.9600 |

pip install transformers torch1from transformers import pipeline
2
3# Load the model and tokenizer
4# Model: https://huggingface.co/OpenMed/OpenMed-NER-OrganismDetect-ModernClinical-149M
5model_name = "OpenMed/OpenMed-NER-OrganismDetect-ModernClinical-149M"
6
7# Create a pipeline
8medical_ner_pipeline = pipeline(
9 model=model_name,
10 aggregation_strategy="simple"
11)
12
13# Example usage
14text = "Caenorhabditis elegans is a model organism for genetic studies."
15entities = medical_ner_pipeline(text)
16
17print(entities)
18
19token = entities[0]
20print(text[token["start"] : token["end"]])aggregation_strategy parameter defines how token predictions are grouped into entities. For a detailed explanation, please refer to the Hugging Face documentation.none: Returns raw token predictions without any aggregation.simple: Groups adjacent tokens with the same entity type (e.g., B-LOC followed by I-LOC).first: For word-based models, if tokens within a word have different entity tags, the tag of the first token is assigned to the entire word.average: For word-based models, this strategy averages the scores of tokens within a word and applies the label with the highest resulting score.max: For word-based models, the entity label from the token with the highest score within a word is assigned to the entire word.batch_size parameter:1texts = [
2 "Caenorhabditis elegans is a model organism for genetic studies.",
3 "The research focused on Drosophila melanogaster development.",
4 "Arabidopsis thaliana serves as a model for plant biology.",
5 "The zebrafish, Danio rerio, is widely used for studying vertebrate development.",
6 "Neurospora crassa is a type of red bread mold used in genetic research.",
7]
8
9# Efficient batch processing with optimized batch size
10# Adjust batch_size based on your GPU memory (typically 8, 16, 32, or 64)
11results = medical_ner_pipeline(texts, batch_size=8)
12
13for i, entities in enumerate(results):
14 print(f"Text {i+1} entities:")
15 for entity in entities:
16 print(f" - {entity['word']} ({entity['entity_group']}): {entity['score']:.4f}")1from transformers.pipelines.pt_utils import KeyDataset
2from datasets import Dataset
3import pandas as pd
4
5# Load your data
6# Load a medical dataset from Hugging Face
7from datasets import load_dataset
8
9# Load a public medical dataset (using a subset for testing)
10medical_dataset = load_dataset("BI55/MedText", split="train[:100]") # Load first 100 examples
11data = pd.DataFrame({"text": medical_dataset["Completion"]})
12dataset = Dataset.from_pandas(data)
13
14# Process with optimal batching for your hardware
15batch_size = 16 # Tune this based on your GPU memory
16results = []
17
18for out in medical_ner_pipeline(KeyDataset(dataset, "text"), batch_size=batch_size):
19 results.extend(out)
20
21print(f"Processed {len(results)} texts with batching")
221# For limited GPU memory, use smaller batches
2medical_ner_pipeline = pipeline(
3 model=model_name,
4 aggregation_strategy="simple",
5 device=0 # Specify GPU device
6)
7
8# Process with memory-efficient batching
9for batch_start in range(0, len(texts), batch_size):
10 batch = texts[batch_start:batch_start + batch_size]
11 batch_results = medical_ner_pipeline(batch, batch_size=len(batch))
12 results.extend(batch_results)1@misc{panahi2025openmedneropensourcedomainadapted,
2 title={OpenMed NER: Open-Source, Domain-Adapted State-of-the-Art Transformers for Biomedical NER Across 12 Public Datasets},
3 author={Maziyar Panahi},
4 year={2025},
5 eprint={2508.01630},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2508.01630},
9}