Views
No views yet
B-CHEMI-CHEM0.910.920.910.98| Rank | Model | F1 Score | Precision | Recall | Accuracy |
|---|---|---|---|---|---|
| 🥇 1 | OpenMed-NER-ChemicalDetect-PubMed-335M | 0.9540 | 0.9498 | 0.9582 | 0.9902 |
| 🥈 2 | OpenMed-NER-ChemicalDetect-PubMed-109M | 0.9490 | 0.9447 | 0.9534 | 0.9891 |
| 🥉 3 | OpenMed-NER-ChemicalDetect-PubMed-109M | 0.9487 | 0.9418 | 0.9557 | 0.9892 |
| 4 | OpenMed-NER-ChemicalDetect-SnowMed-568M | 0.9485 | 0.9469 | 0.9502 | 0.9891 |
| 5 | OpenMed-NER-ChemicalDetect-ElectraMed-560M | 0.9480 | 0.9455 | 0.9505 | 0.9890 |
| 6 | OpenMed-NER-ChemicalDetect-SuperClinical-434M | 0.9469 | 0.9427 | 0.9512 | 0.9881 |
| 7 | OpenMed-NER-ChemicalDetect-SuperMedical-355M | 0.9462 | 0.9418 | 0.9507 | 0.9875 |
| 8 | OpenMed-NER-ChemicalDetect-MultiMed-335M | 0.9460 | 0.9435 | 0.9485 | 0.9857 |
| 9 | OpenMed-NER-ChemicalDetect-MultiMed-568M | 0.9459 | 0.9437 | 0.9481 | 0.9885 |
| 10 | OpenMed-NER-ChemicalDetect-BigMed-560M | 0.9454 | 0.9376 | 0.9534 | 0.9888 |

pip install transformers torch1from transformers import pipeline
2
3# Load the model and tokenizer
4# Model: https://huggingface.co/OpenMed/OpenMed-NER-ChemicalDetect-EuroMed-212M
5model_name = "OpenMed/OpenMed-NER-ChemicalDetect-EuroMed-212M"
6
7# Create a pipeline
8medical_ner_pipeline = pipeline(
9 model=model_name,
10 aggregation_strategy="simple"
11)
12
13# Example usage
14text = "The patient was administered acetylsalicylic acid for pain relief."
15entities = medical_ner_pipeline(text)
16
17print(entities)
18
19token = entities[0]
20print(text[token["start"] : token["end"]])aggregation_strategy parameter defines how token predictions are grouped into entities. For a detailed explanation, please refer to the Hugging Face documentation.none: Returns raw token predictions without any aggregation.simple: Groups adjacent tokens with the same entity type (e.g., B-LOC followed by I-LOC).first: For word-based models, if tokens within a word have different entity tags, the tag of the first token is assigned to the entire word.average: For word-based models, this strategy averages the scores of tokens within a word and applies the label with the highest resulting score.max: For word-based models, the entity label from the token with the highest score within a word is assigned to the entire word.batch_size parameter:1texts = [
2 "The patient was administered acetylsalicylic acid for pain relief.",
3 "Treatment with doxorubicin showed significant improvement in tumor regression.",
4 "The compound benzylpenicillin demonstrated strong antimicrobial activity.",
5 "Further studies are needed to understand the effects of methotrexate on rheumatoid arthritis.",
6 "The synthesis of vancomycin remains a significant challenge in organic chemistry.",
7]
8
9# Efficient batch processing with optimized batch size
10# Adjust batch_size based on your GPU memory (typically 8, 16, 32, or 64)
11results = medical_ner_pipeline(texts, batch_size=8)
12
13for i, entities in enumerate(results):
14 print(f"Text {i+1} entities:")
15 for entity in entities:
16 print(f" - {entity['word']} ({entity['entity_group']}): {entity['score']:.4f}")1from transformers.pipelines.pt_utils import KeyDataset
2from datasets import Dataset
3import pandas as pd
4
5# Load your data
6# Load a medical dataset from Hugging Face
7from datasets import load_dataset
8
9# Load a public medical dataset (using a subset for testing)
10medical_dataset = load_dataset("BI55/MedText", split="train[:100]") # Load first 100 examples
11data = pd.DataFrame({"text": medical_dataset["Completion"]})
12dataset = Dataset.from_pandas(data)
13
14# Process with optimal batching for your hardware
15batch_size = 16 # Tune this based on your GPU memory
16results = []
17
18for out in medical_ner_pipeline(KeyDataset(dataset, "text"), batch_size=batch_size):
19 results.extend(out)
20
21print(f"Processed {len(results)} texts with batching")
221# For limited GPU memory, use smaller batches
2medical_ner_pipeline = pipeline(
3 model=model_name,
4 aggregation_strategy="simple",
5 device=0 # Specify GPU device
6)
7
8# Process with memory-efficient batching
9for batch_start in range(0, len(texts), batch_size):
10 batch = texts[batch_start:batch_start + batch_size]
11 batch_results = medical_ner_pipeline(batch, batch_size=len(batch))
12 results.extend(batch_results)1@misc{panahi2025openmedneropensourcedomainadapted,
2 title={OpenMed NER: Open-Source, Domain-Adapted State-of-the-Art Transformers for Biomedical NER Across 12 Public Datasets},
3 author={Maziyar Panahi},
4 year={2025},
5 eprint={2508.01630},
6 archivePrefix={arXiv},
7 primaryClass={cs.CL},
8 url={https://arxiv.org/abs/2508.01630},
9}