You can deploy this model and start earning money today!

davanstrien/
eval-extraction-ner-v1

Name: eval-extraction-ner-v1
Availability: InStock

eval-mentions-bootstrap

microsoft/deberta-v3-base

finetune

apache-2.0

Views

No views yet

davanstrien/eval-extraction-ner-v1

Token classifier trained on bootstrap NER labels from davanstrien/eval-mentions-bootstrap. Demonstrates the bootstrap-labels skill workflow: GLiNER bootstraps coarse labels, a small task-specific model is trained on them.

Training data

Source: davanstrien/eval-mentions-bootstrap
Bootstrap model: GLiNER (via uv-scripts/gliner)
Score threshold: 0.75 (entities below this dropped)
Span blacklist: ['learning_rate', 'eval_batch_size', 'epsilon', 'lr_scheduler_warmup_ratio', 'lr_scheduler_type', 'epoch', 'batch_size', 'optimizer', 'gradient_accumulation_steps', 'warmup_ratio', 'seed', 'weight_decay', 'model', 'dataset', 'transformers', 'training dataset', 'training data', 'unknown dataset', 'f1']
Train rows: 1767
Val rows: 197
Token-label distribution (excluding O):
- EVALUATION_METRIC: 9888
- BENCHMARK_NAME: 4796
- EVALUATION_DATASET: 4044

Eval results

Metric	Value
F1	0.0000
Precision	0.0000
Recall	0.0000
Accuracy	0.9784

(Note: held-out 10% of bootstrap labels — these are silver labels, not human-reviewed gold. Numbers reflect agreement with GLiNER, not absolute accuracy.)

Caveats

This is a V0 model trained on bootstrap labels with no human review pass. Expect it to inherit GLiNER's failure modes.
The intended use is as the V1 in an active-learning loop: deploy as Label Studio ML backend, route disagreements with GLiNER to humans, retrain on corrections. See the bootstrap-labels skill for the full workflow.

Usage

python

from transformers import AutoTokenizer, AutoModelForTokenClassification, pipeline

ner = pipeline("token-classification", model="davanstrien/eval-extraction-ner-v1", aggregation_strategy="simple")
ner("This model was evaluated on MMLU and HellaSwag.")