Views
No views yet
prajjwal1/bert-tiny, it is optimized for high-speed, high-throughput filtering pipelines.task-classifier-mini-improved2, fine-tuned on more curated examples from a large job postings corpus. We include validation results below.1from transformers import pipeline, AutoModelForSequenceClassification, AutoTokenizer
2
3model_name = "loyoladatamining/task-classifier-mini-v3"
4model = AutoModelForSequenceClassification.from_pretrained(model_name)
5tokenizer = AutoTokenizer.from_pretrained(model_name, max_length=64, truncation=True)
6
7# Create text classification pipeline
8nlp = pipeline(
9 "text-classification",
10 model=model,
11 tokenizer=tokenizer,
12 max_length=64,
13 truncation=True
14)
15
16# Inference
17text = "Manage and maintain the internal database servers on a weekly basis."
18result = nlp(text)
19print(result)1[
2 {
3 "label": "LABEL_1",
4 "score": 0.9845
5 }
6]LABEL_0: The text is not a valid task statement.LABEL_1: The text is a task statement.task-classifier-mini-v3 was evaluated against the previous iteration (task-classifier-mini-improved2) using the loyoladatamining/usajobs_validation dataset.| Model | Accuracy | F1 |
|---|---|---|
| task-classifier-mini-improved2 | 0.8358 | 0.8253 |
| task-classifier-mini-v3 | 0.9583 | 0.9585 |
@article{meisenbacher2025extracting,
title={Extracting O* NET Features from the NLx Corpus to Build Public Use Aggregate Labor Market Data},
author={Meisenbacher, Stephen and Nestorov, Svetlozar and Norlander, Peter},
year={2025}
}