You can deploy this model and start earning money today!

kenhktsui/
test_ag_news_syn

Views

No views yet

SetFit with sentence-transformers/paraphrase-mpnet-base-v2

This is a SetFit model trained on the fancyzhx/ag_news dataset that can be used for Text Classification. This SetFit model uses sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

Fine-tuning a Sentence Transformer with contrastive learning.
Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

Model Type: SetFit
Sentence Transformer body: sentence-transformers/paraphrase-mpnet-base-v2
Classification head: a LogisticRegression instance
Maximum Sequence Length: 512 tokens
Number of Classes: 4 classes
Training Dataset: fancyzhx/ag_news

Model Sources

Repository: SetFit on GitHub
Paper: Efficient Few-Shot Learning Without Prompts
Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
Sports	'Hamburg hampered by Lauth knock Hamburg SV striker Benjamin Lauth will be sidelined for up to four weeks because of complications to a fractured foot and perhaps longer if surgery is required, coach Klaus Toppmoeller said on Wednesday.' 'Keane Pleads Not Guilty to Assault Charges (AP) AP - Manchester United captain Roy Keane pleaded not guilty to all three charges Thursday over an alleged confrontation with a 16-year-old boy.' 'NBA Game Summary - San Antonio at Chicago Chicago, IL (Sports Network) - Tony Parker scored 17 points and had five assists to lead a balanced San Antonio attack that handed the Spurs a 91-75 victory over the Chicago Bulls at the United Center.'
Business	'Forex: Dollar Falls After Fed Rate Hike NEW YORK (Reuters) - The dollar extended its losses on Tuesday after the Federal Reserve raised interest rates as expected but signaled that both inflation and inflation expectations were easing.' 'Ameritrade Posts November Client Trades Ameritrade Holding Corp., a provider of brokerage services for individual investors, said Friday that daily average client trades in November reached 183,000, with 29,000 new accounts opened during the month.' 'Firefox browser sees surge in use A sudden, measurable decline in market share in any product over the course of a few months says something, even if that product is one whose producer still holds about 90 of the market in question.'
World	'Leaders Attend UAE President #39;s Funeral The United Arab Emirates appointed Sheik Khalifa bin Zayed Al Nahyan as its president Wednesday, hours after burying his father in a funeral that attracted thousands of mourners and nine heads of state to this desert nation on the Arabian Peninsula.' 'Report: Tobacco Industry Hid Smoking Dangers NEW YORK (Reuters Health) - The tobacco industry for many years claimed that it was unaware of biological evidence that smoking is harmful to health, but that was untrue according to a medical journal report.' 'Telenor urges fair regulatory system in Thailand (FT.com) FT.com - Telenor, the Norwegian telecommunications company, on Thursday called for "a level-playing field" in Thailand's mobile industry, urging a newly-established Thai telecoms regulator swiftly to create a fair new interconnection regime.'
Sci/Tech	'Microsoft Takes Lead in Software For Handhelds Microsoft has unseated the Palm system with worldwide sales of more than 1.3 million units over the third quarter of the year, compared with slightly more than 850,000 for the Palm, according to a new report. <FONT face="verdana,MS Sans Serif,arial,helvetica" size="-2" color="#666666"><B>-The Washington Post</B></FONT>' 'Telstra launches international Wi-fi roaming Telstra has launched Wi-fi roaming with five international wireless broadband operators giving Telstra customers travelling abroad access to WiFi hotspots in the UK (BT Group), USA (T-Mobile USA), Japan (NTT DoCoMo), Singapore (StarHub) and Malaysia (Maxis ' 'Passwords Fail To Defend Enterprises (TechWeb) TechWeb - Passwords, the dominant form of securing enterprise assets, are a failure, a research firm says.'

Evaluation

Metrics

Label	Accuracy
all	0.7676

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

python

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("setfit_model_id")
# Run inference
preds = model("Wal-Mart says weekly traffic rose Wal-Mart said Saturday that higher shopper traffic in the past week raised its comparable-store sales above the previous year. Free!")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	22	39.625	66

Label	Training Sample Count
World	27
Sports	14
Business	23
Sci/Tech	8

Training Hyperparameters

batch_size: (16, 16)
num_epochs: (5, 5)
max_steps: -1
sampling_strategy: oversampling
body_learning_rate: (2e-05, 1e-05)
head_learning_rate: 0.01
loss: CosineSimilarityLoss
distance_metric: cosine_distance
margin: 0.25
end_to_end: False
use_amp: False
warmup_proportion: 0.1
seed: 42
eval_max_steps: -1
load_best_model_at_end: True

Training Results

Epoch	Step	Training Loss	Validation Loss
0.0043	1	0.4132	-
0.2174	50	0.1877	-
0.4348	100	0.0342	-
0.6522	150	0.0009	-
0.8696	200	0.0005	-
1.0	230	-	0.154
1.0870	250	0.0003	-
1.3043	300	0.0003	-
1.5217	350	0.0002	-
1.7391	400	0.0001	-
1.9565	450	0.0002	-
2.0	460	-	0.1504
2.1739	500	0.0002	-
2.3913	550	0.0001	-
2.6087	600	0.0001	-
2.8261	650	0.0001	-
3.0	690	-	0.1545
3.0435	700	0.0001	-
3.2609	750	0.0001	-
3.4783	800	0.0001	-
3.6957	850	0.0001	-
3.9130	900	0.0001	-
4.0	920	-	0.1537
4.1304	950	0.0	-
4.3478	1000	0.0	-
4.5652	1050	0.0001	-
4.7826	1100	0.0	-
5.0	1150	0.0	0.1534

The bold row denotes the saved checkpoint.

Framework Versions

Python: 3.9.19
SetFit: 1.1.0.dev0
Sentence Transformers: 3.0.1
Transformers: 4.39.0
PyTorch: 2.4.0
Datasets: 2.20.0
Tokenizers: 0.15.2

Citation

BibTeX

bibtex

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}

kenhktsui/test_ag_news_syn