Views
No views yet
'Political':1,
'Economy':2,
'Health':3,
'Sport':4,
'Culture':5,
'Technology':6,
'Art':7,
'Accidents':8| Training batch size | 8 |
| Evaluation batch size | 8 |
| Learning rate | 1e-4 |
| Max length input | 64 |
| Max length target | 200 |
| Number workers | 4 |
| Epoch | 5 |
| Training Loss | 3.20 |
| Classification Accuracy | 95.7% |
| Generation Accuracy | 88.87% |
1
2from transformers import T5ForConditionalGeneration, T5Tokenizer, pipeline
3
4model_name = "Hezam/ArabicT5-49GB-small-classification-generation"
5model = T5ForConditionalGeneration.from_pretrained(model_name)
6tokenizer = T5Tokenizer.from_pretrained(model_name)
7generation_pipeline = pipeline("text2text-generation",model=model,tokenizer=tokenizer)
8
9text = "أوقفوا القتل الجماعي في غزة"
10
11output= generation_pipeline(text,
12 num_beams=10,
13 max_length=200,
14 top_p=0.9,
15 repetition_penalty = 3.0,
16 no_repeat_ngram_size = 3)[0]["generated_text"]
17
18output
19bash
category: 1 article: كتب عبد اللطيف صبح قال الرءيس الفلسطيني محمود عباس في تصريح ل اليوم السابع وقفوا القتل الجماعي في مدينه غزة مءكدا يجب يوقفوا قتل المدنيين العزل في قطاعي غزة والضفه وغزه واوقفوا القتل الجماع