Views
No views yet
bart-base-samsumfacebook/bart-base on Samsum dataset.1from transformers import pipeline
2
3summarizer = pipeline("summarization", model="lidiya/bart-base-samsum")
4conversation = '''Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker?
5Philipp: Sure you can use the new Hugging Face Deep Learning Container.
6Jeff: ok.
7Jeff: and how can I get started?
8Jeff: where can I find documentation?
9Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
10'''
11summarizer(conversation)| key | value |
|---|---|
| eval_rouge1 | 46.6619 |
| eval_rouge2 | 23.3285 |
| eval_rougeL | 39.4811 |
| eval_rougeLsum | 43.0482 |
| test_rouge1 | 44.9932 |
| test_rouge2 | 21.7286 |
| test_rougeL | 38.1921 |
| test_rougeLsum | 41.2672 |