Views
No views yet
1from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
2
3model_name = "akahana/en-id-finetuned-4bit"
4
5tokenizer = AutoTokenizer.from_pretrained(model_name)
6model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
7
8text = "How are you?"
9inputs = tokenizer(text, return_tensors="pt")
10outputs = model.generate(**inputs)
11
12print(tokenizer.decode(outputs[0], skip_special_tokens=True))| Metric | Base Model | Fine-tuned Model |
|---|---|---|
| BLEU | 34.32 | 36.59 |
| CHRF | 60.81 | 62 |
| METEOR | 0.6 | 0.62 |
| TER ↓ | 53.42 | 50.85 |