Views
No views yet
1>>> from transformers import pipeline
2>>> translator = pipeline('translation', model='chunwoolee0/ke_t5_base_bongsoo_en_ko')
3
4>>> translator("나는 습관적으로 점심식사 후에 산책을 한다.")
5[{'translation_text': 'I habitually go to walk after lunch'}]
6
7>>> translator("이 강좌는 허깅페이스가 만든 거야.")
8[{'translation_text': 'This class was created by Huggface.'}]
9
10>>> translator("오늘은 늦게 일어났다.")
11[{'translation_text': 'This day, I went late.'}]
12
13## Training and evaluation data
14
15More information needed
16
17## Training procedure
18
19### Training hyperparameters
20
21The following hyperparameters were used during training:
22- learning_rate: 0.0005
23- train_batch_size: 32
24- eval_batch_size: 32
25- seed: 42
26- gradient_accumulation_steps: 2
27- total_train_batch_size: 64
28- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
29- lr_scheduler_type: linear
30- num_epochs: 1
31
32### Training results
33
34| Training Loss | Epoch | Step | Validation Loss | Bleu |
35|:-------------:|:-----:|:----:|:---------------:|:-------:|
36| No log | 1.0 | 5625 | 1.6845 | 12.2087 |
37
38TrainOutput(global_step=5625, training_loss=2.831754861111111,
39metrics={'train_runtime': 12144.6206, 'train_samples_per_second': 29.643,
40'train_steps_per_second': 0.463, 'total_flos': 2.056934156746752e+16,
41'train_loss': 2.831754861111111, 'epoch': 1.0})
42
43### Framework versions
44
45- Transformers 4.32.1
46- Pytorch 2.0.1+cu118
47- Datasets 2.14.4
48- Tokenizers 0.13.3