Views
No views yet
1import torch
2
3from transformers import VisionEncoderDecoderModel
4
5model = VisionEncoderDecoderModel.from_pretrained("team-lucid/trocr-small-korean")
6
7pixel_values = torch.rand(1, 3, 384, 384)
8generated_ids = model.generate(pixel_values)| Hyperparameter | Small |
|---|---|
| Warmup Steps | 4,000 |
| Learning Rates | 1e-4 |
| Batch Size | 512 |
| Weight Decay | 0.01 |
| Max Steps | 500,000 |
| Learning Rate Decay | 0.1 |
| \(Adam\beta_1\) | 0.9 |
| \(Adam\beta_2\) | 0.98 |