from transformers import BlenderbotTokenizer, BlenderbotForConditionalGeneration

tokenizer = BlenderbotTokenizer.from_pretrained("nilotpaldhar2004/blenderbot-chatbot")
model = BlenderbotForConditionalGeneration.from_pretrained("nilotpaldhar2004/blenderbot-chatbot")

inputs = tokenizer("Hello! How are you?", return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=60, num_beams=2)
print(tokenizer.decode(output[0], skip_special_tokens=True))

Training Details

Samples: 60,000 pairs from blended_skill_talk
Effective batch: 64 (batch 8 x grad accum 8)
Warmup: 15% of total steps
Early stopping patience: 2

Author

Nilotpal — CS student, AI/ML