Views
No views yet
transformers library:1from transformers import pipeline
2
3generator = pipeline("text-generation", model="AdityaBavadekar/gpt2-medium-finetuned-qamodel")1BEAM_SIZE = 5
2TEMPERATURE = 2.0
3MAX_LENGTH = 200
4NOR_NGRAM = 2
5PROMPT = """
6Instruction: You are a respectful, friendly, helpful assistant.
7
8Question : What is your name?
9"""
10generated_text = generator(
11 PROMPT,
12 max_length=MAX_LENGTH,
13 temperature=TEMPERATURE,
14 num_beams=BEAM_SIZE,
15 no_repeat_ngram_size=NOR_NGRAM,
16 early_stopping=True
17)[0]["generated_text"]
18
19print(generated_text)Instruction: [instruction_here]
Question : [question_here]