Views
No views yet
from_pretrained method of the GPT2LMHeadModel class from the transformers library. Here's an example code snippet:1from transformers import GPT2LMHeadModel, GPT2Tokenizer
2
3# Load the model and tokenizer
4model = GPT2LMHeadModel.from_pretrained("path/to/your/model")
5tokenizer = GPT2Tokenizer.from_pretrained("path/to/your/tokenizer")
6
7# Generate some text using the model
8prompt = "Dwight walks into the office and says"
9input_ids = torch.tensor(tokenizer.encode(prompt)).unsqueeze(0)
10
11sample_outputs = model.generate(
12 input_ids,
13 do_sample=True,
14 eos_token_id=tokenizer.eos_token_id,
15 bos_token_id=tokenizer.bos_token_id,
16 top_k=50,
17 max_length = 100,
18 top_p=0.999,
19 num_return_sequences=5,
20 mask_token_id=tokenizer.mask_token_id,
21 pad_token_id=tokenizer.pad_token_id,
22 temperature=0.7
23 )
24
25for i, sample_output in enumerate(sample_outputs):
26 print(tokenizer.decode(sample_output, skip_special_tokens=True))
27 print("\n")
28
29# Print the generated text
30generated_text = tokenizer.decode(output[0], skip_special_tokens=True)
31print(generated_text)generate method of the model, passing in a prompt and setting the maximum length of the generated text to 50 tokens. Finally, we decode the output using the tokenizer and print the generated text.