Views
No views yet
5e-5.transformers library in Python:1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3tokenizer = AutoTokenizer.from_pretrained("your-organization/finetuned-mistral-7b")
4model = AutoModelForCausalLM.from_pretrained("your-organization/finetuned-mistral-7b")
5
6inputs = tokenizer("Input your text here.", return_tensors="pt")
7outputs = model.generate(inputs["input_ids"], max_length=50, num_return_sequences=1)
8
9print(tokenizer.decode(outputs[0], skip_special_tokens=True))