Views
No views yet
mistralai/Mistral-7B-v0.1 using the PEFT (LoRA) technique. It is designed to generate quiz-style questions and answers in various formats (MCQ, fill-in-the-blanks, true/false, etc.) from academic text inputs, primarily targeting BTech CSE core subjects such as DSA, OS, CN, and DBMS.en)1from transformers import AutoTokenizer, AutoModelForCausalLM
2from peft import PeftModel
3
4base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1", device_map="auto", trust_remote_code=True)
5peft_model = PeftModel.from_pretrained(base_model, "Nikhil/quizbuddy-mistral-lora")
6tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")
7
8input_text = "Explain stack and its operations"
9inputs = tokenizer(input_text, return_tensors="pt").to("cuda")
10output = peft_model.generate(**inputs, max_new_tokens=200)
11print(tokenizer.decode(output[0], skip_special_tokens=True))