Views
No views yet
1from transformers import AutoModelForCausalLM, AutoTokenizer
2from peft import PeftModel
3
4base = AutoModelForCausalLM.from_pretrained('Qwen/Qwen2.5-7B-Instruct')
5model = PeftModel.from_pretrained(base, 'mjayason/retail-banking-servicing-qa-lora')
6tok = AutoTokenizer.from_pretrained('Qwen/Qwen2.5-7B-Instruct')Context: block of policy snippets, then the question — answers cite the [POLICY-ID]s present in the context.