Views
No views yet
unsloth/mistral-7b-instruct-v0.3-bnb-4bit1玩家:我潜水的时候捡到一个扇贝。
2阿獭:1from peft import PeftModel
2from transformers import AutoModelForCausalLM, AutoTokenizer
3
4adapter_id = "CasperYL/pascal-unsloth-mistral-lora-chs"
5
6tokenizer = AutoTokenizer.from_pretrained(adapter_id)
7base_model = AutoModelForCausalLM.from_pretrained(
8 "unsloth/mistral-7b-instruct-v0.3-bnb-4bit",
9 device_map="auto",
10)
11model = PeftModel.from_pretrained(base_model, adapter_id)