Views
No views yet
Qwen/Qwen2.5-14B-Instruct 使用 QLoRA 行为对齐并合并权重,主要增强:1from transformers import AutoTokenizer, AutoModelForCausalLM
2
3model_id = "yihao-ai/yihao-llm-14b-v2"
4
5tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
6model = AutoModelForCausalLM.from_pretrained(
7 model_id,
8 torch_dtype="auto",
9 device_map="auto",
10 trust_remote_code=True,
11)
12
13prompt = "你是谁?一句话介绍你的定位。"
14inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
15outputs = model.generate(**inputs, max_new_tokens=64)
16print(tokenizer.decode(outputs[0], skip_special_tokens=True))
17