Views
No views yet
Pimmetjeoss/tribe-crm-qwen-2b
(LoRA adapter) combined with its base model unsloth/Qwen3.5-2B.from_pretrained() load without PEFT dependencies.
Use the adapter-only version if you want to swap/combine adapters.| Metric | Synthetic heldout | Realistic heldout |
|---|---|---|
| Combined accuracy | 91.2% (52/57) | 98.2% (56/57) |
| Tool accuracy | 98.2% (56/57) | 98.2% (56/57) |
| Args accuracy | 91.2% (52/57) | 98.2% (56/57) |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3MODEL = "Pimmetjeoss/tribe-crm-qwen-2b-merged"
4tokenizer = AutoTokenizer.from_pretrained(MODEL)
5model = AutoModelForCausalLM.from_pretrained(MODEL, dtype="bfloat16").to("cuda").eval()
6
7messages = [
8 {"role": "system", "content": "You are a model that can do function calling with the following functions"},
9 {"role": "user", "content": "Zoek Bakkerij De Wit op"},
10]
11inputs = tokenizer.apply_chat_template(messages, tools=YOUR_TOOLS_SCHEMA,
12 add_generation_prompt=True,
13 return_dict=True, return_tensors="pt").to("cuda")
14out = model.generate(**inputs, max_new_tokens=128, do_sample=False)
15print(tokenizer.decode(out[0][inputs["input_ids"].shape[1]:]))