Views
No views yet
Qwen/Qwen2.5-1.5B-Instruct + the weather-intent LoRA adapter,
merged to fp16 so it can be quantized to GGUF (llama.cpp / Ollama) or served
directly. Parses a natural-language weather question into a compact structured
intent (JSON).| metric | base | finetuned |
|---|---|---|
| valid JSON | 100.0% | 100.0% |
| exact match | 64.5% | 98.6% |
| field accuracy | 90.7% | 99.7% |
| slot F1 | 0.894 | 0.996 |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3tok = AutoTokenizer.from_pretrained("Nicholas55555/qwen2.5-1.5b-weather-intent-merged")
4model = AutoModelForCausalLM.from_pretrained("Nicholas55555/qwen2.5-1.5b-weather-intent-merged", device_map="auto")
5
6sys = "You extract structured intent from weather questions. Return ONLY a JSON object..."
7msgs = [{"role": "system", "content": sys},
8 {"role": "user", "content": "will it rain in Paris this weekend?"}]
9prompt = tok.apply_chat_template(msgs, tokenize=False, add_generation_prompt=True)
10out = model.generate(**tok(prompt, return_tensors="pt").to(model.device), max_new_tokens=64)
11print(tok.decode(out[0], skip_special_tokens=True))