Views
No views yet
| Parameter | Value |
|---|---|
| Base model | Qwen/Qwen2.5-Coder-7B-Instruct |
| Method | Supervised Fine-Tuning (SFT) with LoRA |
| LoRA rank | 16 |
| LoRA alpha | 32 |
| LoRA dropout | 0.1 |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Learning rate | 3e-4 |
| Epochs | 3 |
| Batch size | 1 (effective = 8 via gradient accumulation) |
| Max sequence length | 4096 |
| Packing | True |
| Loss on assistant only | True |
messages with user / assistant roles)1pip install transformers trl peft accelerate datasets
2python train.py1from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
2
3model_id = "randomtravellerai/mobile-game-test-plans-qwen2.5-coder-7b-lora"
4model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
5tokenizer = AutoTokenizer.from_pretrained(model_id)
6
7messages = [
8 {"role": "user", "content": "Write an end-to-end test plan for this mobile RPG game feature:\nFeature: Player opens the shop from the main hub, browses weapon skins, previews them on their character, and purchases using in-game currency."}
9]
10
11pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
12result = pipe(messages, max_new_tokens=1024)
13print(result[0]["generated_text"])