Views
No views yet
| Parameter | Value |
|---|---|
| Base model | Qwen/Qwen3.5-9B |
| Method | QLoRA (4-bit NF4 via Unsloth) |
| LoRA rank | r=16, alpha=16 |
| Target modules | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
| Training data | 201 source files from 2 Android projects |
| File types | Kotlin (169), Gradle KTS (18), XML resources (14) |
| Epochs | 3 |
| Sequence length | 2048 |
| Learning rate | 2e-4 (cosine scheduler) |
| Hardware | T4 GPU (16GB VRAM) via Google Colab |
| Framework | Unsloth + TRL SFTTrainer |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2from peft import PeftModel
3
4model = PeftModel.from_pretrained(
5 AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-9B", device_map="auto"),
6 "antiableofnormies/qwen3.5-9b-lora-android-dev",
7)
8tokenizer = AutoTokenizer.from_pretrained("antiableofnormies/qwen3.5-9b-lora-android-dev")1python convert_lora_to_gguf.py --base Qwen3.5-9B-Q4_K_M.gguf --lora ./qwen3.5-style-lora/ --output style-adapter.gguf
2
3llama-server -m Qwen3.5-9B-Q4_K_M.gguf --lora style-adapter.gguf --host 0.0.0.0 -ngl 99 --ctx-size 32768 --port 8080 --mlock
4
5# Optional: merge into a standalone GGUF
6llama-export-lora -m Qwen3.5-9B-Q4_K_M.gguf --lora style-adapter.gguf -o qwen3.5-code-style-merged.gguf