Base model: Qwen/Qwen2.5-7B-Instruct
Data sources: ../../03_data/prepared/alfworld_v3_fixed, ../../03_data/prepared/dbbench_v4
Method: LoRA (Unsloth)
Max sequence length: 2048
Epochs: 2
Learning rate: 2e-06
LoRA: r=128, alpha=256

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

model_id = "curio184/qwen25-7b-agent-exp04-G_r128_ep2"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

Sources & Terms (IMPORTANT)

Training data: ../../03_data/prepared/alfworld_v3_fixed, ../../03_data/prepared/dbbench_v4

Dataset License: MIT License. Compliance: Users must comply with the MIT license and the base model's original terms of use.