from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Canfield/finetune-53321404")
tokenizer = AutoTokenizer.from_pretrained("Canfield/finetune-53321404")

# Generate text
messages = [
    {"role": "user", "content": "Hello, how are you?"}
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt")
outputs = model.generate(inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0]))

Training Details

Method: SFT
Base Model: Qwen/Qwen3-4B
LoRA merged and quantization removed for inference compatibility