from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Canfield/finetune-960f912e")
tokenizer = AutoTokenizer.from_pretrained("Canfield/finetune-960f912e")

# Generate text
messages = [
    {"role": "user", "content": "Hello, how are you?"}
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt")
outputs = model.generate(inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0]))

Training Details

Method: SFT
Base Model: mistralai/Mistral-7B-Instruct-v0.2
LoRA merged and quantization removed for inference compatibility