from optimum.intel import OVModelForSeq2SeqLM
from transformers import T5Tokenizer

# Load OpenVINO model
model = OVModelForSeq2SeqLM.from_pretrained("Mitchins/t5-base-artgen-multi-instruct-OpenVINO")
tokenizer = T5Tokenizer.from_pretrained("Mitchins/t5-base-artgen-multi-instruct-OpenVINO")

# Example usage
text = "woman in red dress"
prompt = f"Enhance this prompt (no lora): {text}"

inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_length=80)
result = tokenizer.decode(outputs[0], skip_special_tokens=True)

Performance

Base Model: T5-base (Google)
Training Samples: 297,282
Parameters: 222M
Format: OpenVINO IR (FP32)
Optimization: Intel CPU/GPU/VPU optimized

Optimized for Intel hardware (CPU, integrated GPU, VPU) with significant speedup compared to standard PyTorch inference.

Deployment

Perfect for Intel NUC and other Intel-based edge devices.