Fine-Tuned CLIP-GPT2 Model for Image Captioning

Model Details:

• Base Model: CLIP ViT-B/32
• Fine-Tuned On: VizWiz dataset
• Format: SafeTensors
• Usage:
  python

  1from transformers import CLIPProcessor, CLIPModel 2from PIL import Image 3 4model = CLIPModel.from_pretrained("vidi-deshp/clip-gpt2-finetuned") 5processor = CLIPProcessor.from_pretrained("openai/clip-vit-base-patch32") 6 7image = Image.open("sample.jpg") 8inputs = processor(images=image, return_tensors="pt") 9 10outputs = model(**inputs)