You can deploy this model and start earning money today!

vivekdhayaal/
vit-cvt-cifar10-experiments

Name: vit-cvt-cifar10-experiments
Availability: InStock

Views

No views yet

Vision Transformer & Convolutional ViT on CIFAR-10

This repository contains the experimental results, training curves, and attention map visualizations for a custom implementation of a Vision Transformer (ViT) and Convolutional Vision Transformer (CvT) trained from scratch on CIFAR-10.

Directory Structure

code/: Custom PyTorch implementations of Scaled Dot-Product Attention, Transformer Blocks, and standard/convolutional patch embeddings.
training_curves/: Loss and accuracy plots covering patch size variations, hyperparameter tuning, data augmentations, and positional embedding ablations.
visualizations/: Attention maps across heads, Attention Rollout flow, and Positional Embedding cosine similarity matrices.

vivekdhayaal/vit-cvt-cifar10-experiments

Vision Transformer & Convolutional ViT on CIFAR-10

Directory Structure

vivekdhayaal/
vit-cvt-cifar10-experiments