How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers
Andreas Steiner, Alexander Kolesnikov, Xiaohua Zhai, Ross Wightman, Jakob Uszkoreit +1 more
Abstract
Vision Transformers (ViT) have been shown to attain highly competitive performance for a wide range of vision applications, such as image classification, object detection and semantic image segmentation. In comparison to convolutional neural networks, the Vision Transformer's weaker inductive bias is generally found to cause an increased reliance on model regularization or data augmentation ("AugReg" for short) when...
Results & Benchmarks
| Task | Dataset | Metric | Value |
|---|---|---|---|
| Image classification | CIFAR-100 | Accuracy | 100 |
Best Implementation
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
- Selected rwightman/pytorch-image-models as the strongest maintained implementation for new work.
- Includes CI workflow signals.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
Reproduction Path
- 1
Start with rwightman/pytorch-image-models and validate setup instructions in README.
- 2
Reproduce the baseline result with the provided defaults before modifying hyperparameters.
- 3
Log exact dependency versions and runtime environment for reproducibility.
Additional Implementations
Official
- google-research/big_visionConfidence: low
Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
Stars: 3.4kForks: 220Last push: May 2025License: Apache-2.0
Community
No additional community repositories detected yet.
Hugging Face Artifacts
No direct paper-linked artifacts were found. Showing strongest curated related artifacts.