OpenTrain AI
Maintained implementation availablepytorchPretrained Models Available

Architecture-Agnostic Masked Image Modeling -- From ViT back to CNN

May 1, 2022arXiv: 2205.13943
2 repos657 stars~a few hours to reproduce
arXiv PDF

Abstract

Results & Benchmarks

TaskDatasetMetricValue
Computer visionImageNetTop-1 Accuracy400
Language modelingImageNetTop-1 Accuracy78.1
SegmentationCOCOAP800

Best Implementation

CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark

657 62 Oct 2025 Apache-2.0
License
CI
Deps
Docker
  • Selected Westlake-AI/openmixup as the strongest maintained implementation for new work.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.
  • Official repository is preserved separately as historical context.

Reproduction Path

  1. 1

    Start with Westlake-AI/openmixup and validate setup instructions in README.

  2. 2

    Reproduce the baseline result with the provided defaults before modifying hyperparameters.

  3. 3

    Log exact dependency versions and runtime environment for reproducibility.

Time to first repro: a few hoursNo CI workflows detected

Additional Implementations

No additional verified repositories beyond the primary recommendation.

Hugging Face Artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts.