OpenTrain AI
Maintained implementation availablepytorchPretrained Models Available

Masked Feature Prediction for Self-Supervised Visual Pre-Training

December 1, 2021arXiv: 2112.09133
1 repo7,336 stars~a few days to reproduce
arXiv PDF

Abstract

Results & Benchmarks

TaskDatasetMetricValue
Self-supervised Visual Pre-trainingTwo-Stream I3DTop-5 Accuracy90.0
Self-supervised Visual Pre-trainingip-CSN-152Top-5 Accuracy92.8

Hardware Requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Best Implementation

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

7.3k 1.3k Mar 2026 Apache-2.0
License
CI
Deps
Docker
  • Selected facebookresearch/SlowFast as the strongest maintained implementation for new work.
  • Repository activity is within the last 24 months.

Reproduction Path

  1. 1

    Start with facebookresearch/SlowFast and validate setup instructions in README.

  2. 2

    Reproduce the baseline result with the provided defaults before modifying hyperparameters.

  3. 3

    Log exact dependency versions and runtime environment for reproducibility.

Time to first repro: a few daysNo CI workflows detectedDependency manifest is missing

Additional Implementations

No additional verified repositories beyond the primary recommendation.

Hugging Face Artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts.