VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
Results and benchmarks
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text presents a transformer method.
| Task | Dataset | Metric | Value | Source |
|---|---|---|---|---|
| Language modeling | ImageNet | Top-1 Accuracy | 79.9 | paper-derived |
| Transformer | DaiNet | AUC | 95.8 | paper-derived |
| Transformer | LeeNet11 | AUC | 95.3 | paper-derived |
| Transformer | LeeNet24 | AUC | 96.3 | paper-derived |
Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.
Evidence graph: 4 refs, 4 links.
Utility signals: depth 100/100, grounding 95/100, status high.
Implementation
Best maintained implementation now
Google Research
38,611 stars · 8,464 forks · Last push Aug 21, 2026 · Apache-2.0 license
- License
- CI
- Dependencies
- Docker
Official implementation from Papers with Code · Community adoption signal (38611 stars)
google-research/google-research is the strongest maintained implementation based on ranking signals. License is declared (Apache-2.0).
Open google-research/google-research- No CI workflows detected
- Dependency manifest is missing
- Selected google-research/google-research as the strongest maintained implementation for new work.
- Repository activity is within the last 24 months.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Active
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 38,611
- Last push
- Aug 21, 2026 (4d)
Official implementation from Papers with Code · Community adoption signal (38611 stars)
- No CI pipeline detected
- No tagged releases
- No Docker setup
- Maintenance
- Stale
- Confidence
- Low
- Reproducibility
- Limited
- Stars
- 73
- Last push
- Jun 7, 2021 (1905d)
Partial overlap with paper title keywords · Community adoption signal (73 stars)
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
- Maintenance
- Stale
- Confidence
- Low
- Reproducibility
- Limited
- Stars
- 14
- Last push
- Jul 14, 2021 (1868d)
Matched via arXiv identifier search · Strong overlap with paper title keywords
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
Reproduction readiness
Major work
No dependency manifest, manual reconstruction required
- google-research/google-research has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
- You will need to reverse-engineer dependencies from import statements in the source code.
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Repositories and ecosystem
No additional verified repositories beyond the primary recommendation.
These repositories had low-confidence matching signals and are hidden by default.
- akashe/ProgrammingInterview
Confidence: Low · 73 stars
- sadimanna/self-supervised-learning-and-contrastive-learning-papers
Confidence: Low · 14 stars
Hugging Face artifacts
No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.
Models
- microsoft/Phi-4-multimodal-instruct
542,445 downloads · 1,612 likes
- multimodalart/higgs-audio-v3-tts-4b-transformers
36,510 downloads · 19 likes
- nvidia/Phi-4-multimodal-instruct-NVFP4
468,721 downloads · 13 likes
Broaden model search
Datasets
- geoffbremneraudio/Geoff_Bremner_Multimodal_Music_Corpus_SAMPLE
89 downloads · 2 likes · Updated Jul 6, 2026
Broaden dataset search
Spaces
No trustworthy spaces matches right now.
Search spaces on Hugging FaceResearch context
Tasks
Language modeling, Transformer
Methods
Transformer
Domains
Computer vision
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.
Data includes links from Papers with Code ( CC-BY-SA-4.0 ).