VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
Abstract
Domain fit: AI-core · Core AI workload signals detected from paper context and implementation/artifact evidence.
Native visual reasoning treats visual generation as the medium of reasoning itself: visual states (i.e. images and videos) are not merely inputs to be understood or outputs to be rendered, but first-class substrates for problem solving beyond language. Yet progress remains bottlenecked by the lack of scalable training tasks, reliable feedback, and controlled comparisons across generative substrates. In this work, we introduce VBVR-Pro, a closed-loop testbed that makes native visual reasoning through generation trainable, verifiable, optimizable, and experimentally controllable. 1) Task scaling. VBVR-Pro turns visual reasoning into a controlled task space of 300 procedurally generated tasks. Models trained on VBVR-Pro show strong transfer beyond the proposed suite across seven external visual reasoning benchmarks such as RISE-Video, MME-CoF-Pro, and BabyVision. 2) Verifiable rewards. VBVR-Pro provides verifiable reward scorers for task-grounded evaluation. Through a systematic study of leading MLLMs as judges, we identify recurring failure modes of the prevalent VLM-as-a-judge paradigm. In contrast, the proposed scorers are grounded in deterministic, task-specific rules, achieve fine-grained alignment with human judgments. Importantly, they serve as reliable reward signals for large-scale multi-task reinforcement learning and demonstrate stronger post-RL performance across visual reasoning tasks. 3) Mechanism study. VBVR-Pro enables controlled modality studies across more than 30 image, video, and interleaved generators. Our analysis shows that video generation remains strongest for tasks requiring persistent spatiotemporal state tracking, while interleaved generation provides a compute-efficient alternative. Critically, ablations and probing suggest the presence of vision-native trajectories that are crucial to visual reasoning. We release all data, models, scorers, and code.
Results and benchmarks
Native visual reasoning treats visual generation as the medium of reasoning itself: visual states (i.e.
Benchmark evidence is limited
Evidence graph: 3 refs, 3 links.
Utility signals: depth 55/100, grounding 75/100, status medium.
Implementation
Best maintained implementation now
VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
39 stars · 0 forks · Last push Oct 5, 2026 · NOASSERTION license
- License
- CI
- Dependencies
- Docker
Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (39 stars)
Video-Reason/VBVR-Pro is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (NOASSERTION).
Open Video-Reason/VBVR-Pro- No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
- Selected Video-Reason/VBVR-Pro as the strongest maintained implementation for new work.
- Includes CI workflow signals.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Active
- Confidence
- Medium
- Reproducibility
- Strong
- Stars
- 39
- Last push
- Oct 5, 2026 (25d)
Matched via arXiv identifier search · Strong overlap with paper title keywords
- No tagged releases
- No Docker setup
- Maintenance
- Recently updated
- Confidence
- Medium
- Reproducibility
- Moderate
- Stars
- 13
- Last push
- Sep 15, 2026 (45d)
Matched via arXiv identifier search · Strong overlap with paper title keywords
- No CI pipeline detected
- No tagged releases
- No Docker setup
- Maintenance
- Recently updated
- Confidence
- Low
- Reproducibility
- Limited
- Stars
- 0
- Last push
- Sep 22, 2026 (38d)
Matched via arXiv identifier search · Strong overlap with paper title keywords
- No CI pipeline detected
- No tagged releases
- No Docker setup
Reproduction readiness
Ready to run
Ready to reproduce
- Clone Video-Reason/VBVR-Pro and install dependencies from pyproject.toml.
- CI pipeline detected, so automated tests are in place.
- Last updated 25 days ago.
Quick start
git clone https://github.com/Video-Reason/VBVR-Pro.git
pip install -e . Validation caveat
Repositories and ecosystem
Official
No additional official repositories detected.
Community
- Video-Reason/VBVR-Pro-BenchConfidence: Medium
Rule-based evaluation kit for VBVR-Pro-Bench — 100 visual-reasoning tasks, one hand-written evaluator each
13 stars · 0 forks · Last push Sep 15, 2026 · NOASSERTION license
These repositories had low-confidence matching signals and are hidden by default.
- hokindeng/solve-vision-with-code
Confidence: Low · 0 stars
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.
Tip: start with models, then check datasets and spaces if you need evaluation data or demos.
Research context
Tasks
None detected
Methods
Reinforcement learning
Domains
Computer vision
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.