Skip to content
OpenTrain AIFor AI Companies

VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning

Junxiang Xu, Ruisi Wang, Fanyi Pu, Maijunxian Wang, Ran Ji +47 morePublished Aug 26, 2026
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Missing
Not verified yet
Time to first repro
A few hours
Fast first run
Risk flags
0
None detected

Abstract

Domain fit: AI-core · Core AI workload signals detected from paper context and implementation/artifact evidence.

Native visual reasoning treats visual generation as the medium of reasoning itself: visual states (i.e. images and videos) are not merely inputs to be understood or outputs to be rendered, but first-class substrates for problem solving beyond language. Yet progress remains bottlenecked by the lack of scalable training tasks, reliable feedback, and controlled comparisons across generative substrates. In this work, we introduce VBVR-Pro, a closed-loop testbed that makes native visual reasoning through generation trainable, verifiable, optimizable, and experimentally controllable. 1) Task scaling. VBVR-Pro turns visual reasoning into a controlled task space of 300 procedurally generated tasks. Models trained on VBVR-Pro show strong transfer beyond the proposed suite across seven external visual reasoning benchmarks such as RISE-Video, MME-CoF-Pro, and BabyVision. 2) Verifiable rewards. VBVR-Pro provides verifiable reward scorers for task-grounded evaluation. Through a systematic study of leading MLLMs as judges, we identify recurring failure modes of the prevalent VLM-as-a-judge paradigm. In contrast, the proposed scorers are grounded in deterministic, task-specific rules, achieve fine-grained alignment with human judgments. Importantly, they serve as reliable reward signals for large-scale multi-task reinforcement learning and demonstrate stronger post-RL performance across visual reasoning tasks. 3) Mechanism study. VBVR-Pro enables controlled modality studies across more than 30 image, video, and interleaved generators. Our analysis shows that video generation remains strongest for tasks requiring persistent spatiotemporal state tracking, while interleaved generation provides a compute-efficient alternative. Critically, ablations and probing suggest the presence of vision-native trajectories that are crucial to visual reasoning. We release all data, models, scorers, and code.

Results and benchmarks

Freshness tier: hot
Native visual reasoning treats visual generation as the medium of reasoning itself: visual states (i.e.

Implementation

Best maintained implementation now

Recommended
Confidence: Medium
Reproducibility: Strong

VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning

39 stars · 0 forks · Last push Oct 5, 2026 · NOASSERTION license

  • License
  • CI
  • Dependencies
  • Docker

Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (39 stars)

Why this implementation
Confidence: medium

Video-Reason/VBVR-Pro is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (NOASSERTION).

Open Video-Reason/VBVR-Pro
Reproduction risks
  • No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
  • Selected Video-Reason/VBVR-Pro as the strongest maintained implementation for new work.
  • Includes CI workflow signals.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

Video-Reason/VBVR-Pro
best maintained
Maintenance
Active
Confidence
Medium
Reproducibility
Strong
Stars
39
Last push
Oct 5, 2026 (25d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No tagged releases
  • No Docker setup
Maintenance
Recently updated
Confidence
Medium
Reproducibility
Moderate
Stars
13
Last push
Sep 15, 2026 (45d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No CI pipeline detected
  • No tagged releases
  • No Docker setup
Maintenance
Recently updated
Confidence
Low
Reproducibility
Limited
Stars
0
Last push
Sep 22, 2026 (38d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No CI pipeline detected
  • No tagged releases
  • No Docker setup

Reproduction readiness

Time to first repro: hours
Last checked: Oct 29, 2026

Ready to run

Ready to reproduce

  • Clone Video-Reason/VBVR-Pro and install dependencies from pyproject.toml.
  • CI pipeline detected, so automated tests are in place.
  • Last updated 25 days ago.
Open Video-Reason/VBVR-Pro

Quick start

git clone https://github.com/Video-Reason/VBVR-Pro.git
pip install -e .

Repositories and ecosystem

Official

No additional official repositories detected.

Community

  • Rule-based evaluation kit for VBVR-Pro-Bench — 100 visual-reasoning tasks, one hand-written evaluator each

    13 stars · 0 forks · Last push Sep 15, 2026 · NOASSERTION license

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.

Tip: start with models, then check datasets and spaces if you need evaluation data or demos.

Research context

Tasks

None detected

Methods

Reinforcement learning

Domains

Computer vision

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX
Explore similar papers

Jump to Paper2Code search queries derived from this paper's research context.