Skip to content
OpenTrain AIFor AI Companies

MOSS-VL Technical Report

Pengyu Wang, Chenkun Tan, Shaojun Zhou, Qirui Zhou, Yanxin Chen +27 morePublished Aug 15, 2026
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Thin evidence
Verify before relying
Time to first repro
A few hours
Fast first run
Risk flags
0
None detected

Abstract

Domain fit: AI-core · Core AI workload signals detected from paper context and implementation/artifact evidence.

We present MOSS-VL, an open vision-language model family that treats real-time interaction -- perceiving while it speaks -- as a first-class capability. It is co-designed across the stack: the language decoder attends to vision only through gated cross-attention, so the model can naturally see incoming frames while generating; a synthesized interaction corpus supervises when to speak, when to stay silent, and when to revise; and a staged curriculum concentrates all real-time-specific training in one light final stage over a strong offline foundation. Offline, MOSS-VL-Instruct is competitive at comparable scale and leads temporal-reasoning video sets. Across four streaming benchmarks, MOSS-VL-Realtime posts the best average on three (second on the fourth) among open-source streaming models, sweeping the three subsets that squarely test proactive behavior -- 66.0 vs. 37.5 for the best baseline on OmniMMI Proactive Alerting. With 11.3B parameters but visual tokens outside the decoded sequence, MOSS-VL widens its time-to-first-token advantage over same-backbone Qwen3-VL-8B from 2.8x to 5.1x as visual context grows. We release all five checkpoints, the training curriculum, and the real-time inference code at https://github.com/OpenMOSS/MOSS-VL.

Results and benchmarks

Freshness tier: hot
We present MOSS-VL, an open vision-language model family that treats real-time interaction -- perceiving while it speaks -- as a first-class capability.
Task Dataset Metric Value Source
Transformer MMBench-EN (v1.1) Gemma-4 12B-IT. 82.7 paper-derived
Transformer MMStar Gemma-4 12B-IT. 74.9 paper-derived
Transformer RealWorldQA Gemma-4 12B-IT. 65.6 paper-derived

Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.

Implementation

Best maintained implementation now

Recommended
Confidence: Medium
Reproducibility: Strong

MOSS-VL is the core multimodal model series within the OpenMOSS ecosystem, dedicated to visual understanding.

460 stars · 17 forks · Last push Aug 18, 2026 · Apache-2.0 license

  • License
  • CI
  • Dependencies
  • Docker

Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (460 stars)

Why this implementation
Confidence: medium

OpenMOSS/MOSS-VL is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (Apache-2.0).

Open OpenMOSS/MOSS-VL
Reproduction risks
  • No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
  • Selected OpenMOSS/MOSS-VL as the strongest maintained implementation for new work.
  • Includes CI workflow signals.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Reproduction readiness

Time to first repro: hours
Last checked: Aug 24, 2026

Ready to run

Ready to reproduce

  • Clone OpenMOSS/MOSS-VL and install dependencies from requirements.txt.
  • CI pipeline detected, so automated tests are in place.
  • Last updated 7 days ago.
Open OpenMOSS/MOSS-VL

Quick start

git clone https://github.com/OpenMOSS/MOSS-VL.git
pip install -r requirements.txt

Hugging Face artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.

Tip: start with models, then check datasets and spaces if you need evaluation data or demos.

Research context

Tasks

Transformer

Methods

Transformer

Domains

Computer vision, Natural Language Processing

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX
Explore similar papers

Jump to Paper2Code search queries derived from this paper's research context.