MOSS-VL Technical Report
Abstract
Domain fit: AI-core · Core AI workload signals detected from paper context and implementation/artifact evidence.
We present MOSS-VL, an open vision-language model family that treats real-time interaction -- perceiving while it speaks -- as a first-class capability. It is co-designed across the stack: the language decoder attends to vision only through gated cross-attention, so the model can naturally see incoming frames while generating; a synthesized interaction corpus supervises when to speak, when to stay silent, and when to revise; and a staged curriculum concentrates all real-time-specific training in one light final stage over a strong offline foundation. Offline, MOSS-VL-Instruct is competitive at comparable scale and leads temporal-reasoning video sets. Across four streaming benchmarks, MOSS-VL-Realtime posts the best average on three (second on the fourth) among open-source streaming models, sweeping the three subsets that squarely test proactive behavior -- 66.0 vs. 37.5 for the best baseline on OmniMMI Proactive Alerting. With 11.3B parameters but visual tokens outside the decoded sequence, MOSS-VL widens its time-to-first-token advantage over same-backbone Qwen3-VL-8B from 2.8x to 5.1x as visual context grows. We release all five checkpoints, the training curriculum, and the real-time inference code at https://github.com/OpenMOSS/MOSS-VL.
Results and benchmarks
We present MOSS-VL, an open vision-language model family that treats real-time interaction -- perceiving while it speaks -- as a first-class capability.
| Task | Dataset | Metric | Value | Source |
|---|---|---|---|---|
| Transformer | MMBench-EN (v1.1) | Gemma-4 12B-IT. | 82.7 | paper-derived |
| Transformer | MMStar | Gemma-4 12B-IT. | 74.9 | paper-derived |
| Transformer | RealWorldQA | Gemma-4 12B-IT. | 65.6 | paper-derived |
Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.
Evidence graph: 3 refs, 3 links.
Utility signals: depth 90/100, grounding 85/100, status high.
Implementation
Best maintained implementation now
MOSS-VL is the core multimodal model series within the OpenMOSS ecosystem, dedicated to visual understanding.
460 stars · 17 forks · Last push Aug 18, 2026 · Apache-2.0 license
- License
- CI
- Dependencies
- Docker
Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (460 stars)
OpenMOSS/MOSS-VL is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (Apache-2.0).
Open OpenMOSS/MOSS-VL- No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
- Selected OpenMOSS/MOSS-VL as the strongest maintained implementation for new work.
- Includes CI workflow signals.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
Reproduction readiness
Ready to run
Ready to reproduce
- Clone OpenMOSS/MOSS-VL and install dependencies from requirements.txt.
- CI pipeline detected, so automated tests are in place.
- Last updated 7 days ago.
Quick start
git clone https://github.com/OpenMOSS/MOSS-VL.git
pip install -r requirements.txt Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.
Datasets
Spaces
Tip: start with models, then check datasets and spaces if you need evaluation data or demos.
Research context
Tasks
Transformer
Methods
Transformer
Domains
Computer vision, Natural Language Processing
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.