What is the best open-source implementation of "Kosmos-2: Grounding Multimodal Large Language Models to the World"?

The best maintained implementation is microsoft/unilm with 22,106 stars on GitHub. Confidence: high. Reproducibility: Limited.

How reproducible is "Kosmos-2: Grounding Multimodal Large Language Models to the World"?

Estimated time to first reproduction: a few days. Risk flags: No CI workflows detected, Dependency manifest is missing. Start with microsoft/unilm and validate setup instructions in README.

Are there pretrained models available for "Kosmos-2: Grounding Multimodal Large Language Models to the World"?

Yes, 3 Hugging Face models found. The top result is openmmlab-community/mm_grounding_dino_large_all with 19,082 downloads.

What framework is used to implement "Kosmos-2: Grounding Multimodal Large Language Models to the World"?

The primary implementation uses pytorch.

Kosmos-2: Grounding Multimodal Large Language Models to the World

Published: Jun 1, 2023

Best maintained implementation now

Evidence: Direct

Domain fit: AI-core

Verified repos: 1

Top repo stars: 22,106

Core AI workload signals detected from paper context and implementation/artifact evidence.

Framework: pytorch

Time to first repro: a few days

2 risk flags

arXiv PDF

Technical details

Canonical key: arxiv-2306.14824

Cache status: Stale (SWR served)

Generated at: Apr 28, 2026, 9:15 PM

Artifact coverage: direct

HF provider: ok (token)

PWC source used: Yes

LLM status: not_generated

LLM model: n/a

LLM generated: Unknown

LLM content type: n/a

HF policy: hf-relevance-v27

implementation starting point

Benchmarks: thin evidence

Time to repro: a few days

2 risk flags

pytorch

Results & Benchmarks

Freshness tier: hot

Direct + Inferred Evidence

Natural language processing

FewVLM

Flickr30k

31.0

Source: paper fulltext

Natural language processing

MetaLM

Flickr30k

43.4

Source: paper fulltext

Benchmark evidence drill-down

2 findings

Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure section below.

Task	Dataset	Metric	Value	Source	Evidence refs
Natural language processing	FewVLM	Flickr30k	31.0	paper-derived	No explicit refs
Natural language processing	MetaLM	Flickr30k	43.4	paper-derived	No explicit refs

Kosmos-2: Grounding Multimodal Large Language Models to the World is the primary contribution described in this paper.

Use This Implementation Because…

Confidence: high

microsoft/unilm is the strongest maintained implementation based on ranking signals. License is declared (MIT).

Open microsoft/unilm

Reproduction Risks

No CI workflows detected
Dependency manifest is missing

Hardware Notes

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Evidence disclosure

Evidence graph: 4 refs, 4 links.

Utility signals: depth 100/100, grounding 95/100, status high.

Implementation Comparison

Top 3 paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

microsoft/unilm

best maintained

Maintenance: Recently updated

Confidence: High

Reproducibility: Limited

Official implementation from Papers with Code · Community adoption signal (22106 stars)

Stars: 22,106
Last push: Jan 23, 2026 (98d ago)

Releases

Risk flags

No CI pipeline detected
No Docker setup
Dependency manifest missing

rabiulcste/vqazero

alternative

Maintenance: Stale

Confidence: Low

Reproducibility: Limited

Strong overlap with paper title keywords · Community adoption signal (28 stars)

Stars: 28
Last push: Sep 14, 2024 (594d ago)

Dependencies

Risk flags

No push in 12+ months
No CI pipeline detected
No tagged releases

thaolmk54/VisualLLM-

alternative

Maintenance: Recently updated

Confidence: Low

Reproducibility: Limited

Matched via arXiv identifier search

Stars: 0
Last push: Jan 15, 2026 (105d ago)

Dependencies

Risk flags

No CI pipeline detected
No tagged releases
No Docker setup

Best implementation now

microsoft/unilm

Confidence: High

Reproducibility: Limited

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Stars: 22,106

Forks: 2,696

Last push: Jan 23, 2026

License: MIT

Official implementation from Papers with Code

Community adoption signal (22106 stars)

License ✓

CI –

Deps –

Docker –

Selected microsoft/unilm as the strongest maintained implementation for new work.
Repository activity is within the last 24 months.

Reproduction readiness

Major Work

Time to first repro: days

Last checked: Apr 28, 2026

Hardware requirements

Expect multi-day setup/compute for meaningful reproduction based on current guidance.

No dependency manifest — manual reconstruction required

· microsoft/unilm has no requirements.txt, environment.yml, pyproject.toml, or Dockerfile.
· You will need to reverse-engineer dependencies from import statements in the source code.

Open microsoft/unilm