WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
Abstract
Domain fit: AI-adjacent · Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.
Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose. The key insight is to let the requested viewpoint shape how multi-view evidence is compressed into the video generator's limited token budget. Trained jointly with the video generator, a memory encoder and pose-conditioned readout module integrate historical observations into a fixed set of target view-specific tokens before denoising, without explicit depth-based correspondences. By combining this memory with recent temporal context and few-step distillation, WorldCrafter enables streaming scene exploration from a single input image or text prompt. Experiments across static and dynamic scenes show substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploration.
Results and benchmarks
Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints.
Benchmark evidence is limited
Evidence graph: 4 refs, 4 links.
Utility signals: depth 55/100, grounding 85/100, status medium.
Implementation
Best maintained implementation now
[Arxiv 2026] WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
544 stars · 23 forks · Last push Oct 28, 2026 · NOASSERTION license
- License
- CI
- Dependencies
- Docker
Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (544 stars)
TencentARC/WorldCrafter is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. License is declared (NOASSERTION). Dependency/environment manifests are present.
Open TencentARC/WorldCrafter- No CI workflows detected
- Selected TencentARC/WorldCrafter as the strongest maintained implementation for new work.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
Reproduction readiness
Setup required
Dependencies pinned, manual setup needed
- TencentARC/WorldCrafter has pyproject.toml but requires manual environment setup.
- No Dockerfile, so you will set up the environment manually.
- No CI pipeline, so test coverage is unknown.
Quick start
git clone https://github.com/TencentARC/WorldCrafter.git
pip install -e . Validation caveat
Hugging Face artifacts
No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.
Models
- TencentARC/WorldCrafter-Base
163 downloads · 13 likes
- TencentARC/WorldCrafter-Fast
0 downloads · 24 likes
Broaden model search
Datasets
No trustworthy datasets matches right now.
Search datasets on Hugging FaceSpaces
No trustworthy spaces matches right now.
Search spaces on Hugging FaceResearch context
Tasks
None detected
Methods
None detected
Domains
Computer vision
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.