SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer
Abstract
Domain fit: AI-core · Core AI workload signals detected from paper context and implementation/artifact evidence.
Real-time streaming video-to-video editing (V2V) is critical for interactive applications such as live broadcasting and gaming, yet it remains a formidable challenge due to the stringent requirements for temporal consistency and inference throughput. In this paper, we present SANA-Streaming, a system-algorithm co-designed framework for high-resolution, real-time streaming video editing on consumer GPUs, with the following three core designs: (1) Hybrid Diffusion Transformer architecture introduces softmax attention in part of the blocks to improve local modeling capabilities while preserving the efficiency of linear layers. (2) Cycle-Reverse Regularization is a novel training strategy that enforces semantic consistency by predicting source frames from generated content via flow matching, improving temporal consistency without requiring paired long edited videos. (3) Efficient System Co-design combines fused GDN kernels and Mixed-Precision Quantization (MPQ) optimized for the NVIDIA Blackwell (RTX 5090) architecture. By profiling real-world throughput, our MPQ maximizes Tensor Core utilization while maintaining generation quality. The resulting system achieves real-time 1280 x 704 resolution editing at 24 end-to-end FPS on a single RTX 5090 GPU, with the DiT core running at 58 FPS. Experimental results demonstrate that our co-design approach significantly outperforms existing SOTA methods in both temporal coherence and system throughput.
Results and benchmarks
Real-time streaming video-to-video editing (V2V) is critical for interactive applications such as live broadcasting and gaming, yet it remains a formidable challenge due to the stringent requirements for temporal consistency and inference throughput.
Benchmark evidence is limited
Evidence graph: 4 refs, 4 links.
Utility signals: depth 60/100, grounding 85/100, status medium.
Implementation
Best maintained implementation now
SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer
8,812 stars · 708 forks · Last push Aug 23, 2026 · Apache-2.0 license
- License
- CI
- Dependencies
- Docker
Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (8812 stars)
NVlabs/Sana is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (Apache-2.0).
Open NVlabs/Sana- No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
- Selected NVlabs/Sana as the strongest maintained implementation for new work.
- Includes CI workflow signals.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Active
- Confidence
- Medium
- Reproducibility
- Strong
- Stars
- 8,812
- Last push
- Aug 23, 2026 (2d)
Matched via arXiv identifier search · Strong overlap with paper title keywords
- Maintenance
- Recently updated
- Confidence
- Low
- Reproducibility
- Strong
- Stars
- 0
- Last push
- Jul 25, 2026 (31d)
Matched via arXiv identifier search
- No tagged releases
- Low confidence match
- Maintenance
- Active
- Confidence
- Low
- Reproducibility
- Strong
- Stars
- 0
- Last push
- Jul 28, 2026 (28d)
Matched via arXiv identifier search
- No tagged releases
- Low confidence match
Reproduction readiness
Ready to run
Ready to reproduce
- Clone NVlabs/Sana and install dependencies from pyproject.toml.
- Dockerfile available for containerized reproduction.
- CI pipeline detected, so automated tests are in place.
- Last updated 2 days ago.
Hardware requirements
- (3) Efficient System Co-design combines fused GDN kernels and Mixed-Precision Quantization (MPQ) optimized for the NVIDIA Blackwell (RTX 5090) architecture.
- The resulting system achieves real-time 1280 x 704 resolution editing at 24 end-to-end FPS on a single RTX 5090 GPU, with the DiT core running at 58 FPS.
Quick start
git clone https://github.com/NVlabs/Sana.git
pip install -e . Validation caveat
Repositories and ecosystem
No additional verified repositories beyond the primary recommendation.
These repositories had low-confidence matching signals and are hidden by default.
- alphaXiv/sana-d11564ce
Confidence: Low · 0 stars
- alphaXiv/sana-e31d1f5d
Confidence: Low · 0 stars
- Soterix/ldt-sr
Confidence: Low · 0 stars
Hugging Face artifacts
No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.
Models
- nvidia/nemotron-3.5-asr-streaming-0.6b
1,046,924 downloads · 1,057 likes
- nvidia/nemotron-speech-streaming-en-0.6b
142,991 downloads · 612 likes
- nvidia/diar_streaming_sortformer_4spk-v2
30,720 downloads · 139 likes
Broaden model search
Datasets
- xrorrim/streaming_vlm
1,651 downloads · 0 likes · Updated Sep 8, 2025
- Pramish/egooops_streaming
18 downloads · 0 likes · Updated Sep 4, 2025
Broaden dataset search
Spaces
No trustworthy spaces matches right now.
Search spaces on Hugging FaceResearch context
Tasks
None detected
Methods
Transformer, Diffusion, Quantization
Domains
Computer vision
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.