OpenTrain AI
Maintained implementation availablepytorchPretrained Models Available

MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokens

April 1, 2024arXiv: 2404.03413
1 repo639 stars~a few hours to reproduce
arXiv PDF

Abstract

Best Implementation

Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding

639 71 Dec 2024 BSD-3-Clause
License
CI
Deps
Docker
  • Selected Vision-CAIR/MiniGPT4-video as the strongest maintained implementation for new work.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Reproduction Path

  1. 1

    Start with Vision-CAIR/MiniGPT4-video and validate setup instructions in README.

  2. 2

    Reproduce the baseline result with the provided defaults before modifying hyperparameters.

  3. 3

    Log exact dependency versions and runtime environment for reproducibility.

Time to first repro: a few hoursNo CI workflows detected

Additional Implementations

No additional verified repositories beyond the primary recommendation.

Hugging Face Artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts.

Curated Related