Multi-Vector Index Compression in Any Modality
Hanxiang Qin, Alexander Martin, Rohan Jha, Chunsheng Zuo, Reno Kriz +1 more
Abstract
We study efficient multi-vector retrieval for late interaction in any modality. Late interaction has emerged as a dominant paradigm for information retrieval in text, images, visual documents, and videos, but its computation and storage costs grow linearly with document length, making it costly for image-, video-, and audio-rich corpora. To address this limitation, we explore query-agnostic methods for compressing mu...
Results & Benchmarks
| Task | Dataset | Metric | Value |
|---|---|---|---|
| Retrieval / indexing | Baseline | nDCG@10. | 71.9 |
| Retrieval / indexing | AGC | nDCG@10. | 70.1 |
| Retrieval / indexing | Qwen2.5-VL-3B | nDCG@10. | 71.5 |
| Retrieval / indexing | Qwen2.5-VL-7B | nDCG@10. | 73.0 |
Hardware Requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Best Implementation
Maintained implementation evidence is not confirmed for this paper yet.
Use the Implementation Status and Reproduction Path sections below for the current action plan.
Reproduction Path
Follow this baseline workflow to decide if this paper is worth immediate prototyping.
- 1
Use the paper and benchmark evidence to scope a baseline reproduction plan.
- 2
Track assumptions and missing details in an experiment log before coding.
Framework baselines
- Hugging Face Transformers training guide
Modern transformer training baseline.
- PyTorch nn.Transformer docs
Reference transformer building block implementation.
Additional Implementations
Official
No additional official repositories detected.
Community
- HanxiangQin/omni-col-pressConfidence: low
A modular framework for training and inference of (compressed) multi-vector retrieval across any modality.
Stars: 20Forks: 2Last push: Apr 2026License: MIT
Hugging Face Artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches: