ModalImmune: Immunity Driven Unlearning via Self Destructive Training
Rong Fu, Jia Yee Tan, Wenxin Zhang, Zijian Zhang, Ziming Wang +4 more
Abstract
Multimodal systems are vulnerable to partial or complete loss of input channels at deployment, which undermines reliability in real-world settings. This paper presents ModalImmune, a training framework that enforces modality immunity by intentionally and controllably collapsing selected modality information during training so the model learns joint representations that are robust to destructive modality influence. Th...
Summary
ModalImmune is a multimodal training framework that enforces modality immunity by intentionally collapsing selected modality information during training so models learn joint representations robust to destructive modality influence. This page includes benchmark evidence for Immunity Driven Unlearning Self Destructive Training on IEMOCAP. Reproduction guidance focuses on implementation viability and concrete risk controls.
Key Contributions
- ModalImmune is a multimodal training framework that enforces modality immunity by intentionally collapsing selected modality information during training so models learn joint representations robust to destructive.
- The ModalImmune framework combines a spectrum-adaptive collapse regularizer, an information-gain guided controller, curvature-aware gradient masking, and a Neumann-truncated hyper-gradient procedure for meta-parameter.
- Empirical evaluation on standard multimodal benchmarks is reported to show that ModalImmune improves resilience to modality removal and corruption while retaining convergence stability and reconstruction capacity.
- ModalImmune is evaluated on multimodal sentiment and emotion benchmarks including CMU-MOSI, CMU-MOSEI, and IEMOCAP using metrics such as Acc2, Acc7, F1, MAE, and correlation.
- Reported experiments focus on a small set of standard multimodal datasets, primarily CMU-MOSI, CMU-MOSEI, and IEMOCAP, which may limit evidence of generalization to other modalities or domains.
Reproducibility Notes
- Estimate is based on paper-only reproduction flow.
Results & Benchmarks
| Task | Dataset | Metric | Value |
|---|---|---|---|
| Immunity Driven Unlearning Self Destructive Training | IEMOCAP | Accuracy | 76.1 |
Hardware Requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Best Implementation
Maintained implementation evidence is not confirmed for this paper yet.
Use the Implementation Status and Reproduction Path sections below for the current action plan.
Reproduction Path
Follow this baseline workflow to decide if this paper is worth immediate prototyping.
- 1
Use the paper and benchmark evidence to scope a baseline reproduction plan.
- 2
Track assumptions and missing details in an experiment log before coding.
Additional Implementations
No additional verified repositories beyond the primary recommendation.
Hugging Face Artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches: