GAUGE Enhances Multimodal Classification with Incomplete Data.

Yunping Shi, En Yu, Kairui Guo, Jie Lu· August 7, 2026 View original

Key takeaways

  • GAUGE handles incomplete multimodal data by adaptively gating fine-grained evidence units.
  • It uses prediction-aware Taylor evidence scores to quantify unit impact.
  • The framework improves classification reliability without altering backbone architecture.
  • GAUGE outperforms baselines across diverse incomplete-input scenarios.

Who benefits

HealthcareAutonomous VehiclesRoboticsSecurityRetail

Summary

GAUGE is a lightweight counterfactual gating framework for incomplete multimodal classification that adaptively modulates fine-grained evidence units within modalities. It imputes missing data, scores counterfactual effects via Taylor evidence scores, and applies continuous gates to improve prediction reliability without altering backbone architecture.

Multimodal classification often assumes all modalities are available, but real-world data frequently suffers from incompleteness. Existing methods for handling missing modalities, such as imputation or dynamic fusion, typically operate at a coarse modality level, failing to selectively retain reliable components while suppressing misleading ones within a single recovered modality. GAUGE (Granularity-Adaptive Counterfactual Gating of Evidence) addresses this by providing a lightweight framework that operates at a fine-grained evidence unit level. It first imputes missing modalities and then encodes all inputs uniformly. Instead of explicit intervention, GAUGE uses prediction-aware Taylor evidence scores, derived from a single forward-backward pass, to quantify the counterfactual effect of each unit. These scores are then mapped to continuous gates, which apply additive attention-logit biases for unit-wise evidence modulation, crucially without modifying the backbone architecture. Experiments across six benchmarks show GAUGE outperforming strong baselines in diverse incomplete-input scenarios, establishing it as a principled and scalable solution for fine-grained evidence control.

Why it matters

For professionals working with multimodal data, GAUGE provides a robust and scalable solution to handle incomplete inputs, leading to more reliable and accurate classification models, especially in real-world scenarios where data is often imperfect.

How to implement this in your domain

  1. 1Integrate GAUGE into multimodal classification pipelines to robustly handle incomplete input data.
  2. 2Utilize GAUGE's fine-grained evidence modulation to improve prediction reliability by selectively weighting components within modalities.
  3. 3Apply Taylor evidence scores to quantify the impact of individual evidence units on model predictions.
  4. 4Experiment with GAUGE in applications where multimodal data is prone to missing information.

Original post by Yunping Shi, En Yu, Kairui Guo, Jie Lu

"arXiv:2608.05608v1 Announce Type: new Abstract: Multimodal classification typically assumes all modalities are available, yet real-world inputs are often incomplete. Imputation and dynamic fusion can mitigate such incompleteness, but existing methods operate at a coarse modality…"

View on X

Originally posted by Yunping Shi, En Yu, Kairui Guo, Jie Lu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses