CAGI Improves Missing Data Imputation with Cluster-Aware Generative Approach

Chuyao Zhang, E Li, Taochen Chen, Yiqun Zhang, Yuzhu Ji, Shuping Zhao, Peng Liu, Yiu-ming Cheung· July 9, 2026 View original

Key takeaways

  • Existing imputation methods often fail to account for latent subgroup structures in data.
  • CAGI co-optimizes clustering and imputation to improve missing data recovery.
  • It uses a generative adversarial network guided by dynamic cluster assignments.
  • CAGI achieves superior performance by preserving subgroup distributions.

Who benefits

HealthcareFinanceMarketingSocial SciencesResearch

Summary

This paper introduces CAGI (Cluster-Aware Generative Imputation), a framework that co-optimizes clustering and imputation to recover missing data by exploiting latent subgroup structures. CAGI uses a "Partition-Guide-Restore" strategy with a Generative Adversarial Network to refine both cluster assignments and imputed values, outperforming existing methods.

Missing data is a common challenge in real-world datasets, making effective imputation a critical preprocessing step. Many existing imputation methods, however, overlook the inherent heterogeneity within data, where multiple subgroups might have distinct distributions. This oversight can lead to generic estimates that blur subgroup boundaries and lack accuracy at the individual instance level. The challenge lies in a circular dependency: reliable subgroup identification requires complete data, but data completion is the goal of imputation itself. To break this cycle, researchers propose CAGI (Cluster-Aware Generative Imputation). CAGI reframes clustering and imputation as a mutually reinforcing co-optimization process. It employs a "Partition-Guide-Restore" strategy where dynamic cluster assignments serve as local priors to guide a Generative Adversarial Network. An iterative feedback loop continuously refines both the cluster structures and the imputed values, ensuring they align with faithful subgroup distributions. Extensive experiments demonstrate CAGI's superior performance on various benchmark datasets.

Why it matters

Data scientists and analysts can significantly improve the quality of their datasets by using CAGI to handle missing values more accurately, especially in data with underlying subgroup structures, leading to more reliable downstream analysis and model performance.

How to implement this in your domain

  1. 1Evaluate current missing data imputation strategies for datasets with suspected latent subgroup structures.
  2. 2Explore the CAGI framework and its implementation for handling missing values in complex datasets.
  3. 3Apply CAGI to a real-world dataset with missing values and compare its performance against existing imputation methods.
  4. 4Consider how improved imputation can impact the accuracy and fairness of downstream machine learning models.

Original post by Chuyao Zhang, E Li, Taochen Chen, Yiqun Zhang, Yuzhu Ji, Shuping Zhao, Peng Liu, Yiu-ming Cheung

"arXiv:2607.06930v1 Announce Type: new Abstract: Missing data is prevalent in practical applications, making effective imputation an essential preprocessing step for downstream analysis. Real-world datasets often exhibit complex latent structures composed of multiple subgroups wit…"

View on X

Originally posted by Chuyao Zhang, E Li, Taochen Chen, Yiqun Zhang, Yuzhu Ji, Shuping Zhao, Peng Liu, Yiu-ming Cheung on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses