RUBRIC Improves Imbalanced Classification with Smart Oversampling

Yanxuan Yu, Dong liu, Renata Borovica-Gajic, Ying Nian Wu· July 14, 2026 View original

Summary

RUBRIC is a generator-agnostic filtering framework that enhances imbalanced classification by ranking synthetic samples based on a realism-utility trade-off. It optimizes for quality over quantity, improving F1-macro and recall in risk-sensitive applications like fraud detection and medical diagnosis.

Class imbalance presents a significant hurdle in critical applications such as fraud detection and medical diagnosis, where minority-class samples are rare but crucial for accurate predictions. While oversampling methods generate synthetic data to balance class distributions, they often produce low-quality samples that can distort decision boundaries, lead to overfitting, and degrade generalization performance. Researchers introduce RUBRIC (Realism--Utility Balanced Ranking for Imbalanced Classification), a novel, generator-agnostic filtering framework designed to address these issues. RUBRIC reframes synthetic sample selection as a quality-over-quantity optimization problem. It ranks candidate synthetic samples by balancing two criteria: "realism," quantified by a discriminator distinguishing real from synthetic data, and "utility," which measures proximity to the decision boundary using a concave margin-based scoring function. The framework demonstrates that this filtering strategy, under mild conditions, tightens the generalization bound for margin-based classifiers by simultaneously reducing distribution shift and suppressing negative contributions from near-negative tail samples. Extensive experiments on credit-card fraud detection and other imbalanced benchmarks show that RUBRIC consistently improves F1-macro and recall while maintaining competitive ROC-AUC scores across various synthetic data generators.

Why it matters

Professionals in finance, healthcare, and cybersecurity can leverage RUBRIC to build more accurate and robust classification models for imbalanced datasets, significantly improving the detection of rare but critical events like fraud or disease.

How to implement this in your domain

  1. 1Integrate RUBRIC into existing machine learning pipelines that use oversampling for imbalanced datasets.
  2. 2Evaluate RUBRIC's performance on specific risk-sensitive applications, such as fraud detection or rare disease diagnosis.
  3. 3Experiment with different synthetic data generators in conjunction with RUBRIC to find optimal combinations.
  4. 4Develop monitoring metrics to track the quality and utility of synthetic samples generated and filtered by RUBRIC.

Who benefits

BFSIHealthcareCybersecurityE-commerceInsurance

Key takeaways

  • RUBRIC is a new framework for filtering synthetic samples in imbalanced classification.
  • It balances "realism" and "utility" to select high-quality synthetic data.
  • RUBRIC improves F1-macro and recall in risk-sensitive applications like fraud detection.
  • It helps reduce distribution shift and prevents overfitting from low-quality synthetic data.

Original post by Yanxuan Yu, Dong liu, Renata Borovica-Gajic, Ying Nian Wu

"arXiv:2607.09816v1 Announce Type: new Abstract: Class imbalance poses a fundamental challenge in risk-sensitive applications such as fraud detection and medical diagnosis, where minority-class samples are scarce yet critical for accurate classification. Existing oversampling meth…"

View on X

Originally posted by Yanxuan Yu, Dong liu, Renata Borovica-Gajic, Ying Nian Wu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses