Geometric Regularization Improves Long-Tailed Semi-Supervised Learning.

Hongyang He, Xinyuan Song, Yan Zhong, Daizong Liu, Yanbin Li, Yang-fan He, Wenqiao Zhang· August 24, 2026 View original

Key takeaways

  • Long-tailed distributions and noisy pseudo-labels are major SSL challenges.
  • Gaussian Bridge Consistency (GBC) uses semantic interpolation paths to address these.
  • A dynamic Prototype Atlas stores high-quality class anchors.
  • GBC and BridgeMix improve long-tail class performance and robustness.

Who benefits

HealthcareE-commerceAutonomous SystemsContent ModerationFinance

Summary

This paper introduces Gaussian Bridge Consistency (GBC), a novel framework that addresses long-tailed label distributions and noisy pseudo-labels in semi-supervised learning (SSL) by constructing semantic interpolation paths between unlabeled samples and high-quality class anchors. GBC, along with BridgeMix, significantly improves long-tail class performance without sacrificing scalability.

Real-world semi-supervised learning (SSL) often struggles with two major issues: highly imbalanced, long-tailed label distributions and the propagation of errors from noisy pseudo-labels. These challenges can severely limit a model's ability to generalize effectively and exacerbate confirmation bias, where the model reinforces its own incorrect predictions. To tackle these problems, researchers propose Gaussian Bridge Consistency (GBC), a new framework that leverages geometric regularization. GBC operates by creating semantic interpolation paths in the latent space, connecting unlabeled samples to reliable class prototypes stored in a dynamic Prototype Atlas. This atlas continuously updates with high-quality labeled and pseudo-labeled exemplars for each class. For every unlabeled instance, GBC forms a class-conditional Gaussian Feature Bridge, allowing the student model to smoothly transition from uncertain predictions to stable class prototypes. A bridge consistency loss is applied along this path to ensure alignment with a geometrically interpolated target distribution. Additionally, the paper introduces BridgeMix, a confidence-aware feature mixing strategy that interpolates both sample and anchor pairs, further enhancing cross-sample generalization. Extensive experiments confirm GBC's robustness and effectiveness, particularly in improving performance for under-represented long-tail classes in realistic SSL settings.

Why it matters

AI/ML practitioners working with imbalanced datasets and semi-supervised learning can use GBC to build more robust and fair models, significantly improving performance on rare classes without compromising overall scalability.

How to implement this in your domain

  1. 1Explore integrating Gaussian Bridge Consistency (GBC) into your semi-supervised learning pipelines, especially for long-tailed datasets.
  2. 2Implement the dynamic Prototype Atlas to maintain high-quality class anchors for improved pseudo-labeling.
  3. 3Apply the BridgeMix strategy to enhance cross-sample generalization and mitigate confirmation bias.
  4. 4Evaluate the impact of GBC on the performance of minority classes in your specific applications.

Original post by Hongyang He, Xinyuan Song, Yan Zhong, Daizong Liu, Yanbin Li, Yang-fan He, Wenqiao Zhang

"arXiv:2608.20710v1 Announce Type: new Abstract: Real-world semi-supervised learning (SSL) often encounters significant challenges with long-tailed label distributions and noisy pseudo-labels, which hinder generalization and amplify confirmation bias. In this work, we introduce a…"

View on X

Originally posted by Hongyang He, Xinyuan Song, Yan Zhong, Daizong Liu, Yanbin Li, Yang-fan He, Wenqiao Zhang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research

AI ResearchAI Engineering & DevTools

Harmony Improves Protein-Ligand Flexible Docking with Torsional Diffusion

Researchers introduce Harmony, a harmonic torsional diffusion framework for flexible protein-ligand docking that explicitly accounts for the periodic geometry of angular variables. This method improves ligand pose accuracy and pocket all-atom reconstruction on benchmarks like PDBBind and enhances the physical validity of generated complexes on PoseBusters.

Maksim Zhdanov, Pavel Strashnov, Vladislav KurenkovAug 24, 2026
AI Engineering & DevToolsAI Research

Multilingual Verifier Bias Impacts RLVR in LLM Mathematical Reasoning

A study reveals that exact-match verifiers in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Models (LLMs) exhibit significant language-dependent false-negative reward noise in multilingual mathematical reasoning. This bias, particularly pronounced in Japanese, stems from format and script variations, highlighting a cross-lingual selection bottleneck that impedes effective multilingual LLM training.

Chenyu Zhou, Qiliang Jiang, Xu ZhouAug 24, 2026
AI Engineering & DevToolsAI Research

TriPLU Improves Tiny Language Model Performance with Trilinear Product FFNs

Researchers introduce TriPLU, a Trilinear Product Linear Unit, which replaces gated FFNs in tiny decoder-only language models with a direct degree-3 product branch. This approach achieves better validation loss on character-level TinyStories and lower bits per byte on other datasets under low-learning-rate settings, suggesting benefits for small models in specific low-compute regimes.

He ZhangAug 24, 2026