Geometric Regularization Improves Long-Tailed Semi-Supervised Learning.
Key takeaways
- Long-tailed distributions and noisy pseudo-labels are major SSL challenges.
- Gaussian Bridge Consistency (GBC) uses semantic interpolation paths to address these.
- A dynamic Prototype Atlas stores high-quality class anchors.
- GBC and BridgeMix improve long-tail class performance and robustness.
Who benefits
Summary
This paper introduces Gaussian Bridge Consistency (GBC), a novel framework that addresses long-tailed label distributions and noisy pseudo-labels in semi-supervised learning (SSL) by constructing semantic interpolation paths between unlabeled samples and high-quality class anchors. GBC, along with BridgeMix, significantly improves long-tail class performance without sacrificing scalability.
Why it matters
AI/ML practitioners working with imbalanced datasets and semi-supervised learning can use GBC to build more robust and fair models, significantly improving performance on rare classes without compromising overall scalability.
How to implement this in your domain
- 1Explore integrating Gaussian Bridge Consistency (GBC) into your semi-supervised learning pipelines, especially for long-tailed datasets.
- 2Implement the dynamic Prototype Atlas to maintain high-quality class anchors for improved pseudo-labeling.
- 3Apply the BridgeMix strategy to enhance cross-sample generalization and mitigate confirmation bias.
- 4Evaluate the impact of GBC on the performance of minority classes in your specific applications.
Original post by Hongyang He, Xinyuan Song, Yan Zhong, Daizong Liu, Yanbin Li, Yang-fan He, Wenqiao Zhang
"arXiv:2608.20710v1 Announce Type: new Abstract: Real-world semi-supervised learning (SSL) often encounters significant challenges with long-tailed label distributions and noisy pseudo-labels, which hinder generalization and amplify confirmation bias. In this work, we introduce a…"
View on XOriginally posted by Hongyang He, Xinyuan Song, Yan Zhong, Daizong Liu, Yanbin Li, Yang-fan He, Wenqiao Zhang on X · view source
Want to go deeper?
Turn these trends into skills with Learnijoy's hands-on AI & tech courses.
Explore coursesMore in AI Research
Harmony Improves Protein-Ligand Flexible Docking with Torsional Diffusion
Researchers introduce Harmony, a harmonic torsional diffusion framework for flexible protein-ligand docking that explicitly accounts for the periodic geometry of angular variables. This method improves ligand pose accuracy and pocket all-atom reconstruction on benchmarks like PDBBind and enhances the physical validity of generated complexes on PoseBusters.
Multilingual Verifier Bias Impacts RLVR in LLM Mathematical Reasoning
A study reveals that exact-match verifiers in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Models (LLMs) exhibit significant language-dependent false-negative reward noise in multilingual mathematical reasoning. This bias, particularly pronounced in Japanese, stems from format and script variations, highlighting a cross-lingual selection bottleneck that impedes effective multilingual LLM training.
TriPLU Improves Tiny Language Model Performance with Trilinear Product FFNs
Researchers introduce TriPLU, a Trilinear Product Linear Unit, which replaces gated FFNs in tiny decoder-only language models with a direct degree-3 product branch. This approach achieves better validation loss on character-level TinyStories and lower bits per byte on other datasets under low-learning-rate settings, suggesting benefits for small models in specific low-compute regimes.