Optimize Federated Learning Communication with Expected Gain-based Escalation.

Mohamad Mestoukirdi, Vincent Corlay· July 1, 2026 View original

Summary

This research introduces a selective escalation protocol for vertical federated learning, reducing communication overhead by only invoking a second, more complex fusion round when a significant improvement in prediction accuracy is expected. It uses an analytical score derived from calibrated posteriors and classwise reliability estimates to decide when to escalate.

Vertical Federated Learning (VFL) allows multiple parties to collaboratively train models without sharing raw data, but the communication overhead for integrating information across different data views can be substantial. This paper proposes a two-round inference protocol designed to optimize this trade-off. A low-cost initial round generates a prediction, and a more resource-intensive second round, involving embedding fusion, is only triggered if it's predicted to significantly enhance the final decision. The core of the approach is an "expected-gain score" that determines when to escalate a sample to the second round. This score analytically combines calibrated pooled posteriors with class-wise reliability estimates, derived from held-out calibration data, making the routing decision interpretable without needing a separate routing network. Experiments show this router improves the communication-accuracy trade-off over existing baselines.

Why it matters

Professionals working with sensitive data across multiple organizations can significantly reduce computational and communication costs in federated learning while maintaining high predictive performance. This improves efficiency and makes VFL more practical for real-world deployment.

How to implement this in your domain

  1. 1Evaluate existing VFL pipelines to identify communication bottlenecks during inference.
  2. 2Integrate a two-round inference protocol, starting with a low-cost initial prediction.
  3. 3Develop or adapt an expected-gain scoring mechanism using calibration data to decide when to invoke a more complex fusion round.
  4. 4Test the system with held-out data to calibrate the pooled posteriors and classwise reliability estimates for accurate escalation decisions.
  5. 5Monitor communication overhead and prediction accuracy to fine-tune the escalation threshold.

Who benefits

HealthcareBFSIRetailGovernmentManufacturing

Key takeaways

  • Selective escalation in VFL can significantly reduce communication and computational overhead.
  • An expected-gain score, derived from calibrated data, provides an interpretable routing mechanism.
  • The two-round protocol balances efficiency with predictive performance in collaborative inference.
  • This method avoids the need for a separately trained routing network.

Original post by Mohamad Mestoukirdi, Vincent Corlay

"arXiv:2606.31331v1 Announce Type: new Abstract: Collaborative inference can improve predictive performance by integrating complementary information across agents, but applying collaborative fusion to every sample can incur unnecessary communication and computational overhead. Thi…"

View on X

Originally posted by Mohamad Mestoukirdi, Vincent Corlay on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses