SUM Framework Boosts Federated Class Incremental Learning.

Jaeik Kim, Jaeyoung Do· July 23, 2026 View original

Summary

SUM (Unified Geometric Surgery on Spatio-Temporal Adaptation Vectors) is a server-side framework that addresses spatial and temporal interference in Federated Class Incremental Learning (FCIL). It reinterprets FCIL as a multi-task problem and uses geometric surgery on adaptation vectors during aggregation to improve performance by up to 22% without extra client-side overhead.

Real-world intelligent systems often require both distributed collaboration (Federated Learning, FL) and continuous adaptation to new tasks (Continual Learning, CL). Combining these, known as Federated Class Incremental Learning (FCIL), introduces complex "spatial-temporal catastrophic forgetting" due to interference from diverse clients and sequential tasks. Existing solutions typically tackle these interferences separately, often adding computational or communication burdens on client devices. This research proposes SUM (Unified Geometric Surgery on Spatio-Temporal Adaptation Vectors), a novel server-side framework. SUM reinterprets FCIL as a unified multi-task learning problem, representing both client and task updates as adaptation vectors in a shared parameter space. The core innovation lies in performing "geometric surgery" on these adaptation vectors during the aggregation phase on the server. Spatial SUM mitigates client-level interference within each training round, while causal online temporal SUM addresses cross-task interference over time. Crucially, SUM achieves this without requiring additional client-side computation, communication, or memory beyond standard federated training. Empirical results show SUM improving performance by up to 22% over prior FCIL methods across various benchmarks, demonstrating robustness and efficiency.

Why it matters

SUM offers a highly efficient and effective way to enable AI models to continuously learn from distributed, evolving data without compromising privacy or incurring significant client-side costs, critical for real-world deployments.

How to implement this in your domain

  1. 1Evaluate current federated learning pipelines for challenges related to class incremental learning and catastrophic forgetting.
  2. 2Investigate server-side aggregation techniques that can perform geometric operations on model updates.
  3. 3Pilot SUM-like approaches in a simulated federated environment to assess performance gains and resource efficiency.
  4. 4Collaborate with AI research teams to integrate advanced aggregation strategies into existing FL frameworks.

Who benefits

HealthcareMobile ComputingIoTFinancial Services

Key takeaways

  • SUM is a server-side framework for Federated Class Incremental Learning (FCIL).
  • It addresses spatial and temporal interference by reinterpreting FCIL as a multi-task problem.
  • SUM uses geometric surgery on adaptation vectors during aggregation.
  • It improves performance by up to 22% without additional client-side computation or communication.

Original post by Jaeik Kim, Jaeyoung Do

"arXiv:2607.19384v1 Announce Type: new Abstract: Real-world intelligent systems often require both distributed collaboration across data-isolated clients and continual adaptation to evolving tasks. This setting naturally gives rise to Federated Class Incremental Learning (FCIL), w…"

View on X

Originally posted by Jaeik Kim, Jaeyoung Do on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses