SAOT Improves Continual Graph Learning by Preserving Structure

Yuting Zhang, Yanbei Liu, Zhitao Xiao, Lei Geng, Yanwei Pang, Xiao Wang· July 2, 2026 View original

▶ The 2-minute explainer

Key takeaways

  • SAOT enhances self-supervised continual graph learning.
  • It explicitly preserves global relational structure using optimal transport.
  • Cross-task knowledge distillation prevents forgetting previous structural knowledge.
  • SAOT significantly outperforms existing baselines on CGL datasets.

Who benefits

Social MediaBioinformaticsCybersecurityE-commerceUrban Planning

Summary

Existing self-supervised continual graph learning (CGL) methods often distort global relational structures over time. This paper introduces SAOT, a novel framework that uses optimal transport theory and cross-task knowledge distillation to explicitly preserve graph structure, significantly outperforming baselines.

Self-supervised Continual Graph Learning (CGL) is a growing area of research focused on enabling models to learn sequentially from a stream of graph data without explicit label supervision. A common limitation of current CGL methods is their tendency to optimize individual nodes in isolation, which can lead to a progressive distortion of the overall relational structure within the graph as learning continues across different tasks. This structural degradation hinders the model's ability to maintain accurate inter-node correspondences. To address this, a new framework called SAOT (Structure-Aware Optimal Transport) has been developed. SAOT leverages optimal transport theory to explicitly capture and preserve the global relational structure within graph representations across sequential learning tasks. Additionally, it incorporates a mechanism for cross-task knowledge distillation, ensuring that previously acquired structural knowledge is retained. Extensive experiments on various CGL benchmarks demonstrate that SAOT significantly outperforms existing self-supervised baselines, achieving substantial accuracy gains, particularly in class-incremental learning scenarios.

Why it matters

For professionals dealing with evolving graph data (e.g., social networks, knowledge graphs, biological networks), SAOT offers a way to build more stable and accurate models that can continually learn without forgetting crucial structural information, leading to better insights and predictions.

How to implement this in your domain

  1. 1Explore SAOT for applications involving dynamic or continually evolving graph data.
  2. 2Integrate optimal transport theory into graph representation learning pipelines to preserve structural integrity.
  3. 3Implement cross-task knowledge distillation mechanisms for continual learning scenarios.
  4. 4Benchmark SAOT against existing CGL methods for tasks requiring robust structural preservation.

Original post by Yuting Zhang, Yanbei Liu, Zhitao Xiao, Lei Geng, Yanwei Pang, Xiao Wang

"arXiv:2607.00377v1 Announce Type: new Abstract: Self-supervised Continual Graph Learning (CGL) aims to successively learn from a graph sequence with different tasks without label supervision - a paradigm that has attracted widespread attention. Most existing self-supervised CGL m…"

View on X

Originally posted by Yuting Zhang, Yanbei Liu, Zhitao Xiao, Lei Geng, Yanwei Pang, Xiao Wang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses