THGFM: New Model for Temporal Heterogeneous Graph Learning

Yixin Peng, Diego Collarana, Er Jin, Stefan Decker· July 31, 2026 View original

Key takeaways

  • THGFM excels at learning from dynamic, heterogeneous graphs.
  • It uses a dual-branch architecture for efficient and specialized processing.
  • Relative time is directly integrated into its attention mechanism.
  • The model significantly outperforms existing graph transformer baselines.

Who benefits

Social MediaE-commerceFinanceTelecommunicationsLogistics

Summary

THGFM is a novel dual-branch temporal heterogeneous graph fusion model designed for dynamic relational systems with diverse node and relation types evolving over time. It combines parameter-efficient cross-type transfer with relation-aware specialization and integrates relative time directly into attention scores, outperforming existing graph transformer models.

Researchers have introduced THGFM, a Dual-Branch Temporal Heterogeneous Graph Fusion Model, specifically designed to address the complexities of learning on dynamic relational systems. These systems, common in real-world applications, feature diverse node and relation types that change over time, posing challenges for existing graph learning methods in balancing efficiency with specialized understanding. THGFM tackles these limitations through a unified dual-path architecture. It features a "Shared-Space Temporal Attention" branch for efficient cross-type knowledge transfer and a "Relational Type-Partitioned Temporal Attention" branch for specialized, relation-aware processing. These branches are integrated via a "Dual-Path Relational-Shared Fusion" mechanism, which uses type-conditioned non-competitive gated sum fusion to adaptively combine their outputs. Furthermore, THGFM innovates by incorporating "Rotary Temporal Attention," directly embedding relative time into the attention score calculation. The model consistently outperforms baseline graph transformer models across various academic benchmarks, demonstrating significant gains in performance.

Why it matters

This advanced graph learning model can unlock deeper insights from complex, evolving datasets, improving predictions and recommendations in areas like social networks, knowledge graphs, and supply chain analysis.

How to implement this in your domain

  1. 1Investigate THGFM for applications involving dynamic, multi-relational data, such as fraud detection or recommendation systems.
  2. 2Evaluate the benefits of dual-path architectures for balancing generalization and specialization in your graph neural network deployments.
  3. 3Experiment with integrating temporal information directly into attention mechanisms using techniques like Rotary Temporal Attention.
  4. 4Benchmark THGFM against current graph learning models on your organization's specific heterogeneous graph datasets.

Original post by Yixin Peng, Diego Collarana, Er Jin, Stefan Decker

"arXiv:2607.27303v1 Announce Type: new Abstract: Temporal heterogeneous graphs offer a natural abstraction for dynamic relational systems in which diverse node and relation types co-exist and evolve over time. Learning on such graphs requires jointly modeling cross-type structural…"

View on X

Originally posted by Yixin Peng, Diego Collarana, Er Jin, Stefan Decker on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses