GAttNHP Improves Event Forecasting in Temporal Knowledge Graphs

Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu· July 17, 2026 View original

Key takeaways

  • Forecasting in Temporal Knowledge Graphs faces challenges with long dependencies and sparse data.
  • GAttNHP uses self-attention, semantic grouping, and quantile regression for improved prediction.
  • The framework captures long-range temporal dependencies and inter-chain interactions.
  • GAttNHP significantly outperforms baselines on TKG datasets, especially for long-tail events.

Who benefits

FinanceCybersecurityHealthcareLogisticsSocial Media Analytics

Summary

This paper introduces GAttNHP, a Group Attention Neural Hawkes Process, to address challenges in forecasting future events on Temporal Knowledge Graphs (TKGs). It tackles long-range dependencies, mutual excitation/inhibition, and sparse inter-arrival times using a self-attention encoder, semantic soft-grouping, and Non-Crossing Quantile regression.

This research introduces GAttNHP (Group Attention Neural Hawkes Process), a novel framework designed to significantly improve the forecasting of future events within Temporal Knowledge Graphs (TKGs). TKGs, which record evolving facts over time, present several inherent difficulties for prediction: encoding long-range temporal dependencies, modeling mutual excitation or inhibition between different event chains, and handling heavy-tailed, statistically sparse inter-arrival times that make deterministic predictions unreliable. GAttNHP addresses these three core issues through a tightly integrated architecture. First, a self-attention encoder processes each subject-relation chain as a continuous-time point process, effectively capturing the lingering influence of distant historical events. Second, a semantic soft-grouping module transforms globally learnable Hawkes priors into an analytical cross-attention mask. This allows event chains to share excitation patterns based on their latent group memberships, avoiding computationally intensive exhaustive pairwise comparisons. Finally, a Non-Crossing Quantile (NCQ) regression head replaces traditional mean-based time prediction. This component provides calibrated, monotonically ordered quantile estimates that maintain stability even under heavy-tailed inter-arrival distributions. Extensive evaluations across six benchmark TKG datasets demonstrate that GAttNHP outperforms state-of-the-art baselines in both entity and time prediction. Ablation studies further confirm that its most substantial gains occur on long-tail event chains, precisely where existing models typically struggle the most.

Why it matters

Professionals working with dynamic, time-sensitive data can leverage GAttNHP to build more accurate predictive models for complex event sequences, enabling better strategic planning and anomaly detection.

How to implement this in your domain

  1. 1Evaluate existing temporal forecasting models for their ability to handle long-range dependencies and sparse data.
  2. 2Explore integrating Hawkes process models with attention mechanisms for event prediction in your domain.
  3. 3Consider adopting quantile regression for time prediction to better capture uncertainty and heavy-tailed distributions.
  4. 4Investigate how semantic grouping of event chains could improve the efficiency and accuracy of your TKG analysis.

Original post by Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu

"arXiv:2607.14733v1 Announce Type: new Abstract: Temporal Knowledge Graphs (TKGs) record how facts evolve over time, but forecasting future events on a TKG remains difficult for three reasons: (i) long-range temporal dependencies are hard to encode; (ii) events on different chains…"

View on X

Originally posted by Xiangni Tian, Kaixian Yu, Runpeng Dai, Niansheng Tang, Hongtu Zhu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research

AI ResearchAI Engineering & DevTools

New Optimizer Accelerates LLM Pretraining with Curvature-Conditioned Momentum

This research proposes a curvature-conditioned multiscale momentum method with sphere constraints to accelerate large language model pretraining. It addresses challenges from noise-dominant gradients and ill-conditioned loss landscapes by enhancing progress along flat directions, significantly improving upon existing adaptive optimizers like AdamW and Muon.

Shuchen Zhu, Yuxin Fang, Mingze Wang, Kun YuanAug 31, 2026
AI ResearchAI Engineering & DevTools

Euclidean Fourier Neural Operators Enhance Domain Transferability

This paper introduces Euclidean Fourier Neural Operators (EFNOs) as a domain-independent alternative to traditional FNOs, addressing their limitation in transferring across different periodic domains. EFNOs achieve this by parameterizing the spectral kernel as a continuous function of the physical wavevector, enabling consistent operator learning across varying domain shapes and sizes.

Nathanael Bosch, Niklas Frederik Schmitz, Michael F. HerbstAug 31, 2026
AI Engineering & DevToolsAI Research

SymboLLM-FE Boosts Feature Engineering with LLMs and Symbolic Regression

This paper introduces SymboLLM-FE, a novel approach combining symbolic regression and large language models for automated feature engineering on tabular data. It aims to generate highly interpretable and performant features while overcoming the limitations of traditional AutoFE and LLM-based methods.

Zi-Jian Cheng, Zi-Yi Jia, Zhi Zhou, Yu-Feng Li, Lan-Zhe GuoAug 31, 2026