HP-JEPA Enhances Graph Representation Learning with Multi-Resolution

Ruichen Xu, Jingxiang Qu, Wenhan Gao, Jiaxing Zhang, Linsey Pang, Ravid Shwartz-Ziv, Yann LeCun, Yuefan Deng· August 4, 2026 View original

Key takeaways

  • HP-JEPA uses hierarchical partitioning for multi-resolution graph representation learning.
  • It captures complementary patterns at different graph scales, unlike single-resolution JEPAs.
  • The framework integrates local, regional, and global structural information.
  • HP-JEPA significantly outperforms fixed-resolution baselines on various graph tasks.

Who benefits

Social MediaPharmaceuticalsCybersecurityLogisticsMaterials Science

Summary

This paper introduces HP-JEPA, a hierarchical partitioning framework for multi-resolution graph joint-embedding predictive learning. It addresses limitations of single-resolution graph JEPAs by integrating representations from coarse-to-fine graph partitions, improving performance on graph classification and regression tasks.

Graph self-supervised learning is crucial for extracting transferable representations from vast amounts of unlabeled graph data. While Joint-Embedding Predictive Architectures (JEPAs) have shown promise by predicting masked targets in latent space without explicit negative-pair construction, existing graph JEPAs typically rely on a single, predefined graph partition. This limitation biases the learned representations towards one structural granularity, hindering their ability to capture diverse patterns across different scales within a graph. To overcome this, the research proposes HP-JEPA, a hierarchical partitioning framework. HP-JEPA organizes each graph into an ordered bank of coarse-to-fine partition resolutions. It then performs context-target latent prediction independently at each resolution using an online encoder, a target encoder, and a latent predictor. The resulting resolution-specific graph representations are subsequently integrated, allowing downstream models to combine complementary local, regional, and global structural information. Experiments across various graph classification and regression benchmarks demonstrate that HP-JEPA consistently outperforms fixed-resolution Graph-JEPA baselines, particularly showing improved accuracy across different graph sizes.

Why it matters

Learning robust and transferable representations from graph data is essential for many AI applications, and this method offers a way to capture more comprehensive structural information.

How to implement this in your domain

  1. 1Explore HP-JEPA for improving representation learning in graph-based AI applications like fraud detection or drug discovery.
  2. 2Integrate multi-resolution graph partitioning into your self-supervised learning pipelines for graph data.
  3. 3Experiment with different methods of integrating resolution-specific graph representations for downstream tasks.
  4. 4Benchmark HP-JEPA against existing graph representation learning techniques on your specific datasets.

Original post by Ruichen Xu, Jingxiang Qu, Wenhan Gao, Jiaxing Zhang, Linsey Pang, Ravid Shwartz-Ziv, Yann LeCun, Yuefan Deng

"arXiv:2608.00491v1 Announce Type: new Abstract: Graph self-supervised learning aims to learn transferable representations from large-scale unlabeled graph data. Joint-embedding predictive architectures (JEPAs) avoid explicit negative-pair construction and raw-input reconstruction…"

View on X

Originally posted by Ruichen Xu, Jingxiang Qu, Wenhan Gao, Jiaxing Zhang, Linsey Pang, Ravid Shwartz-Ziv, Yann LeCun, Yuefan Deng on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses