TPGC Enhances Multi-Task Graph Pre-Training with Dual-Prior Prompts

Zhiyang Qiu, Yangtao Wang, Xiaocui Li, Yanzhao Xie, Siyuan Chen, Wensheng Zhang· September 2, 2026 View original

Key takeaways

  • TPGC improves multi-task graph pre-training by using dual-prior prompt initialization.
  • It explicitly models task-specific and global structural context for better prompts.
  • The method outperforms baselines in few-shot settings with fewer parameters and lower runtime.
  • TPGC enhances task relevance, structural awareness, and transferability of prompt representations.

Who benefits

Social NetworksDrug DiscoveryCybersecurityLogisticsMaterials Science

Summary

TPGC is a new solution for multi-task graph pre-training that uses a dual-prior prompt initialization to improve task relevance, structural awareness, and transferability. It achieves this by injecting task-prior and structure-prior knowledge into prompt representations, outperforming state-of-the-art baselines in few-shot settings.

This paper introduces TPGC (Task-Specific Prompt with Global Context), a novel approach designed to enhance multi-task graph pre-training, particularly in low-resource scenarios. Existing methods often rely on randomly initialized prompts, which can lead to poor alignment with specific tasks, graph structures, and overall transferability. TPGC addresses this by proposing a dual-prior prompt initialization solution that explicitly models the synergy between task-specific knowledge and global structural context. The framework incorporates a Task-Prior Injection Module, which conducts a short homologous multi-task pre-training on an auxiliary graph. This process allows prompt initialization to inherit optimization preferences relevant to various pretext tasks. Building on these task-aware representations, the Structure-Prior Injection Module then extracts transferable global structural context from the auxiliary graph, converting it into layer-wise prompt vectors by aggregating structurally informative node embeddings. Extensive experiments across six benchmarks for node and graph classification demonstrate that TPGC consistently outperforms state-of-the-art baselines in few-shot settings, while also requiring fewer downstream tunable parameters and lower runtime.

Why it matters

For professionals working with graph data and machine learning, TPGC offers a more efficient and effective way to adapt pre-trained graph models to new tasks, especially when labeled data is scarce, leading to better model performance and faster deployment.

How to implement this in your domain

  1. 1Explore integrating TPGC's dual-prior prompt initialization into your graph neural network (GNN) pipelines for multi-task learning.
  2. 2Apply TPGC in scenarios with limited labeled graph data to improve model transferability and performance.
  3. 3Investigate using auxiliary graphs to pre-train task-aware and structure-aware prompts for your specific domain.
  4. 4Benchmark TPGC against existing graph prompt learning methods to assess its benefits for your applications.

Original post by Zhiyang Qiu, Yangtao Wang, Xiaocui Li, Yanzhao Xie, Siyuan Chen, Wensheng Zhang

"arXiv:2609.00047v1 Announce Type: new Abstract: Graph prompt learning is an effective paradigm to adapt pre-trained graph models to downstream tasks in low-resource scenarios. However, existing multi-task graph pre-training frameworks generally use randomly initialized prompts, l…"

View on X

Originally posted by Zhiyang Qiu, Yangtao Wang, Xiaocui Li, Yanzhao Xie, Siyuan Chen, Wensheng Zhang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses