Graph Foundation Models Vulnerable to Representation Attacks.

Pankaj Kumar, Subhankar Mishra· July 22, 2026 View original

Summary

This research identifies a new attack surface in graph foundation models: the alignment layer that maps inputs to a shared representation. Inference-time perturbations can collapse models, with some exhibiting specific fragilities not seen in plain graph networks.

Graph foundation models, which generalize across various graph domains by mapping all inputs into a single shared representation, possess a unique vulnerability. This study identifies the "alignment layer"—the component responsible for creating this shared representation—as a distinct attack surface previously unexplored. Unlike traditional graph neural networks, foundation models can be attacked specifically at this layer during inference, without needing access to their training data. The researchers demonstrated that directed perturbations within this representation space could cause multiple models to collapse. While the budget for these attacks was comparable to what a standard graph network might require, one model, OpenGraph, showed particular fragility in its spectral tokenizer, collapsing at a significantly lower budget. This specific vulnerability was traced directly to the tokenizer rather than the decoder, indicating an alignment-specific weakness. Furthermore, the study explored "realizable" input-space attacks, involving edits to edges, features, or text. These attacks successfully removed at least half of correct predictions on several models. The degree of fragility realized by an attacker with input access was found to correlate with how directly the decoder reads the representation, rather than the model's clean accuracy. This suggests that structural properties, like the decoder's local Lipschitz sensitivity, are better indicators of vulnerability than simple performance metrics.

Why it matters

Professionals deploying or developing graph foundation models need to be aware of these new attack vectors, especially in applications where data integrity and model reliability are critical.

How to implement this in your domain

  1. 1Conduct security audits specifically targeting the alignment layers of deployed graph foundation models.
  2. 2Implement robust input validation and anomaly detection mechanisms to identify potential representation-space perturbations.
  3. 3Research and develop defense mechanisms against inference-time attacks on shared representations.
  4. 4Prioritize models with lower decoder Lipschitz sensitivity when selecting graph foundation models for critical applications.

Who benefits

CybersecuritySocial MediaFinanceDrug DiscoverySupply Chain

Key takeaways

  • Graph foundation models have a unique attack surface in their shared representation layer.
  • Inference-time attacks can significantly degrade model performance.
  • Some models exhibit specific fragilities in their tokenizers.
  • Vulnerability correlates with decoder's directness of representation reading, not just clean accuracy.

Original post by Pankaj Kumar, Subhankar Mishra

"arXiv:2607.18567v1 Announce Type: new Abstract: A graph foundation model generalizes across graph domains by mapping every input into one shared representation before any task reasoning. We call this map the alignment layer, the component that separates a graph foundation model f…"

View on X

Originally posted by Pankaj Kumar, Subhankar Mishra on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses