Detecting Unique Neural Network "Fingerprints" After Collapse

Truong Xuan Khanh, Phan Thanh Duc· July 15, 2026 View original

Summary

Researchers developed an audited protocol to detect donor-specific functional fingerprints in independently trained neural networks, even after Neural Collapse has led to a shared low-dimensional geometry. The study successfully identified unique functional variations across networks, establishing detectability under specific test conditions.

Independently trained neural networks typically lack a common reference frame for their neurons, making direct comparisons challenging due to "coordinate freedom." This problem is exacerbated by Neural Collapse, a phenomenon where networks converge to a shared, low-dimensional geometric structure. A key question arises: can unique, trajectory-specific functional variations still be distinguished once this convergence has occurred? This research addresses the detectability aspect of this question, distinguishing it from transplantability or causal persistence. Using five independently trained networks that exhibited Neural Collapse on the MNIST dataset, the team applied a verified affine-correct alignment mapping to translate "donor" network heads into "recipient" coordinates. The findings demonstrated that donor-specific functional fingerprints remained distinguishable even after recipient-level baseline correction. All twenty ordered donor-recipient pairs were correctly identified, achieving a statistically significant exact permutation p-value of 0.0083. This result was robustly confirmed through a leakage audit. The study successfully establishes detectability under the specific testing conditions, providing a methodology for testing cross-network variation in a controlled environment, though its generalizability beyond this setting remains an open question.

Why it matters

Understanding how to identify unique functional characteristics in neural networks, even after they appear to converge, is crucial for debugging, auditing, and potentially transferring specific learned behaviors between models. This could lead to more robust and interpretable AI systems.

How to implement this in your domain

  1. 1Apply affine alignment techniques to compare and analyze functional differences between independently trained neural networks in your own projects.
  2. 2Develop auditing protocols to detect subtle, donor-specific functional variations in models that exhibit similar overall performance or structural convergence.
  3. 3Investigate the implications of "functional fingerprints" for model versioning, intellectual property, and transfer learning strategies.
  4. 4Utilize the methodology to identify and isolate specific learned features or biases within a neural network ensemble.
  5. 5Explore how these findings might inform strategies for model compression or distillation while preserving critical functional aspects.

Who benefits

AI/ML DevelopmentCybersecuritySoftware EngineeringResearch & Development

Key takeaways

  • Unique functional "fingerprints" can be detected in neural networks even after they converge to a shared geometry.
  • Affine alignment is a key technique for comparing independently trained models.
  • The research establishes detectability, opening avenues for auditing and understanding model variations.
  • This has implications for model debugging, transfer learning, and intellectual property.

Original post by Truong Xuan Khanh, Phan Thanh Duc

"arXiv:2607.11967v1 Announce Type: new Abstract: Independently trained neural networks have no shared neuron-index reference frame, so comparing them requires accounting for coordinate freedom. Neural Collapse sharpens this problem: networks converge toward a shared, low-dimension…"

View on X

Originally posted by Truong Xuan Khanh, Phan Thanh Duc on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses