Federated Explainable AI: A Comprehensive Review and Taxonomy

Masoume Gholizade, Fabrizio Ruffini, Pietro Ducange, Francesco Marcelloni· July 16, 2026 View original

Key takeaways

  • FedXAI combines privacy-preserving FL with transparent XAI.
  • Explainability is becoming integral to the entire FL lifecycle.
  • A new taxonomy classifies FedXAI methods by various criteria.
  • Key challenges include non-IID data, security threats, and standardized evaluation.

Who benefits

HealthcareBFSIGovernmentTelecommunicationsAutomotive

Summary

This survey systematically reviews Federated Explainable Artificial Intelligence (FedXAI), highlighting how explainability integrates into the Federated Learning (FL) lifecycle to address privacy and transparency. It introduces a taxonomy, reviews various approaches, examines evaluation practices, and identifies key open challenges in the field.

This comprehensive survey delves into the emerging field of Federated Explainable Artificial Intelligence (FedXAI), which combines the privacy-preserving benefits of Federated Learning (FL) with the transparency and trust offered by Explainable AI (XAI). While FL effectively addresses data confidentiality by keeping raw data local, it doesn't inherently resolve the inherent opacity of modern machine learning models. FedXAI aims to bridge this gap, ensuring both privacy and explainability are met. The paper emphasizes how explainability is transitioning from a post-hoc analysis tool to an integral component throughout the entire FL lifecycle, supporting critical functions such as aggregation, personalization, robustness, and system-level decision-making. To organize the diverse literature, the authors propose a new taxonomy that categorizes FedXAI methods based on the role of explainability, types of models and explainers, explanation scope, integration level, FL settings, and data heterogeneity. The review covers a wide range of approaches, from model-agnostic explanations to inherently interpretable federated models and aggregation mechanisms that are aware of explainability. The survey also critically examines current evaluation practices, pointing out a significant lack of standardized benchmarks and metrics for assessing explanation quality, stability, potential privacy leakage, and computational overhead in FedXAI systems. Finally, it identifies several key open challenges that need to be addressed, including achieving explainability under non-IID (non-independent and identically distributed) data conditions, mitigating explanation-centric security threats, developing communication-efficient XAI, enabling continual FedXAI, and effectively integrating domain knowledge and regulatory constraints into the framework.

Why it matters

For professionals building privacy-preserving AI systems, this survey provides a critical overview of FedXAI, offering insights into how to integrate transparency and trust while navigating complex challenges in distributed, sensitive data environments.

How to implement this in your domain

  1. 1Assess current federated learning initiatives for explainability gaps and privacy concerns.
  2. 2Explore integrating XAI techniques into the FL lifecycle, considering model-agnostic or interpretable federated models.
  3. 3Develop or adopt standardized benchmarks and metrics for evaluating FedXAI systems.
  4. 4Address challenges related to explainability under non-IID data and communication efficiency.
  5. 5Stay informed on regulatory requirements for AI explainability and privacy in distributed systems.

Original post by Masoume Gholizade, Fabrizio Ruffini, Pietro Ducange, Francesco Marcelloni

"arXiv:2607.13045v1 Announce Type: new Abstract: Federated Learning (FL) has emerged as a key paradigm for privacy-preserving collaborative model training across distributed and heterogeneous data sources. By keeping raw data local, FL addresses data confidentiality concerns, yet…"

View on X

Originally posted by Masoume Gholizade, Fabrizio Ruffini, Pietro Ducange, Francesco Marcelloni on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses