Explainable RL Enhances Adaptive Traffic Signal Control

Dickens Kwesiga, Nishu Choudhary, Angshuman Guin, Michael Hunter· July 7, 2026 View original

Summary

This paper introduces an explainable entity-centric Reinforcement Learning (RL) framework for adaptive traffic signal control, disaggregating traffic states into lane entities and phase configurations. It uses a dual-stage attention network to provide visual and analytical interpretability through an affinity matrix, ensuring operational reliability with deterministic action-masking.

Adaptive traffic signal control, while benefiting from Reinforcement Learning (RL), faces challenges due to the black-box nature of deep RL models, hindering acceptance and trust. This research proposes a novel, explainable entity-centric RL framework designed for transparency and safety in traffic management. Instead of processing traffic states as monolithic vectors, the architecture breaks down real-time intersection observations into distinct lane entities and phase configurations, preserving the intersection's structural topology. A dual-stage attention network dynamically extracts relational dependencies and inter-lane conflicts, generating a real-time affinity matrix. This matrix visually and analytically quantifies the influence of signal phases on traffic volumes and queues, providing full interpretability. To guarantee operational reliability, a deterministic action-masking interface is integrated into the Proximal Policy Optimization pipeline, explicitly preventing invalid phase transitions and ensuring compliance with safety constraints. The framework outperforms state-of-the-art baselines in delay minimization and aligns with established traffic engineering principles.

Why it matters

This explainable RL framework can build trust and facilitate the adoption of AI in safety-critical infrastructure like traffic control, leading to more efficient and safer urban mobility.

How to implement this in your domain

  1. 1Evaluate existing traffic management systems for integration with explainable RL components.
  2. 2Pilot the entity-centric RL framework in a simulated traffic environment.
  3. 3Collaborate with transportation engineers to validate the interpretability of the affinity matrix.
  4. 4Develop clear guidelines for implementing deterministic action-masking in safety-critical AI systems.

Who benefits

Smart CitiesTransportationUrban PlanningPublic Safety

Key takeaways

  • Explainable RL improves trust and adoption for adaptive traffic control.
  • The entity-centric framework preserves intersection topology for better analysis.
  • A dual-stage attention network provides visual and analytical interpretability.
  • Deterministic action-masking ensures operational safety and compliance.

Original post by Dickens Kwesiga, Nishu Choudhary, Angshuman Guin, Michael Hunter

"arXiv:2607.03703v1 Announce Type: new Abstract: Reinforcement Learning (RL) has emerged as a powerful paradigm for adaptive traffic signal control. However, in safety-critical infrastructure like traffic control, the opaque, black-box nature of deep RL models poses challenges for…"

View on X

Originally posted by Dickens Kwesiga, Nishu Choudhary, Angshuman Guin, Michael Hunter on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses