Inverse Reinforcement Learning Reveals Electricity Consumption Behavior Shifts

Enrico Cofler, Carlos Rodriguez-Pardo, Matteo Giuliani, Andrea Castelletti, Massimo Tavoni· July 7, 2026 View original

▶ The 2-minute explainer

Summary

This study uses Inverse Reinforcement Learning (IRL) to model household electricity consumption, treating households as agents responding to socioeconomic and climatic factors. It analyzes how "reward functions" representing consumption behavior change in response to shocks like heatwaves and energy crises, revealing heterogeneous and persistent shifts across consumer groups in Italy.

Understanding the complex ways households consume electricity, particularly how they react to socioeconomic changes and climatic events, is crucial for effective energy policy design. Traditional models often oversimplify this behavior, especially the non-linear responses to thermal stress influenced by income, habits, and the built environment. This research introduces a novel approach by treating households as intelligent agents interacting within their environment, applying Inverse Reinforcement Learning (IRL) to infer their consumption behavior through model-implied reward functions. The study specifically investigates how these inferred reward functions evolve when households experience significant shocks, such as the energy crisis and heatwaves between 2021 and 2023. Applied to different electricity consumption clusters in Italy, the framework revealed that cooling behaviors were reshaped heterogeneously across consumer groups, with responses conditioned by their existing habits and living conditions. The findings identified a spectrum of responses, from temporary adjustments to durable shifts, and even groups showing negligible change. Furthermore, the research highlighted that the timing of consumption (intradaily scale) is an independent dimension of behavioral heterogeneity, suggesting that energy policies should consider not just who consumers are and where they live, but also when they consume and the persistence of their behavioral changes.

Why it matters

This research provides a more nuanced understanding of consumer energy behavior, enabling policymakers and utility companies to design more effective and targeted demand-response programs and energy policies.

How to implement this in your domain

  1. 1Adopt Inverse Reinforcement Learning techniques to model complex consumer behaviors in other domains.
  2. 2Segment customer bases based on inferred reward functions to tailor energy efficiency programs.
  3. 3Design demand-response schemes that account for both socioeconomic factors and intradaily consumption timing.
  4. 4Monitor long-term behavioral shifts to assess the persistence of policy impacts.

Who benefits

Energy UtilitiesUrban PlanningPolicy MakingSmart Home Technology

Key takeaways

  • Inverse Reinforcement Learning can effectively model complex household electricity consumption behavior.
  • Socioeconomic and climatic shocks reshape consumption patterns heterogeneously across groups.
  • Consumer responses can be transient, durable, or negligible, depending on prior habits and environment.
  • Energy policies should consider consumer demographics, built environment, and consumption timing.

Original post by Enrico Cofler, Carlos Rodriguez-Pardo, Matteo Giuliani, Andrea Castelletti, Massimo Tavoni

"arXiv:2607.03176v1 Announce Type: new Abstract: Understanding how households consume electricity in response to socioeconomic and climatic drivers is important for decision-makers designing energy policies in a changing climate and under geopolitical tensions. Consumers respond d…"

View on X

Originally posted by Enrico Cofler, Carlos Rodriguez-Pardo, Matteo Giuliani, Andrea Castelletti, Massimo Tavoni on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses