Inverse Reinforcement Learning Reveals Electricity Consumption Behavior Shifts

Enrico Cofler, Carlos Rodriguez-Pardo, Matteo Giuliani, Andrea Castelletti, Massimo Tavoni· July 7, 2026 View original

▶ The 2-minute explainer

Key takeaways

  • Inverse Reinforcement Learning can effectively model complex household electricity consumption behavior.
  • Socioeconomic and climatic shocks reshape consumption patterns heterogeneously across groups.
  • Consumer responses can be transient, durable, or negligible, depending on prior habits and environment.
  • Energy policies should consider consumer demographics, built environment, and consumption timing.

Who benefits

Energy UtilitiesUrban PlanningPolicy MakingSmart Home Technology

Summary

This study uses Inverse Reinforcement Learning (IRL) to model household electricity consumption, treating households as agents responding to socioeconomic and climatic factors. It analyzes how "reward functions" representing consumption behavior change in response to shocks like heatwaves and energy crises, revealing heterogeneous and persistent shifts across consumer groups in Italy.

Understanding the complex ways households consume electricity, particularly how they react to socioeconomic changes and climatic events, is crucial for effective energy policy design. Traditional models often oversimplify this behavior, especially the non-linear responses to thermal stress influenced by income, habits, and the built environment. This research introduces a novel approach by treating households as intelligent agents interacting within their environment, applying Inverse Reinforcement Learning (IRL) to infer their consumption behavior through model-implied reward functions. The study specifically investigates how these inferred reward functions evolve when households experience significant shocks, such as the energy crisis and heatwaves between 2021 and 2023. Applied to different electricity consumption clusters in Italy, the framework revealed that cooling behaviors were reshaped heterogeneously across consumer groups, with responses conditioned by their existing habits and living conditions. The findings identified a spectrum of responses, from temporary adjustments to durable shifts, and even groups showing negligible change. Furthermore, the research highlighted that the timing of consumption (intradaily scale) is an independent dimension of behavioral heterogeneity, suggesting that energy policies should consider not just who consumers are and where they live, but also when they consume and the persistence of their behavioral changes.

Why it matters

This research provides a more nuanced understanding of consumer energy behavior, enabling policymakers and utility companies to design more effective and targeted demand-response programs and energy policies.

How to implement this in your domain

  1. 1Adopt Inverse Reinforcement Learning techniques to model complex consumer behaviors in other domains.
  2. 2Segment customer bases based on inferred reward functions to tailor energy efficiency programs.
  3. 3Design demand-response schemes that account for both socioeconomic factors and intradaily consumption timing.
  4. 4Monitor long-term behavioral shifts to assess the persistence of policy impacts.

Original post by Enrico Cofler, Carlos Rodriguez-Pardo, Matteo Giuliani, Andrea Castelletti, Massimo Tavoni

"arXiv:2607.03176v1 Announce Type: new Abstract: Understanding how households consume electricity in response to socioeconomic and climatic drivers is important for decision-makers designing energy policies in a changing climate and under geopolitical tensions. Consumers respond d…"

View on X

Originally posted by Enrico Cofler, Carlos Rodriguez-Pardo, Matteo Giuliani, Andrea Castelletti, Massimo Tavoni on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research

AI ResearchAI Engineering & DevTools

Decoding Silent Reading from Non-Invasive EEG

This research demonstrates that open-vocabulary word-level and semantic information can be reliably decoded from non-invasive EEG during silent reading. Using a contrastive decoder and a large dataset from a single participant, the study shows decoding scales log-linearly with training data and extends to rare words.

Ingo Marquardt, Anthilia Alchanat, Priyanka JainAug 21, 2026
AI ResearchAI Engineering & DevTools

Exact Learning Coefficients for Singular Models

This paper presents the first deterministic algorithm for exactly computing local learning coefficients (Real Log Canonical Thresholds) for two-dimensional singular models. This breakthrough provides ground truth for calibrating sampling-based estimators and reveals algebraic structure in learning coefficients, outperforming sampling in shallow regimes.

Gr\'egoire Sergeant-Perthuis (CQSB, Sorbonne Universit\'e), Elias Tsigaridas (Ouragan Team, INRIA), Jules Tsukahara (Ouragan Team, INRIA)Aug 21, 2026
AI Engineering & DevToolsAI Research

Standardized ML Evaluation for Power System Protection

This paper proposes a standardized framework for evaluating machine learning applications in power system protection, addressing inconsistencies in current research. It defines seven critical study dimensions and instantiates the framework with a case study on fault classification and localization using a public benchmark.

Julian Oelhaf, Georg Kordowich, Paula Andrea P\'erez-Toro, Christian Bergler, Johann J\"ager, Andreas Maier, Siming BayerAug 21, 2026