Prompt Wording Impacts On-Device LLM Energy Consumption

Ruiyi Tao, Xiaolong Tu, Haoxin Wang· July 28, 2026 View original

Summary

A new study reveals that prompt design significantly affects the energy consumption of Large Language Models (LLMs) running on mobile and embedded devices. Empirical measurements show that specific linguistic features, like imperative keywords, can alter decoding length and total energy usage, offering a lightweight optimization lever.

The deployment of Large Language Models (LLMs) on mobile and embedded devices is growing due to benefits like enhanced privacy and reduced network latency. However, a major hurdle for on-device inference is the high energy consumption on battery-powered, resource-limited hardware. While efforts have focused on model compression and runtime acceleration, the impact of prompt design on energy efficiency has largely been overlooked. This paper presents an empirical investigation into how prompt wording influences the energy consumption of on-device LLMs. Using actual power measurements collected from a smartphone, the study quantifies the relationship between linguistic features, particularly imperative keywords and instruction structure, and their effect on decoding length and overall energy usage. The findings demonstrate consistent energy differences across various verbs and tasks, indicating that prompt engineering is not just about performance but also a surprisingly effective and lightweight method for improving energy efficiency. This suggests that careful crafting of prompts can lead to substantial power savings for LLMs operating in constrained environments.

Why it matters

For developers and product managers working with on-device AI, understanding the energy sensitivity of prompt design offers a new, low-cost optimization strategy to extend battery life and improve the sustainability of edge AI applications.

How to implement this in your domain

  1. 1Analyze the energy consumption of different prompt variations for your on-device LLM applications.
  2. 2Experiment with alternative imperative keywords and instruction structures to identify more energy-efficient prompts.
  3. 3Develop prompt engineering guidelines that prioritize energy efficiency alongside performance.
  4. 4Integrate energy profiling tools into your development workflow for on-device LLMs.
  5. 5Educate your team on the impact of prompt design on device battery life and user experience.

Who benefits

Mobile ComputingConsumer ElectronicsEdge AIIoTAutomotive

Key takeaways

  • On-device LLM inference faces significant energy consumption challenges.
  • Prompt design, specifically keyword choice, directly impacts energy usage.
  • Linguistic features can alter decoding length and total energy consumption.
  • Prompt engineering offers a lightweight lever for improving energy efficiency on edge devices.

Original post by Ruiyi Tao, Xiaolong Tu, Haoxin Wang

"arXiv:2607.22568v1 Announce Type: new Abstract: Large Language Models (LLMs) are increasingly deployed on mobile and embedded devices to improve privacy and reduce network latency. Yet on-device inference faces a fundamental constraint: high energy consumption on battery-powered,…"

View on X

Originally posted by Ruiyi Tao, Xiaolong Tu, Haoxin Wang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses