New ACE Module Boosts LLM Agent Context Management

Ning Liao, Zihao Long, Xiaoxing Wang, Xue Yang, Yaoming Wang, Ziyuan Zhuang, Xunliang Cai, Rongxiang Weng, Junchi Yan· July 1, 2026 View original

Summary

Researchers introduce ACE (Adaptive Context Elasticizer), a plug-and-play module that dynamically manages historical information for LLM-based agents. ACE maintains a lossless message layer and adaptively orchestrates context, significantly improving performance across various agent frameworks without architectural changes.

As AI agents tackle increasingly complex tasks, the length of their operational trajectories grows, posing a significant challenge for large language models (LLMs) with fixed context windows. Traditional context management methods, such as truncation or summarization, are often inflexible and irreversible, meaning crucial information can be permanently lost or compressed.To overcome these limitations, a new module called ACE (Adaptive Context Elasticizer) has been developed. ACE is designed as a plug-and-play component that dynamically manages historical step information within an agent's context. It features a lossless message maintenance layer that stores both raw and compressed versions of past messages, alongside a context orchestration layer that intelligently decides whether to present each historical step as raw, abstract, or to drop it, based on the current task state.This reversible design ensures that the LLM always receives a compact yet information-rich context. ACE was successfully adapted to four different agent frameworks—ReAct, DeepAgent, WebThinker, and MiroFlow—without requiring any training or architectural modifications. Experiments demonstrated that ACE consistently outperformed existing truncation and summarization baselines, delivering performance gains across all tested frameworks.

Why it matters

For professionals building or deploying LLM-based agents, improving context management is crucial for handling complex, multi-step tasks efficiently and reliably. ACE offers a practical solution to enhance agent performance and reduce errors caused by context window limitations.

How to implement this in your domain

  1. 1Evaluate existing LLM agent workflows for context window limitations and performance bottlenecks.
  2. 2Integrate the ACE module into current agent frameworks to test its impact on task completion and accuracy.
  3. 3Experiment with ACE's adaptive context orchestration settings to optimize for specific agentic tasks.
  4. 4Monitor the trade-offs between computational cost and performance gains when using ACE in production environments.

Who benefits

AI DevelopmentSoftware DevelopmentCustomer ServiceAutomationResearch & Development

Key takeaways

  • Fixed context windows limit LLM agents in complex, long-trajectory tasks.
  • ACE offers a reversible, adaptive solution for managing historical context.
  • It stores both raw and compressed messages, dynamically selecting what to present.
  • ACE significantly improves performance across diverse agent frameworks.

Original post by Ning Liao, Zihao Long, Xiaoxing Wang, Xue Yang, Yaoming Wang, Ziyuan Zhuang, Xunliang Cai, Rongxiang Weng, Junchi Yan

"arXiv:2606.31564v1 Announce Type: new Abstract: The increasing complexity of agentic tasks has led to rapidly growing trajectory lengths, which poses significant challenges for large language model (LLM) based agents with fixed context windows. Existing context management techniq…"

View on X

Originally posted by Ning Liao, Zihao Long, Xiaoxing Wang, Xue Yang, Yaoming Wang, Ziyuan Zhuang, Xunliang Cai, Rongxiang Weng, Junchi Yan on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses