LLM Agent State Compression Impacts Constraint Preservation in Relays

Anantha Sharma, Sheeba Elizabeth John, Kaarthik Senthil Kumar, Saratsuhas Vijayababu· July 22, 2026 View original

Summary

This paper studies how state compression methods affect constraint preservation in two-agent LLM relays, specifically in a travel-planning scenario. It found that structured JSON extraction significantly outperforms narrative summarization in maintaining feasibility, while embedding-based pruning can match uncompressed controls, highlighting the importance of auditable representations.

In long-running Large Language Model (LLM) agent systems, intermediate states often grow large, necessitating compression before being passed to subsequent decision-making steps. This compression creates an information bottleneck where critical details can be lost, potentially breaking strict numeric or categorical constraints. This study investigates the impact of different state compression techniques on constraint preservation within a two-agent LLM relay system, using a closed-world travel-planning scenario. The experiment involved a "Researcher" agent auditing hotel and flight inventory and a "Booker" agent selecting a pair based solely on the goal and the compressed hand-off payload. Four hand-off conditions were compared: no compression, narrative summarization, schema-constrained JSON extraction, and embedding-based pruning. The results showed that the hand-off representation critically affects downstream feasibility. JSON extraction achieved the highest feasibility accuracy at 0.96, while narrative summarization, despite being the most compact, degraded feasibility to 0.48. Embedding-based pruning performed well, matching the uncompressed control at 0.88 without an additional generative compression call. These findings underscore that structured, auditable hand-off representations are superior to mere brevity for preserving constraints.

Why it matters

For professionals designing multi-agent LLM systems, understanding how state compression impacts constraint preservation is crucial for building reliable and accurate workflows, especially in applications requiring strict adherence to rules or data integrity.

How to implement this in your domain

  1. 1Prioritize structured data formats like JSON for inter-agent communication in LLM relays.
  2. 2Avoid purely narrative summarization for state compression when strict constraints must be preserved.
  3. 3Explore embedding-based pruning as an efficient method for state compression that maintains high fidelity.
  4. 4Rigorously test the impact of chosen compression methods on downstream task feasibility and constraint adherence.

Who benefits

AI DevelopmentLogisticsTravelE-commerceProcess Automation

Key takeaways

  • State compression in multi-agent LLM systems can lead to loss of critical information and broken constraints.
  • Structured JSON extraction significantly outperforms narrative summarization for preserving feasibility.
  • Embedding-based pruning can maintain high feasibility accuracy comparable to uncompressed states.
  • Auditable, structured hand-off representations are crucial for reliable multi-agent LLM workflows.

Original post by Anantha Sharma, Sheeba Elizabeth John, Kaarthik Senthil Kumar, Saratsuhas Vijayababu

"arXiv:2607.18265v1 Announce Type: new Abstract: Long-running Large Language Model (LLM)-based agents often accumulate large intermediate traces containing audits, eliminations, and numeric calculations. In practice, this state is compressed before handing it to a downstream decis…"

View on X

Originally posted by Anantha Sharma, Sheeba Elizabeth John, Kaarthik Senthil Kumar, Saratsuhas Vijayababu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses