LLM Agent Message Format Effects are Tier-Dependent in Multi-Hop Relays.

Zayx Shawn· July 14, 2026 View original

Summary

This research investigates how message formats affect information fidelity in multi-hop LLM agent relays, finding that strong agents maintain high fidelity regardless of format, while weaker agents show significant format-dependent recall spread. Structured formats like JSON offer error localization but not error correction.

A new study examines the impact of message formats on information transfer between Large Language Model (LLM) agents in multi-hop communication scenarios. Contrary to some existing literature, the research finds that the effects of message format are highly dependent on the "tier" or capability of the relaying agent. The study used a controlled testbed where atomic facts were re-encoded across six hops in various formats, including free natural language, precision-instructed natural language, JSON, triples, and key-value pairs. For strong, capable relay agents, the information transfer was nearly lossless, debunking the "telephone-game" collapse often feared in such systems. Even with added cognitive load per hop, format-level fidelity remained largely unchanged, though generation costs increased. However, when a weaker 1.5B parameter relay agent was used, the spread in six-hop recall across different formats dramatically increased. This was driven by a trade-off: rigid formats incurred an encoding toll, but fixed-key JSON schema showed resistance to drift, leading to a flip in format ranking during transit. Crucially, the research found that structured formats like JSON provide a "faithful, error-localizing channel" rather than an "error-correcting code." Injected errors persisted to the final hop in 83-100% of chains across all formats, closely matching the retention of true values. This implies that while structured formats can help maintain the integrity of individual facts, they do not inherently correct errors once introduced. The choice of message format should therefore be guided by the capabilities of the weakest agent in the communication pipeline.

Why it matters

Professionals designing and deploying multi-agent LLM systems need to carefully consider message formats based on agent capabilities to ensure reliable information transfer, prevent data degradation, and understand the limitations of structured communication.

How to implement this in your domain

  1. 1Assess the capabilities of all LLM agents in a multi-hop relay system before selecting message formats.
  2. 2Prioritize structured formats like JSON for critical information transfer, especially with weaker agents, to localize errors.
  3. 3Implement robust error detection and handling mechanisms, as structured formats do not inherently correct errors.
  4. 4Design agent communication protocols that account for potential information drift, particularly when using less capable LLMs.
  5. 5Conduct thorough testing of multi-hop agent relays with various message formats to validate fidelity and identify vulnerabilities.

Who benefits

AI/ML DevelopmentSoftware EngineeringRoboticsCustomer Service AutomationBusiness Process Automation

Key takeaways

  • Message format impact in multi-hop LLM agent relays depends on agent capability.
  • Strong agents maintain high fidelity across formats; weaker agents show significant format-dependent variance.
  • Structured formats like JSON localize errors but do not correct them.
  • The "telephone-game" collapse is not inevitable with strong agents.

Original post by Zayx Shawn

"arXiv:2607.09678v1 Announce Type: new Abstract: When LLM agents hand off information to one another, does the message format matter? Two literatures disagree: format-optimization work reports that structured messages cut cost without hurting accuracy, while format-restriction wor…"

View on X

Originally posted by Zayx Shawn on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses