Unified Agent Manages Cross-Device AI Interactions.

Xinshuang Liu, Runfa Blark Li, Shaoxiu Wei, Xin Lin, Truong Nguyen· August 7, 2026 View original

Key takeaways

  • Existing AI agents struggle with managing interactions across multiple devices and time.
  • Unified Agent introduces a stateful design to carry interaction evidence across contexts.
  • A compact, action-ready state is crucial for effective cross-device AI.
  • Unified Agent significantly outperforms other designs, demonstrating robust state-design advantages.

Who benefits

Consumer ElectronicsSmart HomeAutomotivePersonal AssistantsSoftware Development

Summary

Unified Agent is a new stateful AI agent designed to manage user interactions across multiple devices and over time by maintaining a compact, action-ready state of engagement evidence and requests. It significantly outperforms existing multi-agent and single-agent systems on a new cross-device benchmark.

As AI agents become more sophisticated, their ability to operate seamlessly across a user's various devices and over extended periods is becoming increasingly important. However, current agent systems are not adequately designed for this multi-device, multi-temporal interaction paradigm. Traditional single agents often lack effective state management for observations scattered across different devices and moments, while multi-agent systems, though coordinated, fail to maintain the compact, carried state necessary for a continuous cross-device user request. This research argues for a new approach where the agent maintains an effectively designed state that consolidates engagement evidence, stated facts, and ongoing requests into a concise, action-ready form. This state then informs the agent's actions based on current observations. To validate this principle, a new benchmark for user-agent interaction across devices and time was constructed. The proposed system, Unified Agent, embodies this stateful design. It carries interaction evidence across devices and moments, using it in conjunction with current observations to act intelligently. In evaluations, Unified Agent significantly outperformed adaptations of four published designs. Its advantage remained robust across variations in multimodal large language model (MLLM) families, capabilities, and reasoning efforts, demonstrating the inherent strength of its state-design approach. The code and data will be publicly available.

Why it matters

This breakthrough enables more coherent and persistent AI assistance across a user's digital ecosystem, leading to a more natural and effective user experience with AI.

How to implement this in your domain

  1. 1Analyze your current AI agent architectures for their ability to maintain state across devices and time.
  2. 2Investigate implementing a compact, action-ready state design for your next-generation AI assistants.
  3. 3Develop a benchmark for evaluating cross-device, cross-time user-agent interactions relevant to your product.
  4. 4Explore how multimodal large language models can be integrated with stateful agent designs for enhanced capabilities.

Original post by Xinshuang Liu, Runfa Blark Li, Shaoxiu Wei, Xin Lin, Truong Nguyen

"arXiv:2608.05729v1 Announce Type: new Abstract: As capabilities rapidly increase, AI agents can move from running inside one app to acting across a user's devices over time. Yet existing agent systems still fall short in this scenario. This is because observations are scattered a…"

View on X

Originally posted by Xinshuang Liu, Runfa Blark Li, Shaoxiu Wei, Xin Lin, Truong Nguyen on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses