ABot-AgentOS Introduces General Robotic Agent Operating System with Memory

Jiayi Tian, Shiao Liu, Yuting Xu, Jia Lu, Zihao Guan, Honglin Han, Di Yang, Minqi Gu, Yifei Qian, Tianlin Zhang, Yanqing Zhu, Zeqian Ye, Menglin Yang, Fei Wang, Xu Hu, Xiuxian Li, Wei Zhang, Shihui Su, Yiyan Ji, Jingbo Wang, Ziteng Feng, Jiaheng Liu, Zhaoxiang Zhang, Xiaolong Wu, Mingyang Yin, Zedong Chu, Mu Xu· July 14, 2026 View original

Summary

ABot-AgentOS is a new robotic Agent Operating System designed to provide a deliberative layer for long-horizon embodied agents, featuring scene-conditioned planning, multi-modal memory, and edge-cloud collaboration. It introduces Universal Multi-modal Graph Memory and a failure-driven self-evolution loop to enable continual improvement and robust execution across diverse tasks.

While recent advancements in Vision-Language Models (VLMs) and Vision-Language-Action (VLA) systems have improved robotic perception and action, complex, long-duration embodied agents still lack a comprehensive runtime layer for advanced reasoning, memory management, and tool integration. To address this, researchers have developed ABot-AgentOS, a novel robotic Agent Operating System. ABot-AgentOS functions as a deliberative layer above low-level controllers, enabling capabilities such as scene-conditioned planning, context-isolated skill execution, multi-stage verification, and seamless edge-cloud collaboration. A core component is its Universal Multi-modal Graph Memory, a persistent system that converts various inputs—dialogue, visual observations, spatial context, temporal relations, and task traces—into structured nodes and edges, providing an auditable and continually evolving knowledge base. The system also incorporates a failure-driven self-evolution loop. This mechanism diagnoses memory failures and promotes "evo-assets" (improved runtime components) only to future evaluation splits, preventing data leakage while fostering continuous learning and improvement. Evaluated on a new benchmark called EmbodiedWorldBench, ABot-AgentOS demonstrated improved task success and goal completion compared to single-controller baselines, highlighting the benefits of a general agent OS layer for complex robotic tasks.

Why it matters

This research offers a foundational operating system for advanced robotic agents, enabling more complex, long-duration tasks and continuous learning, which is critical for developing truly autonomous systems in various applications.

How to implement this in your domain

  1. 1Explore integrating agent operating system concepts into existing robotic or autonomous system development pipelines.
  2. 2Investigate multi-modal memory architectures for storing and retrieving complex contextual information in AI applications.
  3. 3Implement failure-driven learning loops to enable continuous improvement and adaptation in deployed AI agents.
  4. 4Consider edge-cloud collaboration strategies for managing computational load and data storage in embodied AI systems.

Who benefits

RoboticsLogisticsManufacturingHealthcareDefense

Key takeaways

  • A dedicated Agent Operating System can significantly enhance the capabilities of long-horizon embodied robotic agents.
  • Multi-modal graph memory provides a robust, persistent, and auditable knowledge base for AI agents.
  • Failure-driven self-evolution enables continuous learning and improvement in autonomous systems.
  • ABot-AgentOS improves task success and goal completion in complex embodied environments.

Original post by Jiayi Tian, Shiao Liu, Yuting Xu, Jia Lu, Zihao Guan, Honglin Han, Di Yang, Minqi Gu, Yifei Qian, Tianlin Zhang, Yanqing Zhu, Zeqian Ye, Menglin Yang, Fei Wang, Xu Hu, Xiuxian Li, Wei Zhang, Shihui Su, Yiyan Ji, Jingbo Wang, Ziteng Feng, Jiaheng Liu, Zhaoxiang Zhang, Xiaolong Wu, Mingyang Yin, Zedong Chu, Mu Xu

"arXiv:2607.10350v1 Announce Type: new Abstract: Recent VLM and VLA systems have improved robotic perception and action prediction, yet long-horizon embodied agents still require a general runtime layer for reasoning, memory, tool use, verification, and cross-embodiment execution.…"

View on X

Originally posted by Jiayi Tian, Shiao Liu, Yuting Xu, Jia Lu, Zihao Guan, Honglin Han, Di Yang, Minqi Gu, Yifei Qian, Tianlin Zhang, Yanqing Zhu, Zeqian Ye, Menglin Yang, Fei Wang, Xu Hu, Xiuxian Li, Wei Zhang, Shihui Su, Yiyan Ji, Jingbo Wang, Ziteng Feng, Jiaheng Liu, Zhaoxiang Zhang, Xiaolong Wu, Mingyang Yin, Zedong Chu, Mu Xu on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses