Defining True AI Agency Beyond Engineered Workflows

Eric Xing, Mingkai Deng, Jinyu Hou· June 24, 2026 View original

▶ The 2-minute explainer

Summary

This paper critiques current AI "agent" models, arguing that genuine agency requires internalized structures for goals, identity, decision-making, self-regulation, and learning, rather than external scaffolding. It proposes the Goal-Identity-Configurator (GIC) architecture for general-purpose agentive systems.

The proliferation of AI systems marketed as "coding agents" or "AI co-scientists" has blurred the lines between automation and genuine agency, raising questions about both system capabilities and potential existential risks. This paper critically examines the current landscape of AI agents, drawing on philosophical concepts and science fiction portrayals to distinguish between engineered workflows and true autonomy. The authors argue that genuine agency necessitates the internalization of structures related to goals, identity, decision-making, self-regulation, and learning within the system itself, rather than relying on external scaffolding. They differentiate between "agentic" systems, whose competence stems from predefined workflows, and "agentive" systems, whose capabilities, including social interaction, emerge endogenously. This distinction defines the boundary between systems designed for specific tasks and those capable of operating autonomously in the open world. Building on this analysis, the paper proposes the Goal-Identity-Configurator (GIC) architecture for a general-purpose agent model. This architecture combines hierarchical goal decomposition, evolving identity, simulative reasoning grounded in a trained world model, learned self-regulation, and self-directed learning from both real and simulated experiences. The work also offers insights into the auditability, controllability, and safety of these more autonomous "agentive" systems, emphasizing the importance of human oversight.

Why it matters

For AI developers, researchers, and policymakers, this paper provides a crucial conceptual framework for understanding and building truly autonomous AI systems, clarifying what constitutes genuine agency versus advanced automation. This distinction is vital for responsible AI development, safety, and governance.

How to implement this in your domain

  1. 1Re-evaluate current AI "agent" definitions within your organization based on the proposed distinctions.
  2. 2Explore the GIC architecture principles when designing next-generation autonomous AI systems.
  3. 3Prioritize internalizing goal-setting, self-regulation, and learning capabilities in AI development.
  4. 4Develop new auditability and controllability mechanisms for increasingly agentive systems.
  5. 5Engage in discussions about the ethical and safety implications of true AI agency with stakeholders.

Who benefits

AI DevelopmentRoboticsResearch & AcademiaCybersecurityPublic Policy

Key takeaways

  • True AI agency requires internalized structures, not just external scaffolding.
  • A distinction is made between "agentic" (workflow-driven) and "agentive" (endogenous capability) systems.
  • The GIC architecture is proposed for general-purpose agentive models.
  • Understanding agency is crucial for AI safety, control, and development.

Original post by Eric Xing, Mingkai Deng, Jinyu Hou

"arXiv:2606.23991v1 Announce Type: new Abstract: What is an agent? What constitutes agency? With the rise of Large Language Model (LLM) systems marketed as ``coding agents'', ``AI co-scientists'', and other ``agentic" tools that promise to drive up productivity, and at the same ti…"

View on X

Originally posted by Eric Xing, Mingkai Deng, Jinyu Hou on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses