PolicyGuide Ensures LLM Agent Compliance Across Workflows.

Seongjae Kang, Taehyung Yu, Sung Ju Hwang· August 21, 2026 View original

Key takeaways

  • PolicyGuide ensures LLM agent compliance across multi-step workflows.
  • It compiles policies into workflow graphs and uses a proactive verifier.
  • The system significantly improves compliance and reduces errors compared to action-local checks.
  • It is transferable across different LLM agents and domains.

Who benefits

Customer ServiceBFSIHealthcareTelecommunicationsE-commerce

Summary

This paper introduces PolicyGuide, a system that compiles domain policies into workflow graphs to proactively guide LLM agents through multi-step procedures, ensuring compliance. It improves agent performance by reconciling open requests and providing step-specific remediation, significantly reducing compliance failures compared to action-local checks.

Large Language Model (LLM) agents operating in customer service roles must strictly adhere to organizational policies when performing actions on behalf of users. Compliance failures can stem from either forbidden actions, such as approving an ineligible request, or the omission of required procedural steps, like identity verification. While runtime safeguards can prevent risky individual actions, they often lack the ability to guide an agent through a complete, multi-step workflow. PolicyGuide addresses this limitation by compiling each domain policy into a comprehensive workflow graph. At the boundaries of user turns, a proactive verifier is invoked, which leverages the persisted graph state to reconcile any open requests. This system then returns step-specific remediation, effectively guiding the agent along a policy-compliant path throughout the entire procedure. Evaluations across airline, retail, and telecom domains, using a GPT-5.4 agent and verifier, demonstrated significant improvements. PolicyGuide raised the mean Pass4 score from 0.42 to 0.62, with the most substantial gain observed in the telecom domain (0.19 to 0.61), which is characterized by highly structured workflows. The same workflows were also successfully transferred to Claude Sonnet 4.6 and Gemini 2.5 Pro agents. Further assessments showed the lowest observed attack-success rate under adversarial users and the strongest procedural compliance, validating its effectiveness in ensuring policy adherence.

Why it matters

For businesses deploying LLM agents, PolicyGuide offers a critical solution for ensuring compliance with organizational policies, reducing risks associated with agent errors, and improving the reliability and trustworthiness of automated customer interactions.

How to implement this in your domain

  1. 1Analyze existing organizational policies to identify multi-step procedures suitable for workflow graph representation.
  2. 2Pilot PolicyGuide's approach by compiling a specific domain policy into a workflow graph for an LLM agent.
  3. 3Integrate a proactive verifier into your LLM agent's interaction loop to check policy compliance at each step.
  4. 4Evaluate the system's performance on compliance metrics and compare it to current safeguarding methods.
  5. 5Train policy and compliance teams on how to define and translate policies into structured workflows.

Original post by Seongjae Kang, Taehyung Yu, Sung Ju Hwang

"arXiv:2608.19861v1 Announce Type: new Abstract: Customer-service LLM agents must follow organizational policy when acting on a user's behalf. Compliance failures arise from either forbidden actions, such as granting an ineligible change, or omitted procedural requirements, such a…"

View on X

Originally posted by Seongjae Kang, Taehyung Yu, Sung Ju Hwang on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses