IBM Releases Open-Source Tools for Generative AI Safety Policies

Nathalie Baracaldo, Nicolas Mello, Kush R. Varshney, Heiko Ludwig, Kate Soule, David Cox· August 26, 2026 View original

Key takeaways

  • Tailored safety policies are crucial for generative AI applications due to diverse risks.
  • IBM's Granite.Trust Policy Tools offer an open-source solution for policy definition and enforcement.
  • The Actionable Policy schema uses YAML to specify content constraints for model responses.
  • A synthetic data pipeline helps generate policy-aligned data for model training and testing.

Who benefits

BFSIHealthcareLegalGovernmentTech

Summary

IBM has introduced Granite.Trust Policy Tools, an open-source framework for defining and enforcing content-based safety policies for generative AI applications. It includes an Actionable Policy schema (YAML-based) for specifying model response constraints and a synthetic data generation pipeline for alignment and testing.

IBM has launched a new open-source initiative called Granite.Trust Policy Tools, designed to help organizations manage safety and content policies for generative AI applications. The core idea is that a one-size-fits-all approach to AI safety is insufficient, as different use cases and regulatory environments demand tailored risk mitigation strategies. The framework offers two main components: first, an "Actionable Policy schema," a YAML-based format that allows users to precisely define what generative model responses can and cannot contain, supporting exception-based policy governance. Second, it provides a synthetic data generation pipeline capable of producing policy-aligned training data, crucial for both model alignment and robust testing. These tools enable organizations to specify policies once and enforce them consistently across the entire GenAI application lifecycle, from initial model alignment to continuous runtime monitoring. By making the schema, example policies, and tools openly available, IBM encourages community contributions and feedback to enhance the governance of generative AI.

Why it matters

As generative AI adoption grows, establishing clear, enforceable safety and content policies is critical for mitigating risks and ensuring responsible deployment. These tools provide a structured, open-source solution for organizations to define and implement such policies effectively.

How to implement this in your domain

  1. 1Review the Actionable Policy schema to understand its structure and capabilities for defining content constraints.
  2. 2Download and experiment with the open-source Granite.Trust Policy Tools to define initial policies for a GenAI application.
  3. 3Integrate the policy enforcement mechanisms into your GenAI application's development and deployment pipeline.
  4. 4Utilize the synthetic data generation pipeline to create policy-aligned training and testing data for model fine-tuning and evaluation.
  5. 5Contribute feedback or new ideas to the open-source project to help refine the tools.

Original post by Nathalie Baracaldo, Nicolas Mello, Kush R. Varshney, Heiko Ludwig, Kate Soule, David Cox

"arXiv:2608.23870v1 Announce Type: new Abstract: When it comes to safety policies for generative AI, one size does not fit all. Each organization and use case needs to mitigate different risks depending on the application context, regulatory environment, organizational values, and…"

View on X

Originally posted by Nathalie Baracaldo, Nicolas Mello, Kush R. Varshney, Heiko Ludwig, Kate Soule, David Cox on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses