CRAFT Boosts Enterprise Coding Agents, Reduces Schema Burden.

Aakash Kolekar, Sahika Genc, Shahriar Shariat, Bunyamin Sisman, Tibor Mezi, Barbara Poblete, Shree Vandana Kachroo, Calvin Chi, Parth Parmar, Ari Singer, Prayaas Jain, Cindy Barker, Benoit Dumoulin· July 28, 2026 View original

Summary

CRAFT is a two-stage post-training recipe for enterprise coding agents that translates natural language requests into executable code over proprietary APIs. It learns stable schema knowledge and tool-use behavior, improving agent performance, consistency, and multi-turn coherence while significantly reducing input token burden and schema discovery loops.

Enterprise coding agents are designed to convert natural language analytical requests into executable code, interacting with proprietary APIs, schemas, and metric definitions. A common issue is that injecting exhaustive schema documentation into every prompt increases inference overhead, complicates schema evolution, and reduces reliability in multi-turn analyses. Researchers introduce CRAFT, a two-stage post-training approach that enables agents to acquire stable schema knowledge and tool-use behavior without constant prompt-time schema injection. The first stage, "schema-stripped PLAN supervised fine-tuning," teaches domain-structured plans and executable behaviors from validated trajectories. The second stage uses "execution-shaped reinforcement learning" to align the agent's policy for tool selection, code quality, plan-code consistency, and recovery from execution failures. Training trajectories are meticulously curated using a Tri-Gate filter for validation. Evaluated in advertising analytics, CRAFT improved composite Agent Score by +9.6 pp, consistency by +4.1 pp, and multi-turn coherence by +4.2 pp, while drastically reducing input token burden by 9x and schema-discovery loops by up to 5x compared to a schema-stuffed baseline.

Why it matters

CRAFT offers a significant leap in developing robust and efficient enterprise coding agents, making them more reliable, scalable, and cost-effective for complex analytical tasks by reducing the need for extensive prompt engineering and improving multi-turn interaction.

How to implement this in your domain

  1. 1Assess current enterprise coding agent deployments for prompt overhead and schema management challenges.
  2. 2Investigate CRAFT's two-stage post-training recipe for learning schema knowledge and tool-use behavior.
  3. 3Pilot CRAFT on a specific analytical domain within your organization, such as marketing or finance.
  4. 4Establish a robust data curation process using execution validation and LLM-judge reasoning for training trajectories.

Who benefits

Enterprise SoftwareData AnalyticsMarketing TechnologyFinancial ServicesIT Services

Key takeaways

  • Enterprise coding agents struggle with prompt-time schema injection, leading to overhead and unreliability.
  • CRAFT is a two-stage post-training method for agents to learn stable schema knowledge.
  • It improves agent performance, consistency, and multi-turn coherence.
  • CRAFT significantly reduces input token burden and schema-discovery loops, making agents more efficient.

Original post by Aakash Kolekar, Sahika Genc, Shahriar Shariat, Bunyamin Sisman, Tibor Mezi, Barbara Poblete, Shree Vandana Kachroo, Calvin Chi, Parth Parmar, Ari Singer, Prayaas Jain, Cindy Barker, Benoit Dumoulin

"arXiv:2607.22642v1 Announce Type: new Abstract: Enterprise coding agents translate natural-language analytical requests into executable code over proprietary APIs, schemas, and metric definitions. Yet the prevailing deployment pattern injecting exhaustive schema and tool document…"

View on X

Originally posted by Aakash Kolekar, Sahika Genc, Shahriar Shariat, Bunyamin Sisman, Tibor Mezi, Barbara Poblete, Shree Vandana Kachroo, Calvin Chi, Parth Parmar, Ari Singer, Prayaas Jain, Cindy Barker, Benoit Dumoulin on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses