ExecuGraph Framework Enhances Backend Code Synthesis with LLMs

Sai Deekshith Lekkala, Jothi Prabha Appadurai, Rohith Reddy Bellibatlu, Manpreet Singh· July 24, 2026 View original

Summary

ExecuGraph is a multi-agent framework that improves the reliability of backend code synthesis by integrating execution-based validation. It coordinates specialized agents through a typed directed workflow, demonstrating significant accuracy gains, especially with more capable base models.

While Large Language Models (LLMs) can generate plausible backend code, a single-pass approach offers no inherent guarantee of correctness or runtime reliability. This limitation necessitates a more robust framework for code synthesis. ExecuGraph is introduced as a multi-agent framework that places execution-based validation at the core of backend code synthesis. It employs six specialized agents—Planner, Code Generator, Logical Reviewer, Evaluator, Optimizer, and Explainer—coordinated through a typed directed workflow with a bounded retry budget. The framework is implemented using LangGraph with locally hosted models (Ollama) and can optionally include a retrieval layer for algorithmic technique recall. A subprocess-isolated sandbox with a wall-clock timeout ensures safe and controlled evaluation of generated code. Evaluations were conducted on a curated 30-problem DSA suite, HumanEval, and an APPS-introductory subset. While results on the internal DSA suite showed no statistically significant difference compared to single-agent baselines, ExecuGraph demonstrated a +3.1 percentage point improvement on HumanEval. The most compelling finding was cross-model: with DeepSeekCoder V2 Lite, the graph-category accuracy jumped from 57.5% (one-shot) to 80.0% (multi-full), a substantial +22.5 percentage point increase. This supports the hypothesis that the value of multi-agent decomposition scales with the base model's capability. The framework's primary contribution is its methodological design, allowing for controlled measurement of each component's marginal contribution through configurable one-shot, execution-retry, and per-agent ablation conditions.

Why it matters

For software engineers and product teams, ExecuGraph offers a pathway to generate more reliable and correct backend code using LLMs, potentially accelerating development cycles and reducing debugging efforts.

How to implement this in your domain

  1. 1Explore integrating a multi-agent framework like ExecuGraph into existing code generation workflows.
  2. 2Implement execution-based validation and sandboxing for LLM-generated code.
  3. 3Decompose complex code generation tasks into specialized agent roles (e.g., planner, reviewer, evaluator).
  4. 4Experiment with different base LLMs within the ExecuGraph framework to observe scaling benefits.
  5. 5Develop a robust retry budget and error-class taxonomy for iterative code refinement.

Who benefits

Software EngineeringAI DevelopmentDevOpsIT Services

Key takeaways

  • ExecuGraph is a multi-agent framework for reliable backend code synthesis.
  • It uses execution-based validation and specialized agents.
  • Multi-agent decomposition significantly improves accuracy with capable base models.
  • The framework offers a methodological approach to measure component contributions.

Original post by Sai Deekshith Lekkala, Jothi Prabha Appadurai, Rohith Reddy Bellibatlu, Manpreet Singh

"arXiv:2607.20499v1 Announce Type: new Abstract: Large Language Models generate plausible backend code, but a single-pass paradigm provides no guarantee of correctness or runtime reliability. We present ExecuGraph, a multi-agent framework that places execution-based validation at…"

View on X

Originally posted by Sai Deekshith Lekkala, Jothi Prabha Appadurai, Rohith Reddy Bellibatlu, Manpreet Singh on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses