JustLLMGRPO Improves Chest X-Ray Generation via Prompt Optimization

Pengxiang Cai, Xiaohan Li, Anglin Liu, Qingyuan Zeng, Zexun Li, Jintai Chen· August 11, 2026 View original

Key takeaways

  • Optimizing prompts for generative AI can yield significant performance improvements.
  • JustLLMGRPO uses an LLM to reformulate prompts for better chest X-ray generation.
  • The method achieves state-of-the-art results without modifying the image generator.
  • Focusing on how information is expressed to the generator is a powerful optimization dimension.

Who benefits

HealthcareMedical ImagingPharmaceuticalAI Research

Summary

JustLLMGRPO is a new method that significantly enhances the quality of text-conditioned chest X-ray generation by optimizing the prompts given to a frozen image generator, rather than modifying the generator itself. It uses Group Relative Policy Optimization (GRPO) on an LLM prompt policy to refine radiographic information, leading to more accurate and aligned image synthesis.

Generating realistic chest X-rays from text descriptions is crucial for medical imaging research and applications. Previous efforts primarily focused on improving the image generation models themselves, often treating the input text prompts as static after initial domain adaptation. New research introduces JustLLMGRPO, demonstrating that substantial improvements can be achieved by optimizing the way radiographic information is expressed to an *already adapted* image generator. The method employs an unmodified Large Language Model (LLM) to reformulate prompts, effectively filtering out non-renderable content like temporal comparisons or uncertainties, and emphasizing visible radiographic findings. By applying Group Relative Policy Optimization (GRPO) specifically to the LLM's prompt policy, while keeping the image generator frozen, JustLLMGRPO achieves a significant reduction in image generation errors (RadDINO-FID) and maintains high alignment with the original source prompts. This approach highlights the untapped potential in prompt engineering for specialized generative AI tasks, proving that how information is conveyed can be as critical as the generator's capabilities.

Why it matters

Medical imaging professionals and AI developers can leverage this technique to generate higher-quality, more diagnostically relevant synthetic chest X-rays, which can aid in training, research, and potentially even medical education.

How to implement this in your domain

  1. 1Explore prompt engineering techniques for existing generative AI models in your domain.
  2. 2Evaluate the impact of LLM-based prompt reformulation on the output quality of your generative systems.
  3. 3Consider applying policy optimization methods to refine prompt generation for specialized tasks.
  4. 4Collaborate with AI researchers to adapt JustLLMGRPO's principles to other medical imaging modalities or scientific data generation.

Original post by Pengxiang Cai, Xiaohan Li, Anglin Liu, Qingyuan Zeng, Zexun Li, Jintai Chen

"arXiv:2608.08046v1 Announce Type: new Abstract: Text-conditioned chest X-ray generation aims to synthesize realistic radiographs that faithfully depict specified findings. Existing work has primarily improved quality by updating image generators, implicitly treating prompts as fi…"

View on X

Originally posted by Pengxiang Cai, Xiaohan Li, Anglin Liu, Qingyuan Zeng, Zexun Li, Jintai Chen on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses