Flow Map Denoisers Balance Image Quality and Fidelity in Inverse Problems

Nicolas Zilberstein, Morteza Mardani, Santiago Segarra· June 19, 2026 View original

Summary

A new approach using flow map models implicitly defines a one-parameter family of denoisers that continuously spans the distortion-perception (DP) frontier in image restoration. This allows users to control the tradeoff between minimizing error (fidelity) and maximizing perceptual quality (sharpness) using a single "lookahead" parameter, without needing paired data or extensive tuning.

Image restoration tasks inherently involve a fundamental compromise: methods designed to minimize reconstruction error often result in blurry images, whereas approaches prioritizing perceptual quality tend to produce sharper but potentially less faithful results. Current solutions typically commit to a specific point on this distortion-perception (DP) frontier or demand complex setups like paired-data supervision, auxiliary models, or extensive hyperparameter tuning for sampling. This research introduces flow map models, an extension of flow matching for few-step sampling, as a solution. These models implicitly define a continuous family of denoisers controlled by a single parameter. This "lookahead" parameter, denoted as 't', acts as a simple control knob, allowing users to smoothly navigate between the mean squared error (MMSE) regime, which prioritizes fidelity, and the perceptual regime, which emphasizes sharpness. For Gaussian targets, the study theoretically proves that varying 't' precisely recovers the optimal DP frontier. Empirical observations on natural images show similar behavior. When integrated into a Plug-and-Play solver, this mechanism extends to general inverse problems, controlling the balance between perceptual alignment and data consistency. Despite lacking exact optimality guarantees in this broader context, a single trained flow map effectively spans the DP tradeoff, matching or surpassing specialized baselines at both extremes. Extensive experiments on CelebA and AFHQ datasets across various linear and nonlinear inverse tasks validate these findings.

Why it matters

Professionals in computer vision, medical imaging, and content creation can leverage this method to precisely control the balance between image fidelity and perceptual quality in restoration tasks, optimizing outputs for specific applications without complex retraining or multiple models.

How to implement this in your domain

  1. 1Integrate flow map denoisers into existing image restoration pipelines to gain fine-grained control over output quality.
  2. 2Experiment with the "lookahead" parameter 't' to find the optimal balance for specific visual tasks, such as medical image enhancement or artistic rendering.
  3. 3Apply the Plug-and-Play solver extension to general inverse problems beyond simple denoising, like deblurring or super-resolution.
  4. 4Evaluate the performance against current state-of-the-art methods in terms of both quantitative metrics and subjective perceptual quality.

Who benefits

PhotographyMedical ImagingEntertainmentSecurityAutonomous Vehicles

Key takeaways

  • Flow map models offer a continuous way to balance image distortion and perceptual quality in restoration.
  • A single "lookahead" parameter controls the tradeoff between fidelity and sharpness.
  • The method avoids the need for paired-data supervision or extensive hyperparameter tuning.
  • It performs comparably or better than specialized baselines across various inverse problems.

Original post by Nicolas Zilberstein, Morteza Mardani, Santiago Segarra

"arXiv:2606.19802v1 Announce Type: new Abstract: Image restoration faces a fundamental tradeoff: methods that minimize error produce blurry reconstructions, while those that maximize perceptual quality yield sharp but less faithful images. Existing approaches either commit to a si…"

View on X

Originally posted by Nicolas Zilberstein, Morteza Mardani, Santiago Segarra on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses