New Framework Quantifies Uncertainty in Neural Operators.

Oriol Vendrell-Gallart, Nima Negarandeh, Ramin Bostanabad· June 17, 2026 View original

Summary

This paper introduces REEF-GP (Residual on Embedded Features Gaussian Process), a post-hoc uncertainty quantification (UQ) framework for neural operators that leverages their intrinsic geometry-aware representations. It provides calibrated uncertainty estimates competitive with deep ensembles at a fraction of the cost, even under geometric distribution shifts.

Neural operators are powerful tools for quickly solving Partial Differential Equations (PDEs), acting as fast surrogates. However, their deterministic predictions limit their application in scenarios requiring an understanding of uncertainty, especially when dealing with varying geometries. Existing uncertainty quantification (UQ) methods often focus on network parameters, overlooking the geometry-aware features learned by the operator itself. Researchers propose REEF-GP (Residual on Embedded Features Gaussian Process), a novel post-hoc UQ framework. Instead of learning new features, REEF-GP fits a Gaussian Process to the residuals of a frozen neural operator, using the operator's internal embeddings to define the kernel feature space. This approach directly adapts the operator's learned coordinate-feature representations to construct geometry-aware uncertainties. To ensure stability and scalability, REEF-GP incorporates spectral-normalized projections, heteroscedastic geometry-aware noise, and efficient subset-based training. Across five PDE benchmarks with diverse geometries, REEF-GP maintains predictive accuracy while delivering calibrated uncertainty estimates comparable to deep ensembles but with significantly lower computational cost. It also demonstrates robustness to geometric distribution shifts, concentrating uncertainty in physically meaningful areas like shock fronts.

Why it matters

This innovation is crucial for deploying neural operators in safety-critical applications where understanding prediction confidence is paramount, such as engineering design, climate modeling, and medical imaging. Professionals can now leverage fast PDE surrogates with reliable uncertainty estimates.

How to implement this in your domain

  1. 1Integrate REEF-GP into neural operator pipelines for applications requiring robust uncertainty quantification.
  2. 2Apply post-hoc UQ methods to existing deterministic AI models to enhance their trustworthiness and applicability.
  3. 3Explore how geometry-aware features learned by neural networks can be leveraged for other downstream tasks beyond UQ.
  4. 4Evaluate the trade-offs between computational cost and uncertainty calibration for different UQ techniques in specific domains.
  5. 5Develop visualization tools to interpret geometry-aware uncertainty estimates in physical simulations.

Who benefits

Engineering SimulationScientific ComputingHealthcareClimate ModelingAerospace

Key takeaways

  • REEF-GP provides post-hoc uncertainty quantification for neural operators.
  • It leverages the operator's intrinsic geometry-aware feature representations.
  • The framework offers calibrated uncertainty at a fraction of the cost of deep ensembles.
  • It maintains robustness and accuracy even under geometric distribution shifts.

Original post by Oriol Vendrell-Gallart, Nima Negarandeh, Ramin Bostanabad

"arXiv:2606.17513v1 Announce Type: new Abstract: Neural operators provide fast surrogates for PDEs but their deterministic predictions limit their use in tasks requiring uncertainty quantification (UQ), especially under geometric variability. Existing approaches primarily model un…"

View on X

Originally posted by Oriol Vendrell-Gallart, Nima Negarandeh, Ramin Bostanabad on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses