Physics-Informed ML Excels with Small Data in Manufacturing

Sarah Grewe, J\"org Frochte· July 10, 2026 View original

▶ The 2-minute explainer

Summary

This study explores physics-informed machine learning for machining processes with small, expensive datasets, using abrasive waterjet milling as a case. It highlights the importance of data cleaning, robust evaluation, and careful physics integration, finding Gaussian Process variants perform best and residual learning is competitive.

In machining processes, experimental datasets are often small, costly to acquire, and specific to particular materials. This research investigates how physics-informed machine learning (PIML) can be effectively applied under these small-data constraints, using an abrasive waterjet milling dataset for Inconel 718 as a case study. The study makes several methodological contributions. Firstly, it distinguishes between physics-based data cleaning and statistical curation, treating the latter as competing modeling hypotheses. Secondly, it demonstrates that model rankings from small hold-out sets can be unstable, advocating for robust evaluation methods like 10-fold cross-validation, which showed Gaussian Process (GP) variants consistently at the top. Thirdly, the research explores different levels of physics integration, finding that residual learning on a compact physics baseline is competitive for GP models, offering lower variance and interpretability, though it can degrade tree-based models. Bayesian hyperparameter tuning improved some baselines but harmed multi-stage hybrid pipelines at this sample size. The overall picture emphasizes that for small, expensive process datasets, reliable model comparison requires explicit curation hypotheses, robust evaluation, and thoughtful integration of physics into the model.

Why it matters

For industries relying on complex physical processes with limited data, this research provides practical guidance on how to effectively leverage physics-informed machine learning to build robust and accurate predictive models, optimizing processes and reducing experimental costs.

How to implement this in your domain

  1. 1Adopt a structured approach to data cleaning and curation, explicitly defining physics-based and statistical hypotheses.
  2. 2Prioritize robust model evaluation techniques like k-fold cross-validation, especially with small datasets.
  3. 3Explore Gaussian Process (GP) models for small-data scenarios, particularly when physics integration is possible.
  4. 4Investigate residual learning strategies to combine physics baselines with machine learning models for improved interpretability and performance.

Who benefits

ManufacturingAerospaceMaterials ScienceIndustrial AutomationEngineering

Key takeaways

  • Physics-informed ML is crucial for small, expensive datasets in physical processes.
  • Robust data curation and evaluation methods are as important as the learning algorithm.
  • Gaussian Process models often perform well in small-data, physics-informed settings.
  • Residual learning with a physics baseline can offer competitive performance and interpretability.

Original post by Sarah Grewe, J\"org Frochte

"arXiv:2607.07863v1 Announce Type: new Abstract: In physically dominated machining processes, experimental datasets are small, expensive, and material-specific; in this regime, data curation, evaluation design, and the form of physics integration can matter as much as the learning…"

View on X

Originally posted by Sarah Grewe, J\"org Frochte on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses