Blending physics with data using an efficient Gaussian process regression with soft inequality and monotonicity constraints

• DOI: 10.3389/fmech.2024.1410190
• Publication Date: 2025-01-23T07:01:35Z
• Authors: Didem Kochan; Xiu Yang
• Keywords: soft constraints; TJ1-1570; Mechanical engineering and machinery; quantum-inspired Hamiltonian Monte Carlo; adaptive learning; constrained optimization; Gaussian process regression

In this work, we propose a new Gaussian process (GP) regression framework that enforces the physical constraints in a probabilistic manner. Specifically, we focus on inequality and monotonicity constraints. This GP model is trained by the quantum-inspired Hamiltonian Monte Carlo (QHMC) algorithm, which is an efficient way to sample from a broad class of distributions by allowing a particle to have a random mass matrix with a probability distribution. Integrating the QHMC into the inequality and monotonicity constrained GP regression in the probabilistic sense, our approach enhances the accuracy and reduces the variance in the resulting GP model. Additionally, the probabilistic aspect of the method leads to reduced computational expenses and execution time. Further, we present an adaptive learning algorithm that guides the selection of constraint locations. The accuracy and efficiency of the method are demonstrated in estimating the hyperparameter of high-dimensional GP models under noisy conditions, reconstructing the sparsely observed state of a steady state heat transport problem, and learning a conservative tracer distribution from sparse tracer concentration measurements.