Survey of integrating physics knowledge into machine learning models.
problem Mitigating data shortage and ensuring physical plausibility.
method Combining physics knowledge with machine learning models.
result Summarizes recent works in physics-informed machine learning.
Machine learning improves planetary space physics by incorporating physical knowledge.
problem Improving performance and interpretability of machine learning models for planetary space physics.
method Building on a previous semi-supervised physics-based classification, the team used varying data and physical information to improve machine learning performance and interpretability.
result Incorporating physical knowledge improves machine learning performance and interpretability, essential for deriving scientific meaning.
New method learns from non-uniform data and partial physical knowledge.
problem Identifying dynamical systems from non-uniformly sampled data.
method Physics-informed neural networks integrating numerical integration methods.
result Learning unknown kinetic rates and estimating parameters from non-uniform data.
While physics conveys knowledge of nature built from an interplay between observations and theory, it has been considered less importantly in deep neural networks. Especially, there are few works leveraging physics behaviors when the knowledge is given less explicitly. In this work, we propose a novel architecture call…
In this paper, we introduce a novel framework for combining scientific knowledge within physics-based models and recurrent neural networks to advance scientific discovery in many dynamical systems. We will first describe the use of outputs from physics-based models in learning a hybrid-physics-data model. Then, we furt…
AutoKE automates embedding physical knowledge into neural networks for complex engineering problems.
problem Complex physical equations in engineering problems.
method AutoKE framework using deep neural networks, equation parsing, automatic differentiation, adaptive weights, and NAS.
result Automatically embeds physical knowledge into neural networks for complex equations efficiently.
Paper develops error rates for physics-informed learning, comparing it to data-driven methods.
problem Understanding the trade-off between soft penalties and hard constraints in PISL.
method Develops complexity-dependent error rates using the small-ball method.
result Physics-informed estimators have comparable error rates to hard constrained methods, differing only by constants.
Paper integrates ML with physics models for engineering and environmental challenges.
problem Complex science and engineering problems require new methodologies combining physics-based models and ML.
method Structured overview of integrating physics-based models with ML techniques.
result Taxonomy of existing techniques and potential research gaps identified.
PID-GAN uses physics knowledge to improve deep learning models' reliability.
problem Improving deep learning models' reliability in physics-based applications.
method Physics-informed GAN architecture that incorporates physics knowledge into both generator and discriminator models.
result PID-GAN framework outperforms state-of-the-art in handling gradient imbalance.
Framework augments physical models with deep learning for complex dynamics forecasting.
problem Forecasting complex dynamical phenomena with partial knowledge.
method APHYNITY framework: decomposes dynamics into physical and data-driven components.
result Framework accurately forecasts system evolution and identifies relevant parameters.
Enhances neural operators with physics knowledge for more accurate simulations.
problem Improving accuracy and generalization of neural operators for physical systems.
method Jointly learns from original PDEs and simplified forms, incorporating fundamental physics.
result Significant improvement in nRMSE across various PDE problems.
Data-driven models analyze power grids under incomplete physical information, and their accuracy has been mostly validated empirically using certain training and testing datasets. This paper explores error bounds for data-driven models under all possible training and testing scenarios, and proposes an evaluation implem…
Unified physics-informed learning method improves generalization performance.
problem Lack of theoretical analysis for hybrid settings with incomplete physical constraints.
method Unified residual form unifying collocation and variational methods, establishing generalization performance governed by affine variety dimension.
result Generalization performance is determined by affine variety dimension, not just the number of parameters.
Centuries of development in natural sciences and mathematical modeling provide valuable domain expert knowledge that has yet to be explored for the development of machine learning models. When modeling complex physical systems, both domain knowledge and data provide necessary information about the system. In this paper…
This paper introduces a framework for combining scientific knowledge of physics-based models with neural networks to advance scientific discovery. This framework, termed physics-guided neural networks (PGNN), leverages the output of physics-based model simulations along with observational features in a hybrid modeling …
Framework uses physics knowledge to improve spatiotemporal prediction with limited data.
problem Challenges in modeling physical systems with limited real-world data.
method Physics-aware meta-learning with auxiliary tasks, incorporating PDE-independent spatial and temporal modules.
result Framework outperforms in spatiotemporal prediction tasks with limited data.
Physics-based simulations are often used to model and understand complex physical systems and processes in domains like fluid dynamics. Such simulations, although used frequently, have many limitations which could arise either due to the inability to accurately model a physical process owing to incomplete knowledge abo…
We investigate the dynamics of growth models in terms of dynamical system theory. We analyse some forms of knowledge and its influence on economic growth. We assume that the rate of change of knowledge depends on both the rate of change of physical and human capital. First, we study model with constant savings. The mod…
FEA-Net uses physics knowledge to predict material responses efficiently.
problem Predicting material mechanical responses accurately and efficiently.
method Physics-guided deep learning with FEA integration.
result FEA-Net accurately predicts mechanical responses under external loading.
Improved physics-integrated generative models with noise robustness and fidelity.
problem Enhancing generative models to produce outputs that comply with physical laws and improve generalization.
method Integrating variational autoencoder with planar normalizing flow and attention mechanisms to learn latent posterior distributions and mitigate noise.
result Significant improvement in reconstruction quality and robustness against noise.
We consider the use of Deep Learning methods for modeling complex phenomena like those occurring in natural physical processes. With the large amount of data gathered on these phenomena the data intensive paradigm could begin to challenge more traditional approaches elaborated over the years in fields like maths or phy…
Deep learning improves solar energy forecasting using physical and data-driven models.
problem Improving short-term solar energy forecasting accuracy.
method Injecting physical knowledge into deep learning models for spatio-temporal forecasting.
result Improved solar energy forecasting models using deep learning and physical criteria.
MUSIC learns coupled systems with sparse data and incomplete physics.
problem Learning coupled systems with incomplete physical constraints and missing data.
method Sparsity induced multitask neural network framework integrating partial physical constraints with data-driven learning.
result MUSIC accurately learns solutions to complex coupled systems under data-scarce and noisy conditions.
Paper introduces a method to learn physics between digital twins using imperfect models.
problem Learning physics from imperfect data and low-fidelity models.
method Bayesian Hierarchical modeling with physics-informed Gaussian processes.
result Models learning between digital twins are less uncertain than independent models but not over-confident.
We propose a physics-informed Echo State Network (ESN) to predict the evolution of chaotic systems. Compared to conventional ESNs, the physics-informed ESNs are trained to solve supervised learning tasks while ensuring that their predictions do not violate physical laws. This is achieved by introducing an additional lo…
PIML enhances machine learning for subsurface energy systems.
problem Lack of interpretability and domain-specific knowledge in machine learning models.
method Integrates physics principles into data-driven models using deep learning.
result PIML improves model generalization and adherence to physical laws.
We describe an approach for incorporating prior knowledge into machine learning algorithms. We aim at applications in physics and signal processing in which we know that certain operations must be embedded into the algorithm. Any operation that allows computation of a gradient or sub-gradient towards its inputs is suit…
Improves machine learning models by incorporating physical laws into feature maps.
problem Lack of model interpretability in classical machine learning approaches.
method Physics-informed feature maps constructed from physical laws and dimensional analysis.
result Enhanced model interpretability and potential discovery of new physical equations.
Develops experimental design for discovering missing physics in bioreactors.
problem Discovering missing physics in incomplete model structures of process systems.
method Combines universal differential equations and symbolic regression with sequential experimental design.
result Successfully recovered true model structure of a bioreactor using machine learning techniques.
Understanding and interacting with everyday physical scenes requires rich knowledge about the structure of the world, represented either implicitly in a value or policy function, or explicitly in a transition model. Here we introduce a new class of learnable models--based on graph networks--which implement an inductive…
Deep learning models learn chaotic system dynamics from real and simulated data.
problem Training deep learning models for chaotic systems requires big data.
method Jointly train deep neural networks on real and simulated data, enforcing physical laws.
result Proposes knowledge-based deep learning (KDL) for accurate forecasting of chaotic systems.
p3VAE combines physics and machine learning for robust data representations.
problem Improving machine learning models' robustness to environmental factors of variation.
method Physics-informed variational autoencoder integrating physical knowledge with neural networks.
result p3VAE outperforms competing models in extrapolation and interpretability. PICN learns physical fields from shallow neural networks, improving AI in multi-physical systems.
problem Challenges in modeling and forecasting multi-physical systems due to data scarcity and noise.
method Physics-informed convolutional network (PICN) combining CNN and physical laws, using deconvolution and convolution layers.
result PICN effectively solves and estimates nonlinear physical operator equations and recovers physical information from noisy observations.
Paper proposes PI-DAE for missing data imputation in buildings using physics constraints.
problem Missing data in building energy modeling.
method Physics-informed Denoising Autoencoders (PI-DAE) with multivariate and univariate configurations.
result Enhanced interpretability and robustness to missing data rates.
These notes form part of a lecture course on gauge theory. The material covered is standard in the physics literature, but perhaps less well-known to mathematicians. The purpose of these notes is to make spontaneous symmetry breaking and the Higgs mechanism of mass generation for elementary particles more easily access…
PDE-NetGen converts physical equations to neural networks for various scientific problems.
problem Bridging physics and deep learning for efficient neural network architectures.
method Combines symbolic calculus and neural network generation to translate PDEs into NN architectures.
result Generates compact, computationally-efficient physics-informed NN architectures.
Gradient estimation techniques applied to programs with randomness in high energy physics.
problem Differentiating programs with discrete randomness in high energy physics.
method Several gradient estimation techniques, including Stochastic AD method, applied to simplified detector design experiments.
result Development of the first fully differentiable branching program.
CRNN discovers chemical reaction pathways from data.
problem Challenging to infer reaction pathways for complex systems.
method Neural network approach that satisfies fundamental physics laws.
result CRNN autonomously discovers reaction pathways from species concentration data.
Recent advances in analysis of subband amplitude envelopes of natural sounds have resulted in convincing synthesis, showing subband amplitudes to be a crucial component of perception. Probabilistic latent variable analysis is particularly revealing, but existing approaches don't incorporate prior knowledge about the ph…
This chapter reviews classic regression methods and their evolution to physics-informed approaches.
problem Finding relationships between variables using regression.
method Introduces traditional and physics-informed regression methods, linking them to computational science.
result Regression methods have evolved from purely statistical to incorporating physical knowledge.
This work combines machine learning with physical models to solve inverse problems efficiently.
problem Solving inverse problems in the presence of missing physics and recovering parameters.
method Variational autoencoding with a physically structured decoder network and stochastic local approximations.
result The method accelerates inference for Bayesian inverse problems and acts as a regularizer encoding prior physical information.
To simultaneously address the rising need of expressing uncertainties in deep learning models along with producing model outputs which are consistent with the known scientific knowledge, we propose a novel physics-guided architecture (PGA) of neural networks in the context of lake temperature modeling where the physica…
Novel framework for learning infinitesimal generator of stochastic processes.
problem Challenges in learning infinitesimal generator due to unbounded nature and state space dimensionality.
method Introduces a novel framework based on energy functional, integrates physical priors, and uses reduced-rank estimator in RKHS.
result Learning bounds independent of state space dimension and non-spurious spectral estimation.
This text aims to explain general relativity to geometers who have no knowledge about physics. Using handwritten notes by Michel Vaugon, we construct the bases of the theory.
Active researches are currently being performed to incorporate the wealth of scientific knowledge into data-driven approaches (e.g., neural networks) in order to improve the latter's effectiveness. In this study, the Theory-guided Neural Network (TgNN) is proposed for deep learning of subsurface flow. In the TgNN, as s…
Hybrid model combines physics and data to handle incomplete systems.
problem Incomplete physics models with missing terms.
method Combines deep grey-box models with Optimal Transport.
result Enhances incomplete physics models with superior performance.
We give a survey of our joint ongoing work with Ali Chamseddine, Slava Mukhanov and Walter van Suijlekom. We show how a problem purely motivated by "how geometry emerges from the quantum formalism" gives rise to a slightly noncommutative structure and a spectral model of gravity coupled with matter which fits with expe…
Generative framework learns effective, lower-dimensional models from high-dimensional data.
problem Predicting long-term behavior of complex, multiscale systems with limited data.
method Physics-aware probabilistic model order reduction with latent variables.
result Guaranteed long-term stability and predictive accuracy in multiscale physical systems.