DUE framework models unknown equations from data using deep learning.
problem Unknown equations in complex systems.
method Data-driven modeling using deep learning techniques.
result Framework capable of learning various types of unknown equations.
Data-driven approach learns effective equations for phase field interfaces.
problem Learning accurate equations for phase field interface dynamics.
method Data-driven identification of partial differential equations from phase field data.
result Data-driven equations outperform analytical approximations in certain regimes.
The paper explores solutions to the distributional Bellman equation in reinforcement learning.
problem Distributional reinforcement learning considers complete return distributions, not just expected returns.
method Study existence and uniqueness of solutions to general distributional Bellman equations, linking them to multivariate affine equations.
result Any solution to a distributional Bellman equation can be derived from a multivariate affine distributional equation.
Deep learning predicts dynamics from sparse data.
problem Predicting spatiotemporal dynamics from sparse data.
method Spatially dimension-independent deep learning framework.
result Predicts dynamics from sparse data sites.
Neural differential equations combine deep learning and differential equations for modeling complex systems.
problem Modeling complex systems with high capacity and efficiency.
method Combining neural networks and differential equations, focusing on neural ordinary, controlled, and stochastic differential equations.
result NDEs offer high-capacity function approximation, strong priors, and handle irregular data efficiently.
A universal rule-based self-learning approach using deep reinforcement learning (DRL) is proposed for the first time to solve nonlinear ordinary differential equations and partial differential equations. The solver consists of a deep neural network-structured actor that outputs candidate solutions, and a critic derived…
Deep learning model solves high-dimensional PDEs using Actor-Critic approach.
problem Solving high-dimensional nonlinear PDEs efficiently.
method Reformulated PDE into BSDE system, inspired by Actor-Critic algorithm for deep RL.
result Improved model with fewer parameters, faster convergence, and less hyperparameter tuning.
ICON learns differential equation operators from prompts, reducing retraining and improving few-shot learning.
problem Training neural networks to solve differential equations without retraining for new problems.
method In-Context Operator Networks (ICON) that learns operators from prompted data and applies them to new problems.
result ICON can generalize to new operators beyond the training distribution and requires only a few demos.
Statistical (machine learning) tools for equation discovery require large amounts of data that are typically computer generated rather than experimentally observed. Multiscale modeling and stochastic simulations are two areas where learning on simulated data can lead to such discovery. In both, the data are generated w…
ECSEL learns signomial equations for explainable classification.
problem Creating interpretable models for classification.
method ECSEL constructs signomial equations directly for classification and explanation.
result ECSEL outperforms state-of-the-art methods in interpretability and efficiency.
New method solves PDEs for any initial condition without retraining.
problem Solving PDEs for different initial conditions requires retraining neural solvers.
method Formulate solution as conditional probability distribution.
result Approximates PDE solution for arbitrary initial conditions.
FNOs learn solution operators of dissipative equations efficiently via spectral methods.
problem Learning and approximation of solution operators for dissipative equations.
method Introducing spectral methods and deriving FNO approximation bounds and sample complexity guarantees.
result Polynomial sample complexity guarantees for FNOs learning solution operators of dissipative equations.
Quantum model discovery uses DQCs to solve equations from data.
problem Discovering differential equations from data using quantum computing.
method Differentiable quantum circuits (DQCs) to solve parameterized equations, regression on data and equations.
result Successful parameter inference and equation discovery on various systems.
Efficient kernel method learns differential equations with fewer data.
problem Learning differential equations with limited data and computational resources.
method Kernel-based framework for differential equations with theoretical error bounds.
result Significant improvements in accuracy and computational efficiency.
ICON learns differential equation operators from examples, revealing probabilistic inference.
problem Learning operators for differential equations from limited examples.
method Probabilistic operator learning using ICON architectures trained on diverse datasets.
result ICON implicitly performs Bayesian inference on solution operators.
We propose a new algorithm for solving parabolic partial differential equations (PDEs) and backward stochastic differential equations (BSDEs) in high dimension, by making an analogy between the BSDE and reinforcement learning with the gradient of the solution playing the role of the policy function, and the loss functi…
Bayesian method learns PDEs from noisy data.
problem Discovering PDEs from noisy data.
method Combining variational Bayes and sparse linear regression.
result Proposes a new method to discover PDEs accurately.
Improved equation learning accuracy via comprehensive R²-elimination and Bayesian model selection.
problem Challenges in exhaustive equation learning due to multicollinearity and greedy steps.
method Combines R2 and Bayesian model evidence for a comprehensive yet efficient search. result Our approach surpasses all other methods in identification accuracy, especially in exact equation recovery.
In recent years, data-driven methods have been developed to learn dynamical systems and partial differential equations (PDE). The goal of such work is discovering unknown physics and the corresponding equations. However, prior to achieving this goal, major challenges remain to be resolved, including learning PDE under …
We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distributions that match observations with non-uniform time increments and arbitrary sparseness, which is in contrast with gradient matching that…
We present an approach to identify concise equations from data using a shallow neural network approach. In contrast to ordinary black-box regression, this approach allows understanding functional relations and generalizing them from observed data to unseen parts of the parameter space. We show how to extend the class o…
Active learning improves SR by proposing experiments in data-limited settings.
problem Efficiently gathering data for symbolic regression with physical constraints.
method Query by committee using the Pareto frontier of equations, with physical constraints.
result Reduces data required for SR and achieves state-of-the-art results.
This study evaluates the importance of design of experiments for PINN in physics-informed deep learning.
problem Accuracy of PINN predictions depends on the design of experiment scheme.
method Comparative study of five PDEs using different design of experiment schemes.
result Hammersley sampling-based PINN outperforms other design of experiment schemes.
Study deep neural nets for solving complex insurance equations.
problem Solving linear and semilinear parabolic PIDEs in high dimensions.
method Deep neural network algorithms for integro-differential equations.
result Viability of deep learning for solving high-dimensional PIDEs.
Deep learning approximates SPDE solutions from noise trajectories.
problem Approximating solutions to stochastic partial differential equations (SPDEs).
method Uses neural networks to approximate SPDE solutions based on noise realizations.
result Accurately estimates SPDE solutions and functionals like mean and variance.
Elvet solves differential equations and variational problems with neural networks.
problem Solving complex differential and variational equations with arbitrary conditions.
method Machine learning, specifically neural networks, to represent and solve equations.
result Elvet can solve a wide range of differential and variational problems.
Study on Tukey depth in machine learning using Hamilton-Jacobi equations.
problem Understanding Tukey depth in machine learning applications.
method Derive necessary conditions for Tukey depth in continuum limit, formulating them as a Hamilton-Jacobi equation.
result Prove existence and uniqueness of viscosity solutions for the derived equation, which bounds Tukey depth.
This paper proposes an unsupervised learning method to solve heat equations on chips.
problem Critical need for solving heat transfer equations on chips for 5G and AI.
method Hybrid framework of Auto Encoder and Image Gradient for unsupervised learning.
result Framework can solve heat transfer problems with a single training process and predict unseen cases.
This work leverages recent advances in probabilistic machine learning to discover conservation laws expressed by parametric linear equations. Such equations involve, but are not limited to, ordinary and partial differential, integro-differential, and fractional order operators. Here, Gaussian process priors are modifie…
DiffEqFlux.jl is a library for fusing neural networks and differential equations. In this work we describe differential equations from the viewpoint of data science and discuss the complementary nature between machine learning models and differential equations. We demonstrate the ability to incorporate DifferentialEqua…
CSI method learns conditional distributions by estimating flow equations.
problem Learning conditional distributions in generative models.
method Estimates probability flow equations to transport reference to target distribution.
result Derives explicit expressions for conditional drift and score functions.
Study uses neural networks to solve complex equations efficiently.
problem Solving parametric partial differential equations.
method Machine learning and deep neural networks.
result Performance of the model is independent of parameter space dimension.
This work discovers governing equations from limited data using physics-informed deep learning.
problem Discovering governing equations from scarce and noisy data for complex systems.
method Physics-informed deep learning framework integrating neural networks, physics embedding, and sparse regression.
result The method effectively identifies governing equations from various spatiotemporal systems with different levels of data scarcity and noise.
In this article, we show that solving the system of linear equations by manipulating the kernel and the range space is equivalent to solving the problem of least squares error approximation. This establishes the ground for a gradient-free learning search when the system can be expressed in the form of a linear matrix e…
Derives EoM for DNNs to describe GD dynamics precisely.
problem Gaps between differential equations and actual DNN learning dynamics due to discretization error.
method Starts from GF, derives counter term to cancel discretization error, obtains EoM.
result EoM precisely describes GD dynamics of DNNs, highlights differences between continuous and discrete GD.
DEQGAN uses GANs to solve differential equations without supervision.
problem Solving differential equations with neural networks.
method Generative Adversarial Networks (GANs) to learn the loss function.
result DEQGAN achieves lower mean squared errors and competitive solution accuracy compared to traditional methods.
Neural network learns to solve Black-Scholes for stock options.
problem Stock option pricing using the Black-Scholes Equation.
method Neural Networks applied to solve the Black-Scholes Equation.
result Neural network can accurately forecast stock option prices.
Neural Laplace models diverse DEs in the Laplace domain for better dynamics.
problem Inadequate ODEs for long-range dependencies and discontinuities.
method Unified framework in Laplace domain, using stereographic map for smoothness.
result Superior performance in diverse DEs, including complex history dependency and abrupt changes.
Extends machine learning models for analytic boundary conditions in differential equations.
problem Inclusion of data in differential equations using symbolic algorithms.
method Combines computer algebra with Gaussian processes and extends to analytic boundary conditions using Gröbner and Janet bases of Weyl algebras.
result Describes divergence-free flow in domains bounded by analytic functions.
PNDEs project neural dynamics onto constraint manifolds, improving accuracy and stability.
problem Learning dynamics from data without violating known constraints.
method Projecting the learned vector field onto the tangent space of the constraint manifold.
result PNDEs outperform existing methods in learning constrained dynamical systems.
GF-Net learns Green's functions for linear reaction-diffusion equations.
problem Learning Green's functions for linear reaction-diffusion equations on arbitrary domains.
method GF-Net, a neural network, learns Green's functions in an unsupervised manner using physics-informed approach and symmetry.
result GF-Net efficiently solves linear reaction-diffusion equations under various boundary conditions and sources.
Paper tackles infinite-dimensional optimization and Bayesian learning for stochastic differential equations.
problem Learning the drift function of stochastic differential equations with uncertainty quantification.
method Combines infinite-dimensional optimization results with Bayesian hierarchical framework, incorporating shrinkage priors for sparse learning.
result Systematic approach for accurate learning of stochastic differential equations with uncertainty quantification.
New research connects evolutionary dynamics to Bayesian learning.
problem Connecting evolutionary biology and Bayesian learning.
method Rigorous mathematical proof using Kushner-Stratonovich equation and gradient flows.
result Discrete time filtering equations converge to Stratonovich interpretation of Kushner-Stratonovich equation.
Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are five-fold. (1) Numerical experiments show that small neural networks (< 500 learnabl…
Fine-tunes language models with captions for differential equation solving.
problem Overreliance on function data in operator learning.
method Integrates human knowledge through captions and fine-tunes language models.
result Significantly enhanced performance and reduced function data requirements.
Higher-order ODE solvers improve deep learning performance.
problem Improving deep learning performance using higher-order ODE solvers.
method Evaluation and improvement of Runge-Kutta (RK) methods for deep learning.
result Higher-order RK solvers can improve deep learning performance by incorporating key ingredients of optimizers.
Neural Galerkin schemes use active learning to solve high-dimensional equations.
problem Inaccurate function approximations in high dimensions with limited training data.
method Neural Galerkin schemes based on deep learning with active learning for high-dimensional PDEs.
result Active data collection improves the numerical solution of high-dimensional equations.
The paper proposes a method to learn evolving multivariate distributions from sample paths.
problem Learning the temporal evolution of multivariate densities from sample data.
method Normalizing flows to construct time-dependent mappings.
result The method can approximate evolving probability density functions from observed data.