PNDEs project neural dynamics onto constraint manifolds, improving accuracy and stability.
problem Learning dynamics from data without violating known constraints.
method Projecting the learned vector field onto the tangent space of the constraint manifold.
result PNDEs outperform existing methods in learning constrained dynamical systems.
Neural differential equations combine deep learning and differential equations for modeling complex systems.
problem Modeling complex systems with high capacity and efficiency.
method Combining neural networks and differential equations, focusing on neural ordinary, controlled, and stochastic differential equations.
result NDEs offer high-capacity function approximation, strong priors, and handle irregular data efficiently.
Stabilized neural differential equations enforce constraints on dynamical systems.
problem Ensuring dynamical systems preserve known constraints like conservation laws.
method SNDEs with a stabilization term to enforce manifold constraints.
result SNDEs outperform existing methods and broaden constraint types.
Neural networks improve predictions of complex network dynamics.
problem Improving neural network predictions for complex network dynamics.
method Extended neural network models to complex systems, ensuring they conform to dynamical model assumptions and using a statistical significance test.
result Achieved advanced generalization of neural network predictions for complex systems.
Neural GDEs improve graph prediction by blending discrete structures and differential equations.
problem Dynamic graph prediction challenges in irregularly sampled data.
method Continuous-depth graph neural networks (GNNs) with Neural GDEs.
result Neural GDEs enhance performance across various applications.
A Gaussian Process Ordinary Differential Equation framework for large continuous dynamical systems
problem Forecasting complex dynamical systems
method Kernel autonomous ODE approach based on Gaussian Processes and Quadratic Order Model Reduction
result Full model outperforms ROM methods in terms of accuracy or computational costs
This paper learns state, dynamics, and filtering algorithms together for data assimilation.
problem Costly parameter tuning and inaccurate dynamics models hinder data assimilation algorithms.
method Auto-differentiable data assimilation framework that learns state, dynamics, and parameters via gradient-based optimization.
result Several data assimilation methods can be learned or tuned within this framework.
VSDN models sporadic time series with neural SDEs.
problem Modeling irregular and sparse time series data.
method Variational Bayesian method and neural SDEs.
result VSDNs outperform state-of-the-art models in prediction and interpolation.
Proposes a deep learning method for modeling dynamic individual-level latent trajectories with changing parameters.
problem Modeling longitudinal data with changing individual-level dynamics parameters.
method Combines deep learning for dimensionality reduction and differential equations for dynamic modeling, allowing different parameters for sub-periods.
result Successfully identifies dynamic parameters and predictors of resilience.
In this paper, we provide a representation theorem for dynamic capital allocation under It{ô}-L{é}vy model. We consider the representation of dynamic risk measures defined under Backward Stochastic Differential Equations (BSDE) with generators that grow quadratic-exponentially in the control variables. Dynamic capital …
Panda predicts chaotic systems without retraining, showing emergent properties.
problem Predicting chaotic systems with small errors.
method Trained on a synthetic dataset of chaotic dynamical systems using evolutionary algorithms.
result Panda predicts unseen chaotic systems with zero-shot learning.
Proposes a method to train neural networks that solve differential equations faster.
problem Training neural networks that solve differential equations becomes computationally expensive.
method Introduces a differentiable surrogate for numerical solver time cost using higher-order derivatives.
result Trains models that are faster to solve while maintaining nearly the same accuracy.
Graph neural controlled differential equations learn graph dynamics from vertex observations.
problem Predicting future states of dynamical systems on graphs with limited vertex data.
method Incorporates graph topology information into NCDE to predict graph dynamics.
result Informed NCDE requires fewer parameters and lower MAE compared to previous methods.
Differentiable Window improves attention modules by enabling more focused attentions.
problem Improving attention mechanisms in neural networks.
method Proposes Differentiable Window, a neural module for dynamic window selection.
result Consistent and sizable improvements across various NLP tasks.
Proposes a differentially private bandit algorithm reducing noise over time.
problem Privacy concerns in interactive recommendation systems.
method Tree-based mechanism to add Laplace or Gaussian noise to model parameters, focusing on dynamic global sensitivity.
result Demonstrates (ε,δ)-differential privacy with reduced noise and improved regret. SINDy-PI robustly identifies implicit dynamics from noisy data.
problem Accurately modeling nonlinear dynamics from noisy data.
method Parallel, implicit SINDy algorithm with multiple optimization algorithms and model selection.
result Significantly more noise robust than previous SINDy approaches.
Bayesian inference for stochastic differential equations using Wishart diffusions.
problem Inferring stochastic differential equations for regression and dynamical modeling.
method Bayesian non-parametric approach with semi-parametric Wishart processes.
result Modeling diffusion in stochastic differential equations improves performance and avoids overfitting.
Study particle dynamics in non-differentiable fractal spaces.
problem Understanding motion in non-smooth, probabilistic geometries.
method Use fiber bundle theory to characterize multivalued geodesic trajectories.
result Developed a hybrid theory combining surface and stochastic process theories.
Study of influenza A virus spread using mathematical equations.
problem Understanding the spread of influenza A virus infection.
method Mathematical model and analysis of dynamical system.
result Surface trajectories and asymptotic behavior of the system.
Neural Laplace models diverse DEs in the Laplace domain for better dynamics.
problem Inadequate ODEs for long-range dependencies and discontinuities.
method Unified framework in Laplace domain, using stereographic map for smoothness.
result Superior performance in diverse DEs, including complex history dependency and abrupt changes.
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
PASTIS selects minimal models from stochastic dynamics data.
problem Overfitting in model selection for stochastic dynamics.
method Combining likelihood-estimation statistics with extreme value theory.
result PASTIS reliably identifies minimal models, even with low sampling rates or error.
Paper proposes a method to verify PINN fidelity using Fisher information from dynamical systems.
problem Quantifying PINN fidelity beyond simple trajectory prediction.
method Employing Fisher information for differentiable dynamical systems to compare PINN's learned equations with analytical models.
result PINN fidelity is verified by matching Fisher information landscapes of learned equations and analytical models.
Study uses machine learning to predict predator-prey dynamics without prior knowledge.
problem Predicting predator-prey interactions without prior knowledge of the system.
method Applied Neural Ordinary Differential Equations (Neural ODEs) and Universal Differential Equations (UDEs) to the Lotka-Volterra model.
result UDEs outperform Neural ODEs in predicting predator-prey dynamics, especially in noisy data.
Bayesian framework for robust model discovery from noisy data.
problem Robust model discovery from noisy, sparse and irregular observations of nonlinear systems.
method Bayesian differential programming using Hamiltonian Monte Carlo and sparsity-promoting priors.
result Efficient inference of posterior distributions over plausible models with quantified uncertainty.
Realizations of stochastic process are often observed temporal data or functional data. There are growing interests in classification of dynamic or functional data. The basic feature of functional data is that the functional data have infinite dimensions and are highly correlated. An essential issue for classifying dyn…
Study connects symmetries in dynamical systems to phase plane representations.
problem Understanding symmetries in dynamical systems and their phase plane realizations.
method Analysis of symmetries in differential equations and phase plane representations, establishing correspondence and lifting conditions.
result Every symmetry generator in one formulation corresponds uniquely to a generator in the other, with a lifting condition to solve.
Hybrid model combines neural networks and fluid dynamics for efficient, generalized simulations.
problem Inefficient and poor generalization of deep learning approximations of fluid dynamics.
method Combines graph neural networks with a differentiable PDE solver inside a neural network.
result Hybrid model generalizes well to new scenarios and outperforms both neural network and traditional methods.
Epileptic seizure activity shows complicated dynamics in both space and time. To understand the evolution and propagation of seizures spatially extended sets of data need to be analysed. We have previously described an efficient filtering scheme using variational Laplace that can be used in the Dynamic Causal Modelling…
This work extends set-valued risk measures to discrete time, using difference inclusions and equations.
problem Defining set-valued dynamic risk measures in discrete time.
method Investigates discrete time setting with difference inclusions and difference equations.
result Provides insights for continuous time representations of set-valued dynamic risk measures.
We propose a neural network based approach for extracting models from dynamic data using ordinary and partial differential equations. In particular, given a time-series or spatio-temporal dataset, we seek to identify an accurate governing system which respects the intrinsic differential structure. The unknown governing…
New method learns spatiotemporal dynamics from random point process observations.
problem Challenges in modeling spatiotemporal dynamics from randomly collected data.
method Integration of neural differential equations, neural point processes, implicit neural representations, and amortized variational inference.
result Significant improvements in predictive accuracy and computational efficiency compared to existing methods.
Improved latent dynamics identification framework reduces training time and improves accuracy.
problem Accurate numerical solutions of partial differential equations require computationally expensive solvers.
method Sequential decoder training (mLaSDI) to correct residual errors from previous stages.
result mLaSDI consistently outperforms standard LaSDI, achieving lower prediction errors and reduced training time.
Letter analyzes training dynamics of a nonlinear contrastive learning model in high dimensions.
problem Understanding training dynamics of nonlinear contrastive learning models in high-dimensional settings.
method High-dimensional analysis using McKean-Vlasov PDEs and low-dimensional ODEs.
result The model's performance evolves according to specific ODEs, revealing features like feature learnability and noise effects.
Paper develops a consistent algorithm for learning graph structure from continuous-time stochastic differential equations.
problem Learning structure from continuous-time stochastic differential equations.
method Score-based structure learning using Neural Ordinary Differential Equations with adaptive regularization.
result The method consistently recovers directed graphs of local independencies in systems of stochastic differential equations.
NDS learns dynamical models with prior knowledge, improving accuracy and efficiency.
problem Learning accurate dynamical models with limited data and varying dynamics.
method Neural Dynamical Systems (NDS) integrates prior knowledge in ODEs with neural networks to estimate parameters and predict states.
result NDS achieves higher accuracy and uses fewer samples compared to other methods.
DyNODE uses neural ODEs to model system dynamics in continuous control tasks.
problem Modeling the dynamics of systems in continuous control tasks.
method Neural Ordinary Differential Equations (ODEs) combined with actor-critic RL.
result DyNODE outperforms standard neural networks in sample efficiency and predictive performance.
We propose an analytically tractable class of models for the dynamics of a limit order book, described through a stochastic partial differential equation (SPDE) with multiplicative noise for the order book centered at the mid-price, along with stochastic dynamics for the mid-price which is consistent with the order flo…
Geometric analysis of nonlinear dynamics applied to financial time series.
problem Understanding dynamic properties of financial time series.
method Nonparametric filtering method to estimate vector fields and their derivatives from nonlinear oscillation models.
result Vector fields and their derivatives provide insights into the dynamic properties of financial time series.
Combines causal learning with dynamical systems for practical model identification.
problem Lack of practical, identifiable models for causal inference in dynamical systems.
method Draws connection between causal representation learning and dynamical systems, applying identifiable methods to scalable differentiable solvers.
result Learned explicitly controllable models for trajectory-specific parameters.
Kernel method approximates dynamical operators from data.
problem Estimating eigenfunctions of dynamical operators from data.
method Kernel-based approach in reproducing kernel Hilbert spaces.
result Eigenfunctions estimated via matrix eigenvalue problems.
Deep learning predicts dynamics from sparse data.
problem Predicting spatiotemporal dynamics from sparse data.
method Spatially dimension-independent deep learning framework.
result Predicts dynamics from sparse data sites.
This paper describes how to define and work with differential equations in the abstract setting of tangent categories. The key notion is that of a curve object which is, for differential geometry, the structural analogue of a natural number object. A curve object is a preinitial object for dynamical systems; dynamical …
Modeling interacting objects with latent Gaussian process ODEs.
problem Time uncertainty-aware modeling of continuous-time dynamics of interacting objects.
method A new model using latent Gaussian process ordinary differential equations to infer independent dynamics and interactions.
result Our model improves long-term predictions and successfully encapsulates independent dynamics and interactions.
Develops Φ-DVAE for assimilating unstructured data into physical models.
problem Challenges in incorporating unstructured data into physical models.
method Physics-informed dynamical variational autoencoder (Φ-DVAE) combining latent state-space model and VAE. result Demonstrates data-efficient dynamics encoding with competitive performance and uncertainty quantification.
Data-driven approach learns effective equations for phase field interfaces.
problem Learning accurate equations for phase field interface dynamics.
method Data-driven identification of partial differential equations from phase field data.
result Data-driven equations outperform analytical approximations in certain regimes.
SimCD simultaneously clusters cells and identifies differential gene expression in scRNA-seq data.
problem Separate clustering and differential expression analysis for scRNA-seq data leads to suboptimal results.
method Develops SimCD, a unified hierarchical gamma-negative binomial model for simultaneous cell clustering and differential expression analysis.
result SimCD outperforms existing methods in discovering cell clusters and capturing dynamic expression changes.
Develops path integral for spiked tensor model dynamics.
problem Dynamics of spiked tensor model with random initial conditions.
method Path integral approach applied to partial differential equations.
result Large-N saddle point equations dominated by melonic diagrams.