Neural networks improve predictions of complex network dynamics.
problem Improving neural network predictions for complex network dynamics.
method Extended neural network models to complex systems, ensuring they conform to dynamical model assumptions and using a statistical significance test.
result Achieved advanced generalization of neural network predictions for complex systems.
This research provides theoretical guarantees for hyperparameter estimation in complex network dynamical systems.
problem Theoretical guarantees for hyperparameter estimation in large, inhomogeneous complex network dynamical systems.
method Formulating the system's evolution in a measure transport perspective, proposing a theoretical framework for estimating hyperparameters with mean-type observations.
result A nonasymptotic bound for the deviation of hyperparameter estimates in inhomogeneous complex network dynamical systems with respect to network population size.
This work introduces a method to learn dynamical systems from noisy sensor measurements using multiple shooting.
problem Learning dynamical systems from noisy sensor measurements is challenging due to system instability.
method A scalable method based on multiple shooting.
result Robust learning of latent representations of dynamical systems from noisy measurements.
Koopman operator theory simplifies complex systems analysis.
problem Analyzing nonlinear dynamical systems and complex networks.
method Estimating Koopman operator from data to reveal system properties.
result Koopman operators provide insights into system characteristics.
SRNNs learn dynamics of physical systems from data.
problem Learning dynamics of complex, noisy Hamiltonian systems.
method SRNNs model Hamiltonian functions with neural networks, using symplectic integration and optimization.
result SRNNs reliably learn dynamics of complex and noisy Hamiltonian systems.
Reduces complexity of financial contagion dynamics on networks.
problem Complexity of financial contagion dynamics on networks.
method Dimensional reduction methods (degree-weighted and spectral reduction).
result Spectral reduction better handles heterogeneous networks.
Proposes neural networks that preserve physical system dynamics.
problem Learning accurate representations of dynamical systems.
method Variational integrator networks designed to preserve geometric structure.
result Accurately learns dynamical systems from noisy observations.
Examines multiagent systems for complex learning tasks.
problem Achieving cohesive learning behavior in multiagent networks.
method General formulation for multiagent dynamics and conditions for learning.
result Conditions for achieving cohesive learning behavior in multiagent networks.
Networks of coupled dynamical systems provide a powerful way to model systems with enormously complex dynamics, such as the human brain. Control of synchronization in such networked systems has far reaching applications in many domains, including engineering and medicine. In this paper, we formulate the synchronization…
MagNet uses neural networks to predict multi-agent dynamics from observations.
problem Predicting the evolution of complex multi-agent systems.
method Formulated a coupled non-linear network with ODE-based state evolution, trained a neural network to discover dynamics from observations.
result Orders of magnitude improvement in prediction accuracy over traditional models.
Proposes local coordinate frames for improving model performance in complex dynamical systems.
problem Improving model performance in complex, non-linear, and time-dependent dynamical systems.
method Introduces roto-translation invariant local coordinate frames for geometric graphs.
result The approach outperforms state-of-the-art models in various complex scenarios.
This work learns effective dynamics from short-term data of stochastic systems.
problem Learning effective dynamics from short-term data of stochastic systems.
method Proposes a novel algorithm using a neural network (Auto-SDE) to learn invariant slow manifold from data.
result Validated through numerical experiments to be accurate, stable, and effective.
Graph neural networks detect structural perturbations from time series data.
problem Detecting structural causes of disturbances in complex systems.
method Graph neural network approach to infer structural perturbations from functional time series.
result Data-driven approach outperforms typical reconstruction methods and meets Bayesian inference accuracy.
Machine learning detects tipping points in complex systems.
problem Detecting abrupt shifts in complex dynamical systems.
method Equilibrium-informed neural networks (EINNs) trained on candidate equilibrium states.
result EINNs can identify critical thresholds in nonlinear systems.
Study evaluates machine learning methods for uncertainty quantification in complex systems.
problem Accurately quantify epistemic and aleatoric uncertainties in complex dynamical systems.
method Examined Gaussian processes, UQ-augmented neural networks (ENN, BNN, D-NN, G-NN) on two model data sets.
result Concluded on model architecture and hyperparameter tuning for improved UQ accuracy.
A theoretical framework that supports automated construction of dynamic prime models purely from experimental time series data has been invented and developed, which can automatically generate (construct) data-driven models of any time series data in seconds. This has resulted in the formulation and formalisation of ne…
Fault detection problem for closed loop uncertain dynamical systems, is investigated in this paper, using different deep learning based methods. Traditional classifier based method does not perform well, because of the inherent difficulty of detecting system level faults for closed loop dynamical system. Specifically, …
Generative adversarial network for probabilistic forecasting of random systems.
problem Forecasting random dynamical systems without distributional assumptions.
method Recurrent neural network and generative adversarial network (GAN) with regularization based on maximum mean discrepancy (MMD).
result The proposed model successfully forecasts complex stochastic processes with multiple-step predictions.
New algorithm reduces sample complexity for online reinforcement learning.
problem Reducing sample complexity for online reinforcement learning in nonlinear systems.
method Generalized algorithm for various dynamical systems, including neural networks.
result Achieves policy regret of O(Nε^2 + d_u ln(m(ε))/ε^2) in general settings.
KalmanNet uses neural networks to improve state estimation in systems with unknown dynamics.
problem State estimation of systems with non-linear dynamics and partial information.
method KalmanNet integrates a recurrent neural network with the Kalman filter to handle non-linearities and model mismatches.
result KalmanNet outperforms classic filtering methods in systems with both mismatched and accurate domain knowledge.
GNN improves financial risk detection in dynamic networks.
problem Complex, changing financial networks make traditional risk identification methods ineffective.
method Graph Neural Networks (GNN) for embedded representation learning of financial data.
result GNN enhances the detection of hidden risks and abnormal behaviors in financial networks.
New method learns cell trajectories and network interactions from single-cell data.
problem Network inference in systems biology from steady-state data.
method Min-entropy estimation for stochastic dynamics, leveraging both temporal and perturbational data.
result Jointly learns cellular trajectories and network interactions.
ETGPSSM efficiently models high-dimensional, non-stationary systems with reduced complexity.
problem Prohibitive computational and parametric complexity in high-dimensional, non-stationary dynamical systems.
method ETGPSSM integrates a single shared GP with input-dependent normalizing flows for scalable and flexible modeling.
result ETGPSSM outperforms existing models in computational efficiency and accuracy.
The paper deals with the problem of reconstructing the topological structure of a network of dynamical systems. A distance function is defined in order to evaluate the "closeness" of two processes and a few useful mathematical properties are derived. Theoretical results to guarantee the correctness of the identificatio…
Survey on LSTM-based anomaly detection for technical systems.
problem Detect anomalies in technical systems due to complex dynamics.
method Use LSTM networks and other AI techniques to detect anomalies considering temporal and contextual characteristics.
result Demonstrates the potential of LSTM networks and graph-based approaches for anomaly detection.
We analyze numerically the training dynamics of deep neural networks (DNN) by using methods developed in statistical physics of glassy systems. The two main issues we address are (1) the complexity of the loss landscape and of the dynamics within it, and (2) to what extent DNNs share similarities with glassy systems. O…
Interacting systems are prevalent in nature, from dynamical systems in physics to complex societal dynamics. The interplay of components can give rise to complex behavior, which can often be explained using a simple model of the system's constituent parts. In this work, we introduce the neural relational inference (NRI…
The global financial crisis in 2007-2009 demonstrated that systemic risk can spread all over the world through a complex web of financial linkages, yet we still lack fundamental knowledge about the evolution of the financial web. In particular, interbank credit networks shape the core of the financial system, in which …
Complex high dimensional stochastic dynamic systems arise in many applications in the natural sciences and especially biology. However, while these systems are difficult to describe analytically, "snapshot" measurements that sample the output of the system are often available. In order to model the dynamics of such sys…
Cellular regulatory dynamics is driven by large and intricate networks of interactions at the molecular scale, whose sheer size obfuscates understanding. In light of limited experimental data, many parameters of such dynamics are unknown, and thus models built on the detailed, mechanistic viewpoint overfit and are not …
New method identifies key genes affecting phenotypes in biological systems.
problem Identifying genes that drive specific phenotypes in complex biological systems.
method Data-driven observability decomposition using Koopman operators.
result Koopman operator representation identifies genes that drive phenotypes.
This study uses persistent homology to analyze complex transitional networks from time series data.
problem Lack of effective tools to summarize complex topology in transitional networks.
method Persistent homology from topological data analysis applied to coarse-grained state-space networks (CGSSN).
result CGSSN improves dynamic state detection and noise robustness compared to other methods.
iLED framework offers interpretable dynamics for multiscale systems.
problem Modeling high-dimensional multiscale systems is challenging.
method Interpretable Learning Effective Dynamics (iLED) framework based on Mori-Zwanzig and Koopman operator theory.
result Comparable accuracy to state-of-the-art approaches with added interpretability.
This paper presents a new causal network learning algorithm (FSNN, Feedback System Neural Network) based on the construction and analysis of a non-linear system of Ordinary Differential Equations (ODEs). The constructed system provides insight into the mechanisms responsible for generating the past and potential future…
Model for open, decentralized network with task load balancing.
problem Complex computational tasks in open, decentralized networks.
method Incentive-based load balancing using economic mechanisms.
result Optimized resource allocation and enhanced system resilience.
Enhances neural network dynamics to boost computational capacity.
problem Improving computational capacity of neural networks.
method Introducing Phase Transition Adaptation to drive system dynamics towards edge of stability.
result Consistently achieves enhancement in computational capacity over multiple datasets.
Understanding biological network dynamics is a fundamental issue in various scientific and engineering fields. Network theory is capable of revealing the relationship between elements and their propagation; however, for complex collective motions, the network properties often transiently and complexly change. A fundame…
Graph Neural Network improves causal inference in dynamic systems.
problem Identifying causal relations among multi-variate time series.
method Graph Neural Network approach with score-based method.
result Graph Neural Network significantly outperformed other methods in dynamic Bayesian network inference.
Stable deep models learn dynamical systems with formal stability guarantees.
problem Difficulties in making formal claims about stability of deep network dynamics models.
method Jointly learning a dynamics model and Lyapunov function to ensure non-expansiveness.
result Proposes an approach for stable deep learning of dynamical systems.
Although classical economic theory is based on the concept of stable equilibrium, real economic systems appear to be always out of equilibrium. Indeed, they share many of the dynamical features of other complex systems, e.g., ecological food-webs. We focus on the relation between increasing complexity of the economic n…
Neural differential equations combine deep learning and differential equations for modeling complex systems.
problem Modeling complex systems with high capacity and efficiency.
method Combining neural networks and differential equations, focusing on neural ordinary, controlled, and stochastic differential equations.
result NDEs offer high-capacity function approximation, strong priors, and handle irregular data efficiently.
In a complex system, the interactions between individual agents often lead to emergent collective behavior like spontaneous synchronization, swarming, and pattern formation. The topology of the network of interactions can have a dramatic influence over those dynamics. In many studies, researchers start with a specific …
Use simplified layerwise linear models to understand neural dynamics.
problem Complex neural network dynamics are hard to grasp.
method Apply simplified layerwise linear models to explain neural phenomena.
result Simplified models explain neural collapse, emergence, etc.
Paper proposes learning system dynamics from irregularly-sampled partial observations.
problem Capturing dynamics of multi-agent systems with irregular and partial observations.
method LG-ODE, a latent ordinary differential equation model using graph neural networks and neuralODE.
result Demonstrates effectiveness on motion capture, spring system, and charged particle datasets.
Bayesian method infers network topology and dynamics from noisy, sparse measurements.
problem Learning network topology and dynamics from partial, noisy data.
method Developed method uses dynamical structure functions derived from linear stochastic differential equations.
result Method outperforms state-of-the-art methods in various network types.
Neural EKF improves structural dynamics prediction.
problem Accurately predicting structural response for health monitoring.
method Neural Extended Kalman Filter (Neural EKF) for learning dynamics.
result Significant predictive capabilities demonstrated on simulated and real-world data.
Adapts MBDOE for real-time parameter estimation in complex systems.
problem Costly posterior inference and design optimization in nonlinear systems.
method Combines DAD with differentiable mechanistic models for real-time parameter estimation.
result Demonstrated on four systems, including a DC motor.
Tensor networks help learn complex physical laws from data.
problem Identifying non-linear dynamical laws from complex physical systems.
method Tensor network parameterizations and rank-adaptive optimization.
result Optimal tensor network models can be learned from data.