Neural dynamical systems are dynamical systems that are described at least in part by neural networks. The class of continuous-time neural dynamical systems must, however, be numerically integrated for simulation and learning. Here, we present a compact neural circuit for two common numerical integrators: the explicit …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Neural Dynamical Systems”
New neural net learns time-reversible symplectic dynamics.
problem Lack of time-reversibility in neural networks for symplectic systems.
method Proposes a new neural network architecture for time-reversible symplectic systems.
result Demonstrates learning of time-reversible symplectic dynamics from data.
NDS learns dynamical models with prior knowledge, improving accuracy and efficiency.
problem Learning accurate dynamical models with limited data and varying dynamics.
method Neural Dynamical Systems (NDS) integrates prior knowledge in ODEs with neural networks to estimate parameters and predict states.
result NDS achieves higher accuracy and uses fewer samples compared to other methods.
New metric compares noisy neural trajectories using optimal transport.
problem Existing metrics fail to capture differences in noisy, dynamic neural responses.
method Proposed an optimal transport distance metric for Gaussian processes.
result Metric effectively compares neural dynamics in different systems.
Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamicsstat.ML
dLDS models neural dynamics as sparse combinations of simpler components.
problem Understanding complex neural dynamics at a population level.
method Proposes a decomposed dynamical system model trained through dictionary learning.
result Model efficiently captures and demix diverse neural dynamics.
Stabilized neural differential equations enforce constraints on dynamical systems.
problem Ensuring dynamical systems preserve known constraints like conservation laws.
method SNDEs with a stabilization term to enforce manifold constraints.
result SNDEs outperform existing methods and broaden constraint types.
Stretched and measured neural predictions of complex network dynamicscond-mat.stat-mech
Neural networks improve predictions of complex network dynamics.
problem Improving neural network predictions for complex network dynamics.
method Extended neural network models to complex systems, ensuring they conform to dynamical model assumptions and using a statistical significance test.
result Achieved advanced generalization of neural network predictions for complex systems.
This work introduces a method to learn dynamical systems from noisy sensor measurements using multiple shooting.
problem Learning dynamical systems from noisy sensor measurements is challenging due to system instability.
method A scalable method based on multiple shooting.
result Robust learning of latent representations of dynamical systems from noisy measurements.
New method models unknown systems with hidden parameters using neural networks.
problem Modeling unknown dynamical systems with hidden parameters.
method Training a deep neural network (DNN) model using trajectory data of the unknown system.
result DNN model accurately predicts unknown dynamical systems with new initial conditions.
Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamicsstat.ML
Improved robust latent variable estimation for neural dynamics.
problem Inconsistent results due to noise and nonlinearity in existing models.
method Probabilistic approach to latent variable estimation in decomposed models.
result More accurate latent variable inference in nonlinear systems with diverse noise conditions.
This work learns effective dynamics from short-term data of stochastic systems.
problem Learning effective dynamics from short-term data of stochastic systems.
method Proposes a novel algorithm using a neural network (Auto-SDE) to learn invariant slow manifold from data.
result Validated through numerical experiments to be accurate, stable, and effective.
Parallel neural network training yields better long-term prediction accuracy.
problem Choosing the right training strategy for neural networks in dynamical systems.
method Comparison of parallel and series-parallel training strategies on five neural network architectures and two examples.
result Parallel training consistently outperforms series-parallel training in long-term prediction accuracy.
Neural Shadow-Mapping uncovers causal links in dynamic systems.
problem Discovering causal structures in dynamic systems with mirage correlations.
method Neural network based method embedding high-dimensional data into a shadow representation for causal link estimation.
result Demonstrates performance in discovering causal links from video-representations of dynamic systems.
Neuromorphic Computing is a nascent research field in which models and devices are designed to process information by emulating biological neural systems. Thanks to their superior energy efficiency, analog neuromorphic systems are highly promising for embedded, wearable, and implantable systems. However, optimizing neu…
dynoNet learns dynamical systems using linear operators.
problem Learning complex dynamical systems.
method dynoNet uses linear dynamical operators for sequence modeling and system identification.
result dynoNet effectively identifies systems on benchmarks.
New technologies for recording the activity of large neural populations during complex behavior provide exciting opportunities for investigating the neural computations that underlie perception, cognition, and decision-making. Nonlinear state space models provide an interpretable signal processing framework by combinin…
Paper develops a neural-fuzzy controller for GPS-intelligent buoys.
problem Optimally track dynamically positioned marine buoys with unknown parameters.
method Dynamic system modeling using neural-fuzzy networks with backstepping technique.
result The controller minimizes position errors and adjusts buoy positions accurately.
Develops CLDS models to model neural activity with nonlinear dynamics.
problem Complex, nonlinear dynamics in neural population activity.
method Conditionally Linear Dynamical System (CLDS) models using Gaussian Process (GP) priors.
result CLDS models can perform well even in data-limited conditions.
Meta-Dynamic models learn shared neural dynamics across tasks.
problem Learning latent dynamics from neural recordings across different tasks.
method Captures variabilities on a low-dimensional manifold to meta-learn dynamics.
result Meta-Dynamic models can rapidly learn latent dynamics from new recordings.
Unsupervised learning of multiscale switching dynamical system models from multimodal neural datacs.LG
New algorithm learns switching dynamics from multiple neural signals.
problem Learning accurate switching dynamical system models from multimodal neural data.
method Unsupervised learning algorithm for multiscale switching dynamical system models.
result Switching multiscale dynamical system models outperform single-scale models in behavior decoding.
This work introduces the concept of tangent space regularization for neural-network models of dynamical systems. The tangent space to the dynamics function of many physical systems of interest in control applications exhibits useful properties, e.g., smoothness, motivating regularization of the model Jacobian along sys…
Develops a method to model neural dynamics with flexible yet interpretable latent states.
problem Capturing complex nonlinear dynamics in neural time series while maintaining interpretability.
method Gaussian Process Switching Linear Dynamical System (gpSLDS) that balances expressiveness and interpretability.
result Favorable performance in comparison to rSLDS on synthetic and real neuroscience data.
Neural Physicist learns physical dynamics from images.
problem Learning meaningful physical state representations and accurate state transitions from image sequences.
method Neural Physicist uses VAE for state extraction, NP for parameters, and SSM for dynamics.
result Achieves long-term predictions and identifies system degrees of freedom.
Use simplified layerwise linear models to understand neural dynamics.
problem Complex neural network dynamics are hard to grasp.
method Apply simplified layerwise linear models to explain neural phenomena.
result Simplified models explain neural collapse, emergence, etc.
Researchers dissect Neural ODEs to understand their dynamics.
problem Understanding the inner workings of Neural ODEs.
method Developing continuous-depth formulation to clarify design choices.
result Clarified the influence of design choices on Neural ODE dynamics.
We propose a method to infer stochastic low-rank RNNs from neural data.
problem Fitting low-rank RNNs to noisy, stochastic neural data.
method Variational sequential Monte Carlo methods for stochastic low-rank RNNs.
result Lower dimensional latent dynamics compared to state-of-the-art methods.
State-space models improve dynamical system predictions efficiently and accurately.
problem Challenges in predicting dynamical systems, including long-time integration and long-range dependencies.
method State-space models implemented in Mamba, addressing limitations of existing architectures.
result Mamba outperforms other models in interpolation and challenging extrapolation tasks.
PNDEs project neural dynamics onto constraint manifolds, improving accuracy and stability.
problem Learning dynamics from data without violating known constraints.
method Projecting the learned vector field onto the tangent space of the constraint manifold.
result PNDEs outperform existing methods in learning constrained dynamical systems.
Paper proposes a method to verify PINN fidelity using Fisher information from dynamical systems.
problem Quantifying PINN fidelity beyond simple trajectory prediction.
method Employing Fisher information for differentiable dynamical systems to compare PINN's learned equations with analytical models.
result PINN fidelity is verified by matching Fisher information landscapes of learned equations and analytical models.
FNSDA adapts to new dynamics via Fourier space adaptation.
problem Generalizing to unseen dynamical systems with limited data.
method Automatic partitioning of known environments in Fourier modes and adaptation of specific modes for new environments.
result FNSDA achieves superior or competitive generalization performance with reduced parameter cost.
Deep neural nets approximate random dynamical system trajectories uniformly in time.
problem Approximating trajectories of random dynamical systems over infinite time horizons.
method Recurrent neural networks with simple feedback structures.
result Certain random trajectories can be approximated uniformly in time to any desired accuracy.
Proposes neural delay differential equations for stable system identification with partially observed states.
problem Learning stable models for systems with partial or delayed observations.
method Augments states with history, uses neural delay differential equations, and ensures stability through time delay analysis.
result The approach ensures stability of learned models for partially observed systems.
Complex high dimensional stochastic dynamic systems arise in many applications in the natural sciences and especially biology. However, while these systems are difficult to describe analytically, "snapshot" measurements that sample the output of the system are often available. In order to model the dynamics of such sys…
Neural ODEs control graph dynamics with low energy feedback.
problem Controlling complex dynamical systems on graphs.
method Neural Ordinary Differential Equation Control (NODEC) framework.
result NODEC learns low-energy control signals for graph dynamical systems.
New method learns spatiotemporal dynamics from random point process observations.
problem Challenges in modeling spatiotemporal dynamics from randomly collected data.
method Integration of neural differential equations, neural point processes, implicit neural representations, and amortized variational inference.
result Significant improvements in predictive accuracy and computational efficiency compared to existing methods.
We present the MagNet, a neural network-based multi-agent interaction model to discover the governing dynamics and predict evolution of a complex multi-agent system from observations. We formulate a multi-agent system as a coupled non-linear network with a generic ordinary differential equation (ODE) based state evolut…
FML uses neural networks to model unknown systems accurately.
problem Modeling unknown dynamical systems with incomplete data.
method Flow map learning (FML) combined with deep neural networks.
result Accurate predictive models for partially observed systems.
GFM models neural network training as a dynamical system to forecast final weights.
problem Computational intensity and inefficiency in training deep neural networks.
method Gradient Flow Matching (GFM) treats training as a dynamical system with learned vector fields.
result GFM achieves forecasting accuracy competitive with Transformer-based models and significantly outperforms classical baselines.
A Distribution-to-Distribution Neural Probabilistic Forecasting Framework for Dynamical Systemsstat.ML
Develops a neural framework for probabilistic forecasting of dynamical systems.
problem Uncertainty quantification in dynamical systems using trajectory-oriented approaches.
method D2D neural probabilistic forecasting framework using kernel mean embeddings and mixture density networks.
result The D2D model captures distributional evolution in chaotic systems and produces skillful probabilistic forecasts.
We propose Symplectic Recurrent Neural Networks (SRNNs) as learning algorithms that capture the dynamics of physical systems from observed trajectories. An SRNN models the Hamiltonian function of the system by a neural network and furthermore leverages symplectic integration, multiple-step training and initial state op…
Neural EKF improves structural dynamics prediction.
problem Accurately predicting structural response for health monitoring.
method Neural Extended Kalman Filter (Neural EKF) for learning dynamics.
result Significant predictive capabilities demonstrated on simulated and real-world data.
Theory of learning of high-dimensional controlled non-linear dynamical systems (I): models and methodscond-mat.dis-nn
Neural ODEs provide a framework for studying the training dynamics of neural networks.
problem Training dynamics of neural networks
method Dynamical mean field theory
result Derive learning curves in the high-dimensional limit
DyNODE uses neural ODEs to model system dynamics in continuous control tasks.
problem Modeling the dynamics of systems in continuous control tasks.
method Neural Ordinary Differential Equations (ODEs) combined with actor-critic RL.
result DyNODE outperforms standard neural networks in sample efficiency and predictive performance.
Neural network models colloidal particle dynamics in non-equilibrium systems.
problem Analyzing non-equilibrium dynamics of many-body colloidal systems.
method Combining power functional theory and machine learning, training a neural network to predict internal force fields.
result The neural network accurately predicts dynamics in non-equilibrium systems, in good agreement with simulations.
RNNs compute by warping neural representations over time.
problem Understanding how RNNs perform task computations.
method Developed a Riemannian geometric framework to derive the manifold topology and geometry of RNNs.
result Dynamic warping is a fundamental feature of RNN computations.
SSINNs learn Hamiltonian systems from data with interpretable, low-memory models.
problem Learning Hamiltonian dynamical systems from data efficiently and accurately.
method Combines fourth-order symplectic integration with sparse regression for a learned Hamiltonian.
result Outperforms state-of-the-art techniques in system prediction and energy conservation.
Interacting systems are prevalent in nature, from dynamical systems in physics to complex societal dynamics. The interplay of components can give rise to complex behavior, which can often be explained using a simple model of the system's constituent parts. In this work, we introduce the neural relational inference (NRI…
This work discovers latent field effects governing interacting dynamical systems.
problem Discovering field effects governing interacting dynamical systems.
method Proposes neural fields to learn latent force fields from observed dynamics, disentangling local object interactions and global field effects.
result Accurately discovers latent field effects in various dynamical systems.