Proposes a method to encode dynamical systems for efficient data compression.
problem Efficiently encoding sequences generated by dynamical systems.
method Introduces a local information criterion for model selection in dynamical systems.
result The proposed method can select the best model closer to the true dynamics.
New method for Transformer models to encode position information without sequential bias.
problem Lack of flexible and learnable position encoding for Transformer models.
method Continuous dynamical model to learn position encoding.
result Consistent improvements over baselines in various NLP tasks.
Survey reviews recent advances in learning graph representations over time.
problem Challenges in learning and inference for evolving graphs.
method Categorizes models from encoder-decoder perspective, analyzes techniques.
result Highlights directions for future research in dynamic graph representation learning.
Dissipative SymODEN learns dynamics with dissipation and control from data.
problem Learning dynamics with dissipation and control from observed data.
method Dissipative SymODEN encodes port-Hamiltonian dynamics into a deep learning architecture.
result The learned model reveals key aspects of the system, such as inertia, dissipation, and potential energy.
TIMeSynC combines financial service interactions for intent prediction.
problem Aligning and learning from multi-domain, multi-resolution sequences for accurate intent prediction.
method An encoder-decoder transformer model addressing sequence alignment, temporal dynamics, and dynamic/static sequence combination.
result Significant improvement in intent prediction over existing methods.
Time-lagged VAE reduces complex dynamics to a single embedding.
problem Interpreting high-dimensional time-series data for nonlinear systems.
method Variational dynamics encoder (VDE) using time-lagged variational autoencoders.
result Captures nontrivial dynamics in various examples, including protein folding.
DIVA clusters dynamic data without needing cluster count, outperforming baselines.
problem Clustering complex, dynamic data without prior knowledge of cluster count.
method Nonparametric Dirichlet Process Mixtures with memoized online variational inference.
result DIVA outperforms state-of-the-art in classifying complex data with changing features.
Auto-encoders learn atomistic to coarse-grained mappings for molecular dynamics.
problem Simulating large systems in molecular dynamics is computationally expensive.
method Auto-encoders learn both atomistic to coarse-grained mappings and the coarse-grained potential energy function.
result Auto-encoders enable efficient simulation of larger systems in molecular dynamics.
VAE improves protein dynamics modeling by maximizing latent autocorrelation.
problem Modeling slow processes in protein dynamics.
method Maximizing latent autocorrelation in VAE architecture.
result VDE framework optimizes latent coordinate for slow processes.
New algorithm learns switching dynamics from multiple neural signals.
problem Learning accurate switching dynamical system models from multimodal neural data.
method Unsupervised learning algorithm for multiscale switching dynamical system models.
result Switching multiscale dynamical system models outperform single-scale models in behavior decoding.
A new model disentangles object recognition and dynamics from video data.
problem Temporal reasoning in dynamically changing video data.
method Kalman variational auto-encoder framework for unsupervised learning.
result Model disentangles object representation and dynamics, outperforming other methods.
WeldNet reduces complex dynamics to simpler, manageable segments.
problem Complex, high-dimensional time-dependent datasets from physical processes are costly to simulate.
method Windowed Encoders for Learning Dynamics, splitting time domain into windows for nonlinear dimension reduction and propagator training.
result WeldNet captures nonlinear latent structures and dynamics, outperforming existing methods.
This research improves dynamical systems understanding by identifying latent states and their nonlinear transitions.
problem Previous work on dynamical systems could not identify nonlinear transition dynamics, leading to unreliable predictions.
method Proposes a state-space modeling framework using variational auto-encoders to identify latent states and their nonlinear transition functions.
result Demonstrates high accuracy in recovering latent state dynamics and future prediction accuracy.
Transfer neural networks for efficient protein dynamics sampling.
problem Efficiently sampling protein dynamics in related systems.
method Variational auto-encoder framework with latent embedding for collective variable.
result Transferable model trained on one protein can efficiently sample related mutants.
Paper introduces Tensor Gauge Flow Models for better data encoding.
problem Lack of expressive flow dynamics in existing Generative Flow Models.
method Incorporates higher-order Tensor Gauge Fields into the Flow Equation.
result Tensor Gauge Flow Models achieve improved generative performance.
Study clusters bank customers using LSTM and DTW.
problem Efficiently segmenting bank customers for targeted offers.
method Encoder-decoder LSTM network and Dynamic Time Warping (DTW).
result Hybrid method yields more accurate clusters.
This paper proposes a method to train energy-based models using variational auto-encoders for efficient sampling.
problem Training energy-based models by maximum likelihood is challenging due to intractable partition functions and difficult sampling from the model distribution.
method The authors propose using a variational auto-encoder to initialize finite-step MCMC sampling, specifically Langevin dynamics, to train the energy-based model.
result The proposed method enables training energy-based models using maximum likelihood, generating samples comparable to GANs and EBMs.
Proposes a THGNN for dynamic financial time series prediction.
problem Challenges in predicting stock market price movements.
method Temporal and heterogeneous graph neural network (THGNN) approach.
result Significantly improved prediction performance compared to state-of-the-art methods.
NRI model learns interactions from data without labels.
problem Learning interactions in systems from unlabeled data.
method Variational auto-encoder with graph neural networks.
result NRI model accurately recovers interactions and predicts dynamics.
New method detects dynamical system changes in time series data.
problem Detecting changes in time series data structures.
method Weighted Ordinal Partition Network (OPN) with topological data analysis (TDA).
result Improved accuracy and resilience to noise in dynamic state detection.
SFM resolves small-scale physics challenges in weather data.
problem Challenges in super-resolving small-scale details in physical sciences like weather.
method Encoding inputs to a latent base distribution, flow matching for stochastic details, adaptive noise scaling.
result SFM framework significantly outperforms existing methods.
LD-EnSF speeds up data assimilation with sparse observations.
problem Efficiently assimilate sparse and noisy data into complex dynamical systems.
method LD-EnSF uses latent dynamics networks and history-aware LSTM encoders to process sparse observations without full-space simulations.
result Achieves significant speedups over existing methods while maintaining high accuracy.
Neural Physicist learns physical dynamics from images.
problem Learning meaningful physical state representations and accurate state transitions from image sequences.
method Neural Physicist uses VAE for state extraction, NP for parameters, and SSM for dynamics.
result Achieves long-term predictions and identifies system degrees of freedom.
Unified inference framework for spatiotemporal data.
problem Challenges in extracting mechanistic insights from complex spatiotemporal data.
method Vision transformer-driven variational encoding and likelihood-free Bayesian approach.
result Unified inference framework for identifying spatial and temporal patterns.
DSA improves sentence embedding by dynamically attending to words.
problem Efficiently capturing the importance of words in sentences for embedding.
method DSA modifies dynamic routing from capsule networks for self-attention in sentences.
result DSA achieves state-of-the-art results in SNLI with fewer parameters.
TK-GCN forecasts spatiotemporal dynamics using Koopman-enhanced graph convolutional networks.
problem Forecasting complex spatiotemporal dynamics over irregular domains.
method Two-stage framework: Koopman-enhanced Graph Convolutional Network (K-GCN) for spatial encoding and Transformer for temporal modeling.
result TK-GCN outperforms state-of-the-art methods in spatiotemporal cardiac dynamics forecasting.
MT-VAE learns motion transitions for generating diverse future motions.
problem Learning long-term human motion sequences with transitions.
method Jointly learns motion mode embeddings and transitions using Variational Auto-Encoders.
result Generates multiple plausible future motion sequences from input.
STG2Seq predicts multi-step passenger demand with graph and hierarchical structure.
problem Predicting passenger demand over multiple time horizons is challenging due to nonlinear and dynamic spatial-temporal dependencies.
method Proposes a graph-based model with a hierarchical graph convolutional structure to capture spatial and temporal correlations.
result Consistently outperforms baseline and state-of-the-art models on real-world datasets.
New approach decodes stock volatility states for S&P500 network.
problem Discovering multiple volatility states in S&P500 stock returns.
method Encoding-and-decoding approach using quantile-based thresholds and change point detection.
result Forecasting stock returns and revealing volatility dynamics.
Study connects flow dynamics to 3D geometry via surface intersections.
problem Relating flow dynamics to geometric properties of 3-manifolds.
method Relates pseudo-Anosov flow dynamics to hyperbolic geometry via curve graphs.
result Established a link between flow invariants and geometric features of 3-manifolds.
VectorNet predicts car behavior using vectorized HD maps and agent dynamics.
problem Predicting behavior in multi-agent systems with self-driving cars.
method VectorNet uses hierarchical graph neural networks on vectorized representations of HD maps and agent trajectories.
result VectorNet achieves comparable or better performance than state-of-the-art methods while using fewer parameters and less computational power.
New method learns nonlinear projections for reduced-order modeling of complex dynamical systems.
problem Modeling transient dynamics near a manifold in nonlinear systems.
method Constrained autoencoder neural networks with invertible activation functions and biorthogonal weight matrices.
result Demonstrated effectiveness on a vortex shedding model, learning oblique fibers for fast dynamics.
D2PCCA integrates deep learning and probabilistic modeling for nonlinear dynamical systems.
problem Analyzing nonlinear dynamical systems with probabilistic understanding.
method Combines deep learning and probabilistic modeling, using KL annealing and normalizing flows.
result Captures latent dynamics in sequential datasets with improved convergence and flexibility.
Study reduces financial dynamics complexity using PCA for NASDAQ, oil, gold, and USD.
problem Understanding complex financial interactions among multiple assets.
method Time-delay embedding and PCA for dimensionality reduction, followed by linear regression.
result Limited number of principal components capture dominant dynamics of each asset.
Study analyzes inference dynamics in deep generative models to improve concept formation.
problem Understanding the mechanism of inference in deep generative models.
method Numerical analysis of a VAE model with added noise, focusing on latent space activity patterns and concept formation.
result Inference dynamics in VAEs approach a concept as input data noise increases, enhancing generalization ability.
Method learns model for unknown stochastic system from data.
problem Modeling unknown stochastic dynamical systems.
method Autoencoder approach using deep neural networks (DNNs).
result Decoder serves as a predictive model for unknown stochastic systems.
Improved VAE models avoid posterior collapse in text modeling.
problem Posterior collapse in VAEs leads to poor data manifold parameterization.
method Coupled-VAE couples a VAE with a deterministic autoencoder to improve encoder and decoder parameterizations.
result Coupled-VAE consistently improves results in probability estimation and latent space richness.
BiCoGAN improves cGANs by disentangling latent and auxiliary variables.
problem Improving disentanglement of latent and auxiliary variables in cGANs.
method BiCoGAN uses bidirectional training with extrinsic factor loss and dynamically-tuned importance weight.
result BiCoGAN encodes auxiliary variables more accurately and disentangles latent and auxiliary variables effectively.
The process of dynamic state estimation (filtering) based on point process observations is in general intractable. Numerical sampling techniques are often practically useful, but lead to limited conceptual insight about optimal encoding/decoding strategies, which are of significant relevance to Computational Neuroscien…
Method analyzes large-scale network data to detect communication pattern shifts.
problem Analyzing large-scale time-series network data is challenging.
method Temporal encoder embedding method using ground-truth or estimated vertex labels.
result Detects communication pattern shifts across all levels of network structure.
Dynamical-VAE learns causal dynamics from POMDPs using future information.
problem Learning accurate state representations from partial observations in POMDPs.
method Dynamical Variational Auto-Encoder (DVAE) with hindsight framework.
result DVAE uncovers causal graph more effectively than history-based methods.
A model learns stock trading rules from raw prices using encoder-decoder neural network.
problem Extracting features from long price sequences for profitable trading rules.
method Neural encoder-decoder framework combined with DRL.
result The model outperforms state-of-the-art models in dynamic environments.
WeatherFormer learns robust weather features from small datasets.
problem Modeling complex weather dynamics from limited data.
method Pretrained transformer encoder on large satellite dataset, with spatiotemporal encoding.
result State-of-the-art performance in county-level soybean yield prediction and influenza forecasting.
We study the dynamics of the vector field on an open surface given by the gradient of a Green's function. This dynamical approach enables us to show that this field induces an invariant decomposition of the surface as the union of a disk and a 1-skeleton that encodes the topology of the surface. We analyze the structur…
Method learns to map dynamics of different systems.
problem Mapping dynamics of different systems.
method Learned latent dynamical system for mapping.
result Learned correspondences enable imagined motions and bisimulation.
DyRep learns dynamic graph node embeddings efficiently.
problem Efficiently encoding evolving information over dynamic graphs into low-dimensional representations.
method Inductive deep representation learning framework using time-scale dependent multivariate point process model.
result Significantly outperforms baselines on real-world datasets for dynamic link and event time prediction.
A novel deep probabilistic model for dynamic systems forecasting.
problem Probabilistic forecasting in dynamic systems.
method Combining deep generative models and state space models with recurrent neural networks and variational sequence models.
result Outperforms existing models in system identification benchmarks and real-world centrifugal compressor forecasting.
Neuroscience is experiencing a data revolution in which many hundreds or thousands of neurons are recorded simultaneously. Currently, there is little consensus on how such data should be analyzed. Here we introduce LFADS (Latent Factor Analysis via Dynamical Systems), a method to infer latent dynamics from simultaneous…