Optimal estimator derived for partially observable LTI systems.
problem Optimal estimator for partially observable LTI systems.
method State-space representation for derivation of optimal estimator.
result Derivation of minimum error variance estimator for partially observable LTI systems.
State-space systems generate probabilistic dependencies between inputs and outputs.
problem Understanding probabilistic dependencies in state-space systems.
method Introducing a probabilistic framework and proving sufficient conditions for output existence and uniqueness.
result State-space systems can generate probabilistic dependencies, even without functional relations.
Empirical mode modeling improves state-space analysis of noisy data.
problem Analyzing nonlinear systems with noisy data.
method Combining empirical mode decomposition with empirical dynamic modeling.
result Empirical mode modeling enhances state-space representations in noisy data.
Dynamical systems with large state-spaces are often expensive to thoroughly explore experimentally. Coarse-graining methods aim to define simpler systems which are more amenable to analysis and exploration; most current methods, however, focus on a priori state aggregation based on similarities in transition rates, whi…
The paper develops a state-space approach to deep Gaussian processes for efficient state estimation.
problem Efficient regression and state estimation for deep Gaussian processes.
method Hierarchical transformed Gaussian process priors, state-space representation, linear stochastic differential equations, sequential methods.
result The state-space approach enables efficient state estimation and regression for deep Gaussian processes.
A new method learns complex dynamical systems from data efficiently.
problem Learning complex dynamical systems from large-scale data efficiently.
method Low-rank structured variational autoencoding framework for nonlinear Gaussian state-space models.
result Consistently demonstrates better predictive capabilities compared to other models.
State-space models improve dynamical system predictions efficiently and accurately.
problem Challenges in predicting dynamical systems, including long-time integration and long-range dependencies.
method State-space models implemented in Mamba, addressing limitations of existing architectures.
result Mamba outperforms other models in interpolation and challenging extrapolation tasks.
Deep SSMs use neural networks to identify complex systems.
problem Identifying nonlinear systems with high uncertainty.
method Deep state space models with neural networks.
result Deep SSMs outperform traditional methods on benchmarks.
Unified deep sequential and state-space models for robust option pricing with uncertainty.
problem Combining robustness to noise and uncertainty measurement in option pricing models.
method Unscattered reservoir smoother (URS) integrating deep sequential and state-space models.
result URS achieves competitive forecasting accuracy and uncertainty measurement in noisy datasets.
Improves state space models' resistance to noise.
problem State space models' initialization assumes noise-free data, which is often violated.
method Uncertainty-aware initialization for state space models, reformulating HiPPO with measurement noise.
result Improves model resistance to noise at training and inference time.
Active learning selects inputs for GPSSM to learn latent states.
problem Optimally learn latent states of a GPSSM through active selection of inputs.
method Use mutual information to select informative inputs; approximate mutual information for GPSSM.
result Effective active learning of GPSSM dynamics in physical systems.
New approach to concentration inequalities for unbounded state space dynamical systems.
problem Concentration inequalities for unbounded state space dynamical systems.
method Functional analytic framework, transport-entropy inequality.
result Exponential concentration inequalities for sampling from stationary distribution.
Bayesian model learns multiscale interactions in complex systems.
problem Understanding dynamic interplay between processes at different time scales.
method Bayesian learning framework with Particle Gibbs with Ancestor Sampling (PGAS) algorithm.
result Demonstrated the effectiveness of the proposed approach through simulations.
New method for efficient probabilistic deep state-space models.
problem Efficient inference for probabilistic deep state-space models.
method Deterministic inference algorithm for ProDSSM with neural network weights.
result Superior balance between predictive performance and computational budget.
This paper reviews deep learning methods for state space models.
problem Analyzing temporal dynamics in dynamical systems.
method Selective review of deep neural network approaches for state space models.
result Unified perspective on discrete and continuous time SSMs.
PAC-Bayesian bounds for stochastic LTI systems derived.
problem Error bounds for stochastic LTI systems.
method PAC-Bayesian theory applied to autonomous stochastic LTI models.
result Error bounds for stochastic LTI systems derived.
New RL policy for unbounded state space with stability guarantee.
problem Traditional RL methods fail for unbounded state space.
method Proposes stability as performance metric, uses Sparse-Sampling-based Monte Carlo Oracle.
result Proposed policy ensures state dynamics remain bounded with high probability.
Neural Physicist learns physical dynamics from images.
problem Learning meaningful physical state representations and accurate state transitions from image sequences.
method Neural Physicist uses VAE for state extraction, NP for parameters, and SSM for dynamics.
result Achieves long-term predictions and identifies system degrees of freedom.
Paper derives an error bound for stochastic LTI systems.
problem Stochastic LTI systems with inputs in control engineering and econometrics.
method PAC-Bayesian-Like error bound derivation.
result Derived an error bound for stochastic LTI systems.
ETGPSSM efficiently models high-dimensional, non-stationary systems with reduced complexity.
problem Prohibitive computational and parametric complexity in high-dimensional, non-stationary dynamical systems.
method ETGPSSM integrates a single shared GP with input-dependent normalizing flows for scalable and flexible modeling.
result ETGPSSM outperforms existing models in computational efficiency and accuracy.
A new active learning method for Gaussian process models.
problem Efficiently exploring unbounded state spaces for accurate models.
method Maximizes mutual information with respect to a bounded region using model predictive control.
result Our method yields a better model within the region of interest than entropy-based methods.
HiPPO-Prophecy models can learn dynamical systems without fine-tuning.
problem Learning dynamical systems in context without fine-tuning parameters.
method Introduced a novel weight construction for SSMs that approximates derivatives of input signals.
result Discrete SSMs can predict the next state of any dynamical system after observing previous states.
Unified treatment of RC in stochastic and deterministic settings.
problem Understanding and generalizing reservoir computing in both deterministic and stochastic contexts.
method Investigation of state-space systems, analysis of fading memory and solution stability, introduction of stochastic echo states.
result Generality of fading memory and solution stability in state-space systems, even without the echo state property.
New model preserves symmetry in multivariate time series, improving performance.
problem Implicit ordering in MTS models violates inherent exchangeability.
method Permutation-equivariant 2D state space model with canonical architecture.
result Eliminates sequential dependency chains and simplifies stability analysis.
Paper uses variational inference to estimate nonlinear models.
problem Parameter estimation for nonlinear state-space models.
method Variational inference approach for nonlinear state-space models.
result The method provides robust parameter estimates and outperforms alternatives.
Gaussian process state-space models (GP-SSMs) are a very flexible family of models of nonlinear dynamical systems. They comprise a Bayesian nonparametric representation of the dynamics of the system and additional (hyper-)parameters governing the properties of this nonparametric representation. The Bayesian formalism e…
Introduces R-SSM for modeling multi-object dynamics with GNNs and normalizing flows.
problem Complex interactions and evolutions in multi-object systems are hard to model.
method Relational state-space model (R-SSM) using graph neural networks (GNNs) and normalizing flows.
result Empirically validated on synthetic and real datasets.
Robust state-space radio interferometric imaging using Stochastic Approximation Expectation Maximization
problem Improving state-space radio interferometric imaging in the presence of heavy-tailed noise
method Stochastic Approximation Expectation Maximization
result Significant improvement in reconstruction fidelity and robustness to radio-frequency interference
State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system identification) in nonlinear nonparametric state-space models. We place a Gauss…
dynestyx: A library for probabilistic programming of dynamical systems
problem integrating state-space models into probabilistic programming languages
method a unified interface for specifying priors and performing inference
result principled uncertainty quantification for state and parameters
Combines deep state space models with diffusion models for better forecasting and capturing latent dynamics
problem Forecasting and capturing latent dynamics in time series
method DDSSM: Diffusion-driven state space model
result Empirically outperforms state-of-the-art deep SSM
New IRL algorithm for continuous state spaces with formal guarantees.
problem Finding a reward function for expert behavior in continuous state spaces.
method Modeling the system using orthonormal functions and providing correctness proofs.
result Proof of correctness and formal guarantees on sample and time complexity.
Adversarial attacks on probabilistic state-space models affect latent state and policy decisions.
problem Robust reinforcement learning under adversarial observability.
method Analyzing adversarial attacks on linear probabilistic state-space models.
result Demonstrating the influence of adversarial observations on latent state and policy decisions.
Federated framework learns causal states to predict counterfactuals without centralizing data.
problem Decentralized counterfactual reasoning in coupled industrial systems with private data.
method Federated causal representation learning in state-space systems.
result Proves convergence to centralized oracle and provides privacy guarantees.
State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse Gaussian processes. The result of learning is a tractable posterior over nonlinear dy…
This paper introduces a new specialized algorithm for equilibrium Monte Carlo sampling of binary-valued systems, which allows for large moves in the state space. This is achieved by constructing self-avoiding walks (SAWs) in the state space. As a consequence, many bits are flipped in a single MCMC step. We name the alg…
Paper develops efficient recursive learning for multi-channel systems with heterogeneous dynamics.
problem Accurately learning system dynamics in complex, multi-channel systems with nonlinear and noisy data.
method Formulates system as Gaussian process state-space models (GPSSMs), introduces heterogeneous multi-output kernel, and develops recursive inference framework.
result Matches SOTA offline GPSSMs in accuracy with 1/100 runtime, and outperforms SOTA online GPSSMs by 70% in accuracy under noise with 1/20 runtime.
Develops state-space deep Gaussian processes for irregular signals.
problem Solving deep Gaussian process regression problems for irregular signals/functions.
method Represent DGPs as SDEs, solve using state-space filtering and smoothing methods.
result Rich class of priors compatible with irregular signals/functions.
Bayesian filtering approach identifies nonlinear restoring forces in dynamic systems.
problem Identification of nonlinear dynamic systems in engineering.
method Modeling the nonlinear restoring force as a Gaussian process, converting it to a state-space model, and inferring internal states and the nonlinear restoring force through filtering and smoothing.
result The approach effectively identifies nonlinear restoring forces in both simulated and experimental datasets.
Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is formed by projecting the problem onto a set of approximate eigenfunctions derived…
We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic contribution is a novel approximate posterior that can be calculated efficientl…
Bayesian approach for learning spatiotemporal systems from noisy data.
problem Efficiently modeling and learning from spatiotemporal dynamical systems with noisy data.
method Hierarchical state-space models with Gaussian process regression for efficient interpolation and training.
result Efficient modeling and learning of spatiotemporal dynamics using Bayesian methods.
Predictability enables efficient parallelization of nonlinear models.
problem Understanding which nonlinear state space models can be efficiently parallelized.
method Established a relationship between system dynamics and optimization problem conditioning, quantified by the largest Lyapunov exponent.
result Predictable systems can be evaluated in O((logT)2) time, improving over conventional sequential approaches. IBPF algorithm tackles high-dimensional parameter learning for complex systems.
problem Learning high-dimensional parameters in complex, partially observed, and nonlinear systems.
method Iterated Block Particle Filter (IBPF) for graphical state space models.
result IBPF algorithm consistently beats the curse of dimensionality across various experiments.
This paper examines foreign exchange risk premia from simple univariate regressions to the state-space method. The adjusted traditional regressions properly figure out the existence and time-evolving property of the risk premia. Successively, the state-space estimations overall are quite rationally competent in examini…
Methods from learning theory are used in the state space of linear dynamical and control systems in order to estimate the system matrices. An application to stabilization via algebraic Riccati equations is included. The approach is illustrated via a series of numerical examples.
New methods for skill rating in sports using state-space models.
problem Improving skill rating in competitive sports.
method State-space models, sequential Monte Carlo, discrete hidden Markov models.
result Advantages of state-space models for time-varying player skills.
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
problem 6-DoF localisation and dense 3D reconstruction in spatial environments.
method Approximate Bayesian inference in a deep state-space model combining learning and domain knowledge.
result Near state-of-the-art performance on UAV flight data.