Empirical mode modeling improves state-space analysis of noisy data.
problem Analyzing nonlinear systems with noisy data.
method Combining empirical mode decomposition with empirical dynamic modeling.
result Empirical mode modeling enhances state-space representations in noisy data.
A new framework for time series analysis using state-space learning.
problem Ineffectiveness of traditional Kalman filtering in handling big data and multiple explanatory variables.
method State Space Learning (SSL) framework using statistical learning for high-dimensional regression.
result SSL outperforms traditional methods in subset selection and forecasting accuracy.
Structured state space models improve ECG classification and reveal new insights.
problem Improving ECG analysis through deep learning.
method Applying structured state space models to capture long-term dependencies in ECG data.
result SSMs lead to significant improvements in ECG classification over current state-of-the-art.
Improves state space models' resistance to noise.
problem State space models' initialization assumes noise-free data, which is often violated.
method Uncertainty-aware initialization for state space models, reformulating HiPPO with measurement noise.
result Improves model resistance to noise at training and inference time.
Study improves ECG analysis accuracy using state space models, self-supervised learning, and patient metadata.
problem Improving quantitative accuracy of ECG analysis using deep learning.
method Explored state space models, self-supervised learning, and patient metadata integration.
result Improved ECG analysis accuracy through these components, no significant advantage from higher sampling rates or longer input sizes.
This study uses persistent homology to analyze complex transitional networks from time series data.
problem Lack of effective tools to summarize complex topology in transitional networks.
method Persistent homology from topological data analysis applied to coarse-grained state-space networks (CGSSN).
result CGSSN improves dynamic state detection and noise robustness compared to other methods.
This paper reviews deep learning methods for state space models.
problem Analyzing temporal dynamics in dynamical systems.
method Selective review of deep neural network approaches for state space models.
result Unified perspective on discrete and continuous time SSMs.
Dynamical systems with large state-spaces are often expensive to thoroughly explore experimentally. Coarse-graining methods aim to define simpler systems which are more amenable to analysis and exploration; most current methods, however, focus on a priori state aggregation based on similarities in transition rates, whi…
A new method for state estimation in state-space models using incomplete data.
problem State estimation in nonlinear state-space models with incomplete observations.
method Statistical analysis of incomplete observations, score function, observed information matrices, EM-gradient-particle filtering.
result Maximum likelihood estimation of state-vector with explicit form of observed information matrix.
New model preserves symmetry in multivariate time series, improving performance.
problem Implicit ordering in MTS models violates inherent exchangeability.
method Permutation-equivariant 2D state space model with canonical architecture.
result Eliminates sequential dependency chains and simplifies stability analysis.
Stanza models complex time series with balance between traditional and deep learning approaches.
problem Capturing long-term structure in non-stationary time series.
method Nonlinear, non-stationary state space model.
result Achieves forecasting accuracy competitive with deep LSTMs, especially for multi-step ahead forecasting.
Implements SSSD for missing value imputation and forecasting in time series data.
problem Missing values in time series data.
method Structured state space models combined with conditional diffusion models.
result SSSD outperforms state-of-the-art methods on various data sets and missingness scenarios.
Lyapunov's second theorem is an essential tool for stability analysis of differential equations. The paper provides an analog theorem for incremental stability analysis by lifting the Lyapunov function to the tangent bundle. The Lyapunov function endows the state-space with a Finsler structure. Incremental stability is…
Witt algebra acts on Khovanov-Rozansky homology of links.
problem Understanding algebraic structures in knot theory.
method Construction of Witt algebra action on Khovanov-Rozansky homology.
result Induced maps between twists of the homology via link cobordisms.
New method for inferring Markov chains from large state spaces, applied to epidemic models.
problem Challenging to compute matrix exponentials and derivatives for large state spaces.
method Differentiated uniformization method for continuous-time Markov chains.
result Estimation of infection and recovery rates during the first wave of COVID-19 in Austria.
Parameterized state space models in the form of recurrent networks are often used in machine learning to learn from data streams exhibiting temporal dependencies. To break the black box nature of such models it is important to understand the dynamical features of the input driving time series that are formed in the sta…
New approach to concentration inequalities for unbounded state space dynamical systems.
problem Concentration inequalities for unbounded state space dynamical systems.
method Functional analytic framework, transport-entropy inequality.
result Exponential concentration inequalities for sampling from stationary distribution.
State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent advances use a broader range of optimization formulations to allow outlier-robust e…
A new model detects anomalies in time series data efficiently.
problem Detect anomalies in high-dimensional time series data.
method r-ssGPFA, an unsupervised online anomaly detection model using state space Gaussian processes.
result The model detects anomalies efficiently and is computationally cheaper.
New optimizer G-AdaGrad improves upon AdaGrad for non-convex machine learning problems.
problem Solving non-convex machine learning problems efficiently.
method Proposes a new optimizer G-AdaGrad and analyzes its convergence using state-space models.
result Empirical results show G-AdaGrad performs better than AdaGrad and Adam.
Time series analysis is a key component of machine learning, with applications in various fields.
problem Time series analysis in machine learning
method Basic concepts, classical statistical models, modern machine learning approaches
result Machine learning techniques for time series analysis
We consider differentially private algorithms for reinforcement learning in continuous spaces, such that neighboring reward functions are indistinguishable. This protects the reward information from being exploited by methods such as inverse reinforcement learning. Existing studies that guarantee differential privacy a…
Study improves prediction of commodity futures using multi-factor model.
problem Improving accuracy in predicting commodity futures prices.
method State-space functional regression model incorporating yield curve dynamics.
result Functional regression model outperforms Schwartz-Smith model in estimating short-end of futures curve.
SMEs provide a transparent testbed for RL evaluation.
problem Lack of precise, white-box diagnostics in RL environments.
method Synthetic Monitoring Environments (SMEs) with fully configurable task characteristics and known optimal policies.
result SMEs allow for precise evaluation of RL algorithms, revealing the impact of specific environmental properties.
Diagnosing an inherited disease often requires identifying the pattern of inheritance in a patient's family. We represent family trees with genetic patterns of inheritance using hypergraphs and latent state space models to provide explainable inheritance pattern predictions. Our approach allows for exact causal inferen…
Study uses time series analysis to predict player churn and conversion in games.
problem Predicting player churn and conversion in free-to-play games.
method State Space time series approach with Autoregressive Integrated Moving Average and Unobserved Components models.
result Unobserved Components approach fails to detect marketing campaigns and predicts abandonment poorly.
Model predicts Chinese stock market liquidity and customer order behavior.
problem Understanding market liquidity and customer order behavior in the Chinese stock market.
method Dual state-space model using Fourier transform to connect volume-at-price buckets to correlations.
result Customer orders are correlated with market sentiment and stock returns, not with bond returns.
The paper develops a state-space approach to deep Gaussian processes for efficient state estimation.
problem Efficient regression and state estimation for deep Gaussian processes.
method Hierarchical transformed Gaussian process priors, state-space representation, linear stochastic differential equations, sequential methods.
result The state-space approach enables efficient state estimation and regression for deep Gaussian processes.
A new model explains relative spreads between economies using dynamic Nelson-Siegel and functional regression.
problem Analyzing and predicting relative spreads between economies in fixed income markets.
method State-space functional regression model incorporating dynamic Nelson-Siegel model and kernel PCA.
result The new model outperforms the dynamic Nelson-Siegel model in explaining relative spreads.
Local PCA detects intrinsic parameterization of complex thermo-chemical state-spaces.
problem Detecting intrinsic parameterization of complex thermo-chemical state-spaces.
method Local PCA applied to local clusters of data.
result Local PCA finds meaningful parameterization linked to local stoichiometry, reaction progress, and soot formation processes.
State spaces of multifactor approximations of nonnegative Volterra processes are linear transformations of the nonnegative orthant.
problem Characterizing state spaces of multifactor approximations of nonnegative Volterra processes.
method Explicit linear transformation of the nonnegative orthant.
result State spaces of multifactor approximations of nonnegative Volterra processes are given by explicit linear transformation of the nonnegative orthant.
Mamba Hawkes Process improves modeling of event sequences with long-term dependencies.
problem Modeling mutual inhibition and nonlinearity in asynchronous event sequences.
method Introduces Mamba Hawkes Process using Mamba state space architecture.
result MHP outperforms existing models across various datasets.
Mamba struggles with long context lengths, but spectrum scaling improves performance.
problem Mamba's performance degrades with increasing context length.
method Spectrum scaling applied to pre-trained Mamba models to improve long-context generalization.
result Spectrum scaling significantly improves performance in long-context settings.
Algorithm learns diffusion processes with high-dimensional state spaces.
problem Stochastic control of unbounded diffusion processes with high-dimensional state spaces.
method Adaptive partitioning and learning algorithm that refines discretization based on estimation bias and statistical confidence.
result Established regret bounds that depend on problem parameters, extending to unbounded diffusion processes.
Divides state space into regions with identical term structure shapes.
problem Classifying term structure shapes in the two-factor Vasicek model.
method Using envelopes and winding numbers to divide and classify the state space.
result Nearly complete classification of parameter space regarding term structure shapes.
Deep learning enhances active inference for dynamic state spaces.
problem Limited applicability of active inference to continuous state spaces.
method Use of deep learning to approximate probability distributions for active inference.
result Active inference can be applied to continuous state spaces.
Predicts cryptocurrency prices with deep state-space model.
problem Predicting day-ahead crypto-currency prices.
method Proposes a deep state-space model combining state-space formulation and deep neural networks.
result The deep state-space model outperforms state-of-the-art and classical methods in accuracy.
We are interested in understanding stability (almost sure boundedness) of stochastic approximation algorithms (SAs) driven by a `controlled Markov' process. Analyzing this class of algorithms is important, since many reinforcement learning (RL) algorithms can be cast as SAs driven by a `controlled Markov' process. In t…
We introduce a concept of autoregressive (AR)state-space realization that could be applied to all transfer functions T(L) with T(0) invertible. We show that a theorem of Kalman implies each Vector Autoregressive model (with exogenous variables) has a minimal AR-state-space realization …
We provide a comprehensive overview and tooling for GP modeling with non-Gaussian likelihoods using state space methods. The state space formulation allows for solving one-dimensional GP models in O(n) time and memory complexity. While existing literature has focused on the connection between GP regression …
Foams have Lie algebra symmetries that simplify web state spaces.
problem Understanding symmetries in foam structures.
method Defined an action of a Lie subalgebra on foams compatible with glN-foam evaluation. result Endows glN-web state spaces with sl2-action. The paper analyzes variational autoencoders for state space models with risk bounds.
problem Analyzing the risk associated with variational autoencoders for state space models.
method Backward factorization of variational distributions to analyze excess risk, providing oracle inequalities and upper bounds.
result Explicit upper bounds on variational estimation error for state space models under strong mixing assumptions.
Enhances time-series regression trees with latent factors for robust financial analysis.
problem Handling predictors with measurement error, trends, seasonality, and missing data.
method Integrates latent stationary factors extracted via state-space methods into time-series regression trees.
result Factor-augmented trees provide a reliable approach for macro-finance problems, exemplified by the lead-lag effect between equity volatility and the business cycle.
A new method for analyzing high-dimensional time-series data using deep neural networks.
problem Challenges in modeling high-dimensional time-series data with explicit state and observation processes.
method Deep Direct Discriminative Decoders (D4) for high-dimensional observation processes.
result D4 outperforms traditional SSMs and RNNs in various time-series data applications.
In this study, we analyzed the activity of monkey V1 neurons responding to grating stimuli of different orientations using inference methods for a time-dependent Ising model. The method provides optimal estimation of time-dependent neural interactions with credible intervals according to the sequential Bayes estimation…
A formula for the Riemannian metric tensor of differentiable manifolds of linear dynamical systems of same McMillan degree is presented in terms of their transfer function matrices. The necessary calculations for its application to ARMA and state space overlapping parametrizations are drafted. The importance of this ap…
A new method learns state and proposal dynamics in state-space models using neural networks.
problem Inference in non-linear state-space models.
method StateMixNN method using neural networks for proposal and transition distributions.
result Significantly improved recovery of hidden state, especially in highly non-linear scenarios.
Framework models multiscale dynamics with Bayesian learning for regime changes.
problem Analyzing complex interactions between fast and slow processes.
method Hierarchical state-space modeling with Sequential Monte Carlo.
result Bayesian approach accurately tracks state transitions and identifies switching dynamics.