Predicts cryptocurrency prices with deep state-space model.
problem Predicting day-ahead crypto-currency prices.
method Proposes a deep state-space model combining state-space formulation and deep neural networks.
result The deep state-space model outperforms state-of-the-art and classical methods in accuracy.
The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the variational sparse approximation which relies on inducing points and 2) the state-space…
Cohort effects are important factors in determining the evolution of human mortality for certain countries. Extensions of dynamic mortality models with cohort features have been proposed in the literature to account for these factors under the generalised linear modelling framework. In this paper we approach the proble…
We provide a comprehensive overview and tooling for GP modeling with non-Gaussian likelihoods using state space methods. The state space formulation allows for solving one-dimensional GP models in O(n) time and memory complexity. While existing literature has focused on the connection between GP regression …
The paper develops a state-space approach to deep Gaussian processes for efficient state estimation.
problem Efficient regression and state estimation for deep Gaussian processes.
method Hierarchical transformed Gaussian process priors, state-space representation, linear stochastic differential equations, sequential methods.
result The state-space approach enables efficient state estimation and regression for deep Gaussian processes.
State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent advances use a broader range of optimization formulations to allow outlier-robust e…
New method for efficient probabilistic deep state-space models.
problem Efficient inference for probabilistic deep state-space models.
method Deterministic inference algorithm for ProDSSM with neural network weights.
result Superior balance between predictive performance and computational budget.
State-space systems generate probabilistic dependencies between inputs and outputs.
problem Understanding probabilistic dependencies in state-space systems.
method Introducing a probabilistic framework and proving sufficient conditions for output existence and uniqueness.
result State-space systems can generate probabilistic dependencies, even without functional relations.
We propose a parallelizable sparse inverse formulation Gaussian process (SpInGP) for temporal models. It uses a sparse precision GP formulation and sparse matrix routines to speed up the computations. Due to the state-space formulation used in the algorithm, the time complexity of the basic SpInGP is linear, and becaus…
We consider the problem of learning low-dimensional representations for large-scale Markov chains. We formulate the task of representation learning as that of mapping the state space of the model to a low-dimensional state space, called the kernel space. The kernel space contains a set of meta states which are desired …
Online Passive-Aggressive (PA) learning is a class of online margin-based algorithms suitable for a wide range of real-time prediction tasks, including classification and regression. PA algorithms are formulated in terms of deterministic point-estimation problems governed by a set of user-defined hyperparameters: the a…
State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system identification) in nonlinear nonparametric state-space models. We place a Gauss…
New model preserves symmetry in multivariate time series, improving performance.
problem Implicit ordering in MTS models violates inherent exchangeability.
method Permutation-equivariant 2D state space model with canonical architecture.
result Eliminates sequential dependency chains and simplifies stability analysis.
MOCK learns complex systems from trajectories efficiently.
problem Learning nonparametric differential equations from high-dimensional data.
method MOCK uses multivariate occupation kernel functions to learn vector fields linearly.
result MOCK outperforms other methods on various datasets.
New method for state inference in state-space models with unknown dynamics.
problem State inference in state-space models with computationally expensive and undefined dynamics.
method Estimate state transition dynamics using a multi-output Gaussian process and Bayesian Neural Network as a surrogate model.
result Significant improvement in accuracy for state inference and prediction in non-stationary user models.
A new model detects anomalies in time series data efficiently.
problem Detect anomalies in high-dimensional time series data.
method r-ssGPFA, an unsupervised online anomaly detection model using state space Gaussian processes.
result The model detects anomalies efficiently and is computationally cheaper.
A new framework for time series analysis using state-space learning.
problem Ineffectiveness of traditional Kalman filtering in handling big data and multiple explanatory variables.
method State Space Learning (SSL) framework using statistical learning for high-dimensional regression.
result SSL outperforms traditional methods in subset selection and forecasting accuracy.
We consider deterministic Markov decision processes (MDPs) and apply max-plus algebra tools to approximate the value iteration algorithm by a smaller-dimensional iteration based on a representation on dictionaries of value functions. The setup naturally leads to novel theoretical results which are simply formulated due…
A new method for state space partitioning in block particle filtering reduces bias and variance.
problem Overcoming the curse of dimensionality in non-linear, non-Gaussian state space estimation.
method Formulates state space partitioning as a clustering problem and uses spectral clustering with constraints.
result The proposed method effectively groups correlated state variables into smaller blocks, reducing bias and variance.
New method speeds up Gaussian process inference for large datasets.
problem Numerical instability and inefficiency in approximate inference methods for non-Gaussian likelihoods.
method Conjugate-computation variational inference with Kalman recursions.
result Linear-time inference with fast and stable variational inference for state-space GP models.
Geometric approach to quantum thermodynamics models state spaces and processes.
problem Quantum thermodynamics in the regime of non-equilibrium states.
method Contact geometry and principal fiber bundles to model quantum state spaces and processes.
result Geometric formulation reveals the fundamental thermodynamic relations and unattainability of the third law.
Develops a learning model predictive controller for competitive racing.
problem Lack of exploration in state space and complexity in obstacle avoidance.
method Explores state space through multiple initializations and develops a new method for convex terminal set selection.
result Yields a richer terminal safe set and maintains convexity.
Improved Gaussian process inference for spatio-temporal data.
problem Cubic computational costs in Gaussian process inference, especially in spatio-temporal settings.
method Proposes the Vanilla-SPDE Exchange, leveraging an equivalence between standard and SPDE formulations to achieve improved computational cost.
result Demonstrates improved computational efficiency through complexity analysis and numerical experiments.
The problem of combined state and input estimation of linear structural systems based on measured responses and a priori knowledge of structural model is considered. A novel methodology using Gaussian process latent force models is proposed to tackle the problem in a stochastic setting. Gaussian process latent force mo…
State-space models (SSMs) are a highly expressive model class for learning patterns in time series data and for system identification. Deterministic versions of SSMs (e.g. LSTMs) proved extremely successful in modeling complex time series data. Fully probabilistic SSMs, however, are often found hard to train, even for …
A planning approach learns skills from interactions, balancing exploration and exploitation.
problem Learning robust high-level skills in noisy environments with unknown pre-conditions.
method Formulates skills as high-level policies, learns plans via bandit problems, balances exploration and exploitation.
result A planner capable of learning robust high-level skills in high-dimensional state spaces.
A new method for analyzing high-dimensional time-series data using deep neural networks.
problem Challenges in modeling high-dimensional time-series data with explicit state and observation processes.
method Deep Direct Discriminative Decoders (D4) for high-dimensional observation processes.
result D4 outperforms traditional SSMs and RNNs in various time-series data applications.
We introduce a new formulation of the Hidden Parameter Markov Decision Process (HiP-MDP), a framework for modeling families of related tasks using low-dimensional latent embeddings. Our new framework correctly models the joint uncertainty in the latent parameters and the state space. We also replace the original Gaussi…
Study uses time series analysis to predict player churn and conversion in games.
problem Predicting player churn and conversion in free-to-play games.
method State Space time series approach with Autoregressive Integrated Moving Average and Unobserved Components models.
result Unobserved Components approach fails to detect marketing campaigns and predicts abandonment poorly.
Unified approach to Bayesian inference with guarantees on covariance matrices.
problem Approximate Bayesian inference with PSD guarantees.
method Bayes-Newton methods extending Newton's method for optimisation.
result Novel algorithms with PSD covariance matrices.
Paper develops efficient recursive learning for multi-channel systems with heterogeneous dynamics.
problem Accurately learning system dynamics in complex, multi-channel systems with nonlinear and noisy data.
method Formulates system as Gaussian process state-space models (GPSSMs), introduces heterogeneous multi-output kernel, and develops recursive inference framework.
result Matches SOTA offline GPSSMs in accuracy with 1/100 runtime, and outperforms SOTA online GPSSMs by 70% in accuracy under noise with 1/20 runtime.
AUCRSS detects change points in partially observed multivariate autocorrelated data.
problem Detecting change points in multivariate autocorrelated data with limited sensing resources.
method Adaptive Upper Confidence Region (AUCRSS) with state space model (SSM), adaptive sampling policy, and generalized likelihood ratio test.
result The method outperforms existing approaches in detecting change points efficiently.
A typical audio signal processing pipeline includes multiple disjoint analysis stages, including calculation of a time-frequency representation followed by spectrogram-based feature analysis. We show how time-frequency analysis and nonnegative matrix factorisation can be jointly formulated as a spectral mixture Gaussia…
We are interested in understanding stability (almost sure boundedness) of stochastic approximation algorithms (SAs) driven by a `controlled Markov' process. Analyzing this class of algorithms is important, since many reinforcement learning (RL) algorithms can be cast as SAs driven by a `controlled Markov' process. In t…
The problem of existence of arbitrage free and monotone CDO term structure models is studied. Conditions for positivity and monotonicity of the corresponding Heath-Jarrow-Morton-Musiela equation for the x-forward rates with the use of the Milian type result are formulated. Two state spaces are taken into account - of…
Empirical mode modeling improves state-space analysis of noisy data.
problem Analyzing nonlinear systems with noisy data.
method Combining empirical mode decomposition with empirical dynamic modeling.
result Empirical mode modeling enhances state-space representations in noisy data.
Hybrid model improves sequential data prediction by combining neural and time series models.
problem Nonlinear prediction in online settings with domain-specific feature engineering issues.
method Joint optimization of LSTM for feature extraction and SARIMAX for time series data using state space representations.
result Significant improvements in real-life competition datasets.
Stochastic domains often involve risk-averse decision makers. While recent work has focused on how to model risk in Markov decision processes using risk measures, it has not addressed the problem of solving large risk-averse formulations. In this paper, we propose and analyze a new method for solving large risk-averse …
A new method for estimating adversarial strategies in nonlinear systems.
problem Inferring an intelligent adversarial agent's strategy in highly nonlinear systems.
method Formulated inverse cognition as a nonlinear Gaussian state-space model and developed an inverse UKF (IUKF) system.
result The estimation error of IUKF converges and closely follows the recursive Cramér-Rao lower bound.
Many modern commercial sites employ recommender systems to propose relevant content to users. While most systems are focused on maximizing the immediate gain (clicks, purchases or ratings), a better notion of success would be the lifetime value (LTV) of the user-system interaction. The LTV approach considers the future…
A new method reduces high-dimensional state space for dynamic choice models.
problem Estimation of dynamic discrete choice models is computationally intensive and infeasible in high-dimensional settings.
method Recursive partitioning algorithm to reduce dimensionality of high-dimensional state space.
result Our method reduces estimation bias and makes estimation feasible.
State spaces of multifactor approximations of nonnegative Volterra processes are linear transformations of the nonnegative orthant.
problem Characterizing state spaces of multifactor approximations of nonnegative Volterra processes.
method Explicit linear transformation of the nonnegative orthant.
result State spaces of multifactor approximations of nonnegative Volterra processes are given by explicit linear transformation of the nonnegative orthant.
Divides state space into regions with identical term structure shapes.
problem Classifying term structure shapes in the two-factor Vasicek model.
method Using envelopes and winding numbers to divide and classify the state space.
result Nearly complete classification of parameter space regarding term structure shapes.
Foams have Lie algebra symmetries that simplify web state spaces.
problem Understanding symmetries in foam structures.
method Defined an action of a Lie subalgebra on foams compatible with glN-foam evaluation. result Endows glN-web state spaces with sl2-action. The paper analyzes variational autoencoders for state space models with risk bounds.
problem Analyzing the risk associated with variational autoencoders for state space models.
method Backward factorization of variational distributions to analyze excess risk, providing oracle inequalities and upper bounds.
result Explicit upper bounds on variational estimation error for state space models under strong mixing assumptions.
The design of multiple experiments is commonly undertaken via suboptimal strategies, such as batch (open-loop) design that omits feedback or greedy (myopic) design that does not account for future effects. This paper introduces new strategies for the optimal design of sequential experiments. First, we rigorously formul…
New method uncovers small but significant local activities in time-series data.
problem Reconstructing small but important local activities in time-series data.
method Neural state-space models with latent causal-effect disentanglement.
result Demonstrated proof-of-concept on reconstructing ectopic foci in cardiac electrical propagation.
Proposes DAM for optimizing discrete generative models.
problem Challenges in optimizing discrete generative models.
method Discrete Adjoint Matching (DAM) for discrete state spaces.
result Demonstrates effectiveness on synthetic and mathematical reasoning tasks.