Improved state estimation in nonlinear models using amortized backward variational inference.
problem State estimation in general state-space models.
method Amortized backward variational inference with neural network parameters.
result Linear growth of variational approximation error in number of observations.
The paper analyzes variational autoencoders for state space models with risk bounds.
problem Analyzing the risk associated with variational autoencoders for state space models.
method Backward factorization of variational distributions to analyze excess risk, providing oracle inequalities and upper bounds.
result Explicit upper bounds on variational estimation error for state space models under strong mixing assumptions.
Online method for state estimation and parameter learning in SSMs.
problem State estimation and parameter learning in state-space models.
method Stochastic gradient optimization of variational lower bound, using backward decompositions and Bellman recursions.
result Ability to operate online without revisiting historic observations.
Bayesian state and parameter estimation for nonlinear models using variational methods.
problem Estimating states and parameters for nonlinear state-space models.
method Variational approach to approximate the intractable Bayesian distribution, resulting in an optimisation problem.
result The proposed method efficiently computes Bayesian estimates for nonlinear models, outperforming Hamiltonian Monte Carlo in numerical examples.
Efficiently estimates online variational learning using importance sampling.
problem Online variational estimation in state-space models.
method Variational approach with Monte Carlo importance sampling.
result Proposed efficient algorithm for streaming data.
We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle …
New method uses adiabatic principles to improve ground-state preparation in quantum computing.
problem Challenges in variational training of complex energy landscapes.
method Iterative Hamiltonian deformation complemented with adiabatic principles.
result Consistent convergence to target ground state through sequence of intermediate problems.
State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse Gaussian processes. The result of learning is a tractable posterior over nonlinear dy…
Combines variational and evolutionary optimization for generative models.
problem Optimizing generative models with discrete latent variables.
method Truncated posteriors as variational distributions, evolutionary algorithms applied to variational parameters.
result Evolutionary algorithms effectively optimize variational bounds for generative models.
A new variational method for SSMs improves inference efficiency.
problem Hard variational inference for state space models.
method Proposes variational marginal particle filter (VMPF) based on Rao-Blackwellization.
result VMPF provides tighter variational bounds and sometimes benefits from unbiased reparameterization.
Paper uses variational inference to estimate nonlinear models.
problem Parameter estimation for nonlinear state-space models.
method Variational inference approach for nonlinear state-space models.
result The method provides robust parameter estimates and outperforms alternatives.
VSE estimates complex processes from noisy measurements without a model.
problem Estimating states of complex, model-free processes from noisy data.
method Variational state estimation using recurrent neural networks (RNNs) in both learning and inference phases.
result VSE provides a competitive state estimate for a benchmark process (Lorenz system) compared to known and data-driven methods.
A new method learns complex dynamical systems from data efficiently.
problem Learning complex dynamical systems from large-scale data efficiently.
method Low-rank structured variational autoencoding framework for nonlinear Gaussian state-space models.
result Consistently demonstrates better predictive capabilities compared to other models.
This paper models time-series data with a mixture of Markov chains, automatically determining the number of components.
problem Tackles the inability of common Markov state modeling frameworks to discern heterogeneities in complex data.
method Uses a mixture of Markov chains and variational expectation-maximization algorithm for automatic component selection.
result Achieves performance consistent with theoretically optimal error scaling, identifying meaningful heterogeneities in various data sets.
Paper addresses state estimation in sensor networks with intermittent data.
problem State estimation in sensor networks with packet dropouts and corrupted observations.
method Bayesian variational inference with a dual-mask generative model.
result The method effectively identifies system states and noise parameters.
Noise-resilient optimization on noisy quantum computers.
problem Noise's impact on hybrid quantum-classical optimization.
method Iterative quantum circuit with noise consideration, using Quantum Fisher Information bound.
result Algorithm robustness against different noise strengths.
New method for efficient Bayesian inference in GPSSMs.
problem Challenges in inference for Gaussian process state-space models.
method Free-form variational inference with stochastic gradient Hamiltonian Monte Carlo.
result Our method learns transition dynamics and latent states more accurately than competing methods.
Recent advances in the estimation of deep directed graphical models and recurrent networks let us contribute to the removal of a blind spot in the area of probabilistc modelling of time series. The proposed methods i) can infer distributed latent state-space trajectories with nonlinear transitions, ii) scale to large d…
Improves Gaussian process models for large datasets.
problem Complexity and memory limitations in Gaussian process models.
method Combines variational sparse approximation and state-space formulation.
result Significant computational and memory savings for large datasets.
A new method for online VI in SSMs using asymptotic contrast.
problem Lack of functionality for streaming data in standard VI methods for SSMs.
method Propose maximising an IWAE-type variational lower bound on the asymptotic contrast function using stochastic approximation.
result OSIWAE allows for online learning of model parameters and latent states.
Quantum annealing improves VB inference, avoiding local minima.
problem Variational Bayes inference stuck in local minima.
method Quantum annealing approach to VB inference.
result Quantum annealing variational Bayes (QAVB) outperforms classical VB.
New method for efficient online variational estimation in streaming data.
problem Efficiently estimating parameters and latent states in online parametric models.
method i.i.d. Monte Carlo sampling coupled with deep architecture.
result The method computes the evidence lower bound and its gradient efficiently.
This paper learns variational models and solvers for inverse problems from incomplete data.
problem Solving inverse problems with partially observed data.
method Joint learning of variational cost and gradient-based solver as neural networks.
result Joint learning leads to improved reconstruction performance.
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
problem 6-DoF localisation and dense 3D reconstruction in spatial environments.
method Approximate Bayesian inference in a deep state-space model combining learning and domain knowledge.
result Near state-of-the-art performance on UAV flight data.
New method speeds up Gaussian process inference for large datasets.
problem Numerical instability and inefficiency in approximate inference methods for non-Gaussian likelihoods.
method Conjugate-computation variational inference with Kalman recursions.
result Linear-time inference with fast and stable variational inference for state-space GP models.
Deep QMC method accurately computes electronic excited states.
problem Accurate calculation of electronic excited states in large systems.
method Extends variational QMC with deep neural networks for excited states.
result Consistently achieves high accuracy for low-lying excited states.
We present a scalable approach to performing approximate fully Bayesian inference in generic state space models. The proposed method is an alternative to particle MCMC that provides fully Bayesian inference of both the dynamic latent states and the static parameters of the model. We build up on recent advances in compu…
Paper develops a new state estimation method for nonlinear systems.
problem State estimation for nonlinear state-space models is intractable.
method Developed a variational inference approach based on Gaussian approximations.
result The method outperforms alternative Gaussian approaches in various examples.
New variational inference approach using Hilbert space for robotic state estimation.
problem Robotic state estimation with high-dimensional data.
method Variational inference reformulated in a Bayesian Hilbert space, using iterative projection.
result Variational inference can be seen as iterative projection in Euclidean space.
Online VSMC efficiently learns SSM parameters in streaming data.
problem Parameter learning and latent state inference in state-space models.
method Combines particle methods and variational inference for online learning.
result Online VSMC achieves efficient, entirely on-the-fly parameter estimation and particle proposal adaptation.
New method calibrates predictions in chaotic systems using variational inference.
problem Uncertainty in data assimilation for chaotic systems.
method Variational inference applied to multivariate Gaussian distribution.
result Nearly perfectly calibrated predictions in chaotic Lorenz-96 dynamics.
Quantum state preparation framework speeds up basket option pricing.
problem Limited practical benefit of quantum amplitude estimation due to state-preparation depth.
method Structure-aware tensor-train rank-based variational state preparation.
result State-preparation depth scaling replaced with linear scaling, maintaining low basket-pricing errors.
This paper considers a new family of variational distributions motivated by Sklar's theorem. This family is based on new copula-like densities on the hypercube with non-uniform marginals which can be sampled efficiently, i.e. with a complexity linear in the dimension of state space. Then, the proposed variational densi…
Improved variational inference for logistic regression and classification.
problem Intractability of Evidence Lower Bound in variational logistic regression.
method Introducing a new bound for the expectation of softplus function, applied to variational logistic regression and Gaussian process classification.
result The new bound results in a tighter posterior and faster computation compared to Monte-Carlo methods.
Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which implies that the joint distribution given the ODE's and GP kernels is also Gaussian di…
Studying general quantum many-body systems is one of the major challenges in modern physics because it requires an amount of computational resources that scales exponentially with the size of the system.Simulating the evolution of a state, or even storing its description, rapidly becomes intractable for exact classical…
A new method uses compressive autoencoders for image restoration.
problem Efficient regularization of inverse problems in computational imaging.
method Variational Bayes Latent Estimation (VBLE) with compressive autoencoders.
result VBLE achieves similar performance to state-of-the-art PnP methods but faster.
VLBM learns MDP transitions from limited data, improving OPE performance.
problem Limited coverage of state and action space in offline trajectories.
method VLBM uses variational inference with RSA and branching architecture.
result VLBM outperforms existing OPE methods on deep OPE benchmark.
Method learns topological states from randomized measurements.
problem Detecting topologically ordered two-dimensional states on quantum processors.
method Variational tensor network tomography with randomized measurements.
result Demonstrated ability to learn ground states of surface code and quantum spin liquid states.
We investigate the optimization of two probabilistic generative models with binary latent variables using a novel variational EM approach. The approach distinguishes itself from previous variational approaches by using latent states as variational parameters. Here we use efficient and general purpose sampling procedure…
ETGPSSM efficiently models high-dimensional, non-stationary systems with reduced complexity.
problem Prohibitive computational and parametric complexity in high-dimensional, non-stationary dynamical systems.
method ETGPSSM integrates a single shared GP with input-dependent normalizing flows for scalable and flexible modeling.
result ETGPSSM outperforms existing models in computational efficiency and accuracy.
Improved UIVI method shows better performance than state-of-the-art SIVI methods.
problem Estimating the likelihood of samples from complex distributions in high dimensions.
method Replaced the inner MCMC loop of UIVI with importance sampling and learned the optimal proposal distribution.
result The refined UIVI approach demonstrates superior performance or parity with state-of-the-art methods.
Extends ESGVI for UWB localization with skewed noise, improving state estimation accuracy.
problem Improving state estimation accuracy in UWB localization with skewed noise.
method Generalizes ESGVI to matrix Lie groups and introduces non-Gaussian factors.
result Improved accuracy in UWB localization with NLOS and multipath effects.
New GP model tackles physics constraints efficiently.
problem Lack of efficient, physics-informed models for complex systems.
method Physics-informed variational state-space Gaussian process.
result Efficient spatio-temporal modeling with improved performance.
Gaussian process classification is a popular method with a number of appealing properties. We show how to scale the model within a variational inducing point framework, outperforming the state of the art on benchmark datasets. Importantly, the variational formulation can be exploited to allow classification in problems…
Proposes an amortized variational framework for Deep Q Networks.
problem Efficient exploration in deep reinforcement learning.
method Amortized variational inference for action value function approximation.
result Significantly less learning parameters and better performance.
Parallelizes autoregressive generation using VSSM.
problem Autoregressive models' inability to parallelize generation.
method Variational SSM (VSSM) with parallelizable sampling and decoding.
result Parallel generation possible with VSSM.
Ideas from the image processing literature have recently motivated a new set of clustering algorithms that rely on the concept of total variation. While these algorithms perform well for bi-partitioning tasks, their recursive extensions yield unimpressive results for multiclass clustering tasks. This paper presents a g…