Paper presents a robust Kalman filter for state estimation.
problem Robust state estimation under process and measurement noise.
method Generalized Bayesian approach to a Weighted Observation Likelihood Filter (WoLF) framework.
result Achieved robust state estimation against both process and measurement noise.
Many nonlinear extensions of the Kalman filter, e.g., the extended and the unscented Kalman filter, reduce the state densities to Gaussian densities. This approximation gives sufficient results in many cases. However, this filters only estimate states that are correlated with the observation. Therefore, sequential esti…
Recursive KalmanNet combines neural networks with Kalman filters for precise state estimation.
problem State estimation in systems with noisy measurements and non-Gaussian noise.
method Recursive KalmanNet uses a recurrent neural network to estimate states with consistent error covariance, optimizing for Gaussian negative log-likelihood.
result Recursive KalmanNet outperforms conventional Kalman filters and deep learning-based estimators in non-Gaussian noise conditions.
This study improves state estimation for nonlinear systems using conditional normalizing flows.
problem Performance degradation of traditional filtering algorithms in nonlinear systems with non-Gaussian uncertainty.
method Uses conditional normalizing flows with MLP, transformer, or state-space models for state and parameter estimation.
result Optimal-transport-inspired kinetic loss mitigates overparameterization in flows.
The Kalman filter (KF) is used in a variety of applications for computing the posterior distribution of latent states in a state space model. The model requires a linear relationship between states and observations. Extensions to the Kalman filter have been proposed that incorporate linear approximations to nonlinear m…
A new particle filter avoids resampling to improve state estimation in high dimensions.
problem Particle deprivation in high-dimensional state spaces.
method A resampling-free particle filter designed to mitigate particle deprivation.
result The filter offers a near-accurate representation of the posterior distribution in high-dimensional contexts.
Novel method uses Bayesian filters and PCRLB for state estimation of option prices.
problem Estimating unobserved latent variables from option prices.
method Posterior Cramer-Rao Lower Bound (PCRLB) based adaptive state estimation using various Bayesian filters.
result Proposed method outperforms individual filters and improves forecasting.
Graph Kalman filters adapt classical filters to graph data.
problem Adapting classical Kalman filters to graph data.
method Generalizes Kalman filters to attributed graphs, learning state-transition and readout functions end-to-end.
result Adapted Kalman filters can predict graph outputs.
Latent FxLMS accelerates ANC by adapting along low-dimensional filter weights.
problem Improving active noise control with neural adaptive filters.
method Training an auto-encoder on filter coefficients, constraining weights to latent variables, and updating in latent space.
result Latent FxLMS converges in fewer steps with comparable error to standard FxLMS.
Robust Kalman filtering method for outlier detection.
problem Outliers and misspecified measurement models in state-space models.
method Combines generalised Bayesian inference with Kalman filters for robustness and efficiency.
result Matches or outperforms other robust filtering methods at lower computational cost.
We revisit the development of grid based recursive approximate filtering of general Markov processes in discrete time, partially observed in conditionally Gaussian noise. The grid based filters considered rely on two types of state quantization: The \textit{Markovian} type and the \textit{marginal} type. We propose a s…
This paper presents a fast Bayesian filtering technique for state estimation.
problem Bottleneck in Bayesian inference for state estimation from noisy sensor data.
method Processor-native uncertainty tracking for uncertainty propagation and inference.
result Deterministic approximate filtering with up to 805x speedup and competitive accuracy.
A novel method reduces dimensionality for filtering SRNs with observed variables.
problem Challenges in estimating hidden state variables in SRNs with limited observations.
method Filtered Markovian Projection (Filtered MP) for dimensionality reduction in filtering.
result Filtered MP guarantees consistency and superior computational efficiency in high dimensions.
Improved stock volume prediction using Kalman Filters with various hidden states.
problem Improving accuracy of intraday trading volume prediction.
method Extended Kalman Filter with various hidden states for different stocks, using cross-validation to determine optimal state number.
result Demonstrated improved accuracy through comparison experiments and numerical analysis.
Improved state estimation in high-dimensional models using Zig-Zag Sampler.
problem Weight degeneracy in particle filtering methods for high-dimensional state space models.
method Discrete Zig-Zag Sampler applied within the Composite MH Kernel of SMCMC framework.
result Improves estimation accuracy and increases acceptance ratio in high-dimensional state estimation.
Adaptive Heston model calibration using PCRLB and switching filters.
problem Estimating volatility in stochastic volatility models like Heston.
method Bayesian filtering (EKF, UKF, PF) with PCRLB for parameter estimation.
result Adaptive estimation of Heston model parameters improves volatility estimation.
Convolutional Bayesian filtering generalizes state estimation by incorporating inequality conditions.
problem Standard Bayesian filtering assumes exact conditional probabilities, limiting its applicability.
method Introducing inequality conditions transforms conditional probabilities into convolutional forms, expanding the filtering framework.
result Convolutional Bayesian filtering encompasses standard Bayesian filtering and allows for more nuanced model consideration.
The Kalman filter is extensively used for state estimation for linear systems under Gaussian noise. When non-Gaussian Lévy noise is present, the conventional Kalman filter may fail to be effective due to the fact that the non-Gaussian Lévy noise may have infinite variance. A modified Kalman filter for linear systems wi…
Framework expands particle filtering to estimate states beyond prior boundaries.
problem Limitations of traditional particle filtering in estimating states outside prior support.
method Diffusion-Enhanced Particle Filtering Framework with adaptive diffusion, entropy-driven regularisation, and kernel-based perturbations.
result Framework significantly improves state estimation accuracy and success rates for out-of-boundary targets.
Paper proposes an end-to-end learning method for state estimation in robotics.
problem Lack of annotated data for optimising dynamic and measurement models in particle filters.
method End-to-end learning objective based on maximising a pseudo-likelihood function.
result Improves state estimation when large portions of true states are unknown.
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model inside a particle filter framework. Model updating is done at measurement sample …
NBF combines deep learning with classical filtering for better belief tracking.
problem Maintaining distributions over hidden states in partially observable systems.
method Trains neural networks to map beliefs to fixed-length vectors, updating them with incoming observations and dynamics.
result NBF efficiently tracks shifting, multimodal beliefs without particle impoverishment.
A new method for state space partitioning in block particle filtering reduces bias and variance.
problem Overcoming the curse of dimensionality in non-linear, non-Gaussian state space estimation.
method Formulates state space partitioning as a clustering problem and uses spectral clustering with constraints.
result The proposed method effectively groups correlated state variables into smaller blocks, reducing bias and variance.
This paper addresses the problem of filtering with a state-space model. Standard approaches for filtering assume that a probabilistic model for observations (i.e. the observation model) is given explicitly or at least parametrically. We consider a setting where this assumption is not satisfied; we assume that the knowl…
We seek to learn an effective policy for a Markov Decision Process (MDP) with continuous states via Q-Learning. Given a set of basis functions over state action pairs we search for a corresponding set of linear weights that minimizes the mean Bellman residual. Our algorithm uses a Kalman filter model to estimate those …
Develops state-space deep Gaussian processes for irregular signals.
problem Solving deep Gaussian process regression problems for irregular signals/functions.
method Represent DGPs as SDEs, solve using state-space filtering and smoothing methods.
result Rich class of priors compatible with irregular signals/functions.
A new method learns state and proposal dynamics in state-space models using neural networks.
problem Inference in non-linear state-space models.
method StateMixNN method using neural networks for proposal and transition distributions.
result Significantly improved recovery of hidden state, especially in highly non-linear scenarios.
ROAD-EnKFs use learned low-dimensional models to improve state reconstruction and forecasting.
problem Reconstructing and forecasting states of unknown or expensive systems.
method Learned low-dimensional surrogate models and ensemble Kalman filter integration.
result ROAD-EnKFs achieve higher accuracy at lower computational cost than existing methods.
Given a stationary state-space model that relates a sequence of hidden states and corresponding measurements or observations, Bayesian filtering provides a principled statistical framework for inferring the posterior distribution of the current state given all measurements up to the present time. For example, the Apoll…
Proposes CE-BASS for robust Kalman filtering with innovative and additive outliers.
problem Robustness to both innovative and additive outliers in Kalman filtering.
method Particle mixture Kalman filter with re-sampling of past states.
result CE-BASS efficiently handles multi-modality and trend changes in hidden state distributions.
We simplify Bayesian filtering by framing it as optimization, making it practical for high-dimensional systems.
problem Bayesian filtering struggles in high-dimensional state spaces like neural networks.
method We frame Bayesian filtering as optimization, using gradient descent for nonlinear cases.
result Our method results in effective, robust, and scalable filters for high-dimensional systems.
KalmanNet uses neural networks to improve state estimation in systems with unknown dynamics.
problem State estimation of systems with non-linear dynamics and partial information.
method KalmanNet integrates a recurrent neural network with the Kalman filter to handle non-linearities and model mismatches.
result KalmanNet outperforms classic filtering methods in systems with both mismatched and accurate domain knowledge.
The paper develops a computational method for efficient online filtering of diffusion processes.
problem Online filtering of discretely observed nonlinear diffusion processes.
method The approach involves Doob's h-transforms approximated by solving backward Kolmogorov equations using nonlinear Feynman-Kac formulas and neural networks. result The proposed method can be orders of magnitude more efficient than state-of-the-art particle filters.
This work studies the problem of stochastic dynamic filtering and state propagation with complex beliefs. The main contribution is GP-SUM, a filtering algorithm tailored to dynamic systems and observation models expressed as Gaussian Processes (GP), and to states represented as a weighted sum of Gaussians. The key attr…
Enhanced ensemble filters use machine learning to improve accuracy in filtering models.
problem Accuracy limitations of traditional ensemble Kalman filters.
method Introduces a measure neural mapping (MNM) to map joint predicted state and observation to updated state estimates.
result Superior root-mean-square-error performance compared to leading methods in filtering models.
Filtered conformal ellipsoids for graph-native time series
problem Joint prediction sets for multivariate time series
method Filtered conformal ellipsoids
result Sharper at-target ellipsoids than static-covariance and non-filter baselines
Filtering is a general name for inferring the states of a dynamical system given observations. The most common filtering approach is Gaussian Filtering (GF) where the distribution of the inferred states is a Gaussian whose mean is an affine function of the observations. There are two restrictions in this model: Gaussia…
This paper learns state, dynamics, and filtering algorithms together for data assimilation.
problem Costly parameter tuning and inaccurate dynamics models hinder data assimilation algorithms.
method Auto-differentiable data assimilation framework that learns state, dynamics, and parameters via gradient-based optimization.
result Several data assimilation methods can be learned or tuned within this framework.
This paper proves long-time accuracy of ensemble Kalman filters for chaotic and machine-learned systems.
problem Ensuring long-term accuracy of ensemble Kalman filters for complex dynamical systems.
method Established conditions for long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems.
result Ensemble Kalman filters maintain small estimation error over long time horizons for chaotic and machine-learned systems.
Study of filtering and smoothing in submanifolds of Euclidean space.
problem Filtering and smoothing in continuous-discrete time on submanifolds.
method Formal expressions and projection approach for prediction and smoothing.
result Agreement with classical results for prediction, differences for smoothing.
A new variational method for SSMs improves inference efficiency.
problem Hard variational inference for state space models.
method Proposes variational marginal particle filter (VMPF) based on Rao-Blackwellization.
result VMPF provides tighter variational bounds and sometimes benefits from unbiased reparameterization.
Develops an inverse particle filter for cognitive systems.
problem Tracking cognitive adversaries in counter-adversarial applications.
method Global filtering approach using Monte Carlo methods and differentiable I-PF.
result Demonstrates convergence to optimal inverse filter and improved estimation performance.
We cast Amari's natural gradient in statistical learning as a specific case of Kalman filtering. Namely, applying an extended Kalman filter to estimate a fixed unknown parameter of a probabilistic model from a series of observations, is rigorously equivalent to estimating this parameter via an online stochastic natural…
Despite the recent popularity of deep generative state space models, few comparisons have been made between network architectures and the inference steps of the Bayesian filtering framework -- with most models simultaneously approximating both state transition and update steps with a single recurrent neural network (RN…
In nonlinear state-space models, sequential learning about the hidden state can proceed by particle filtering when the density of the observation conditional on the state is available analytically (e.g. Gordon et al., 1993). This condition need not hold in complex environments, such as the incomplete-information equili…
IBPF algorithm tackles high-dimensional parameter learning for complex systems.
problem Learning high-dimensional parameters in complex, partially observed, and nonlinear systems.
method Iterated Block Particle Filter (IBPF) for graphical state space models.
result IBPF algorithm consistently beats the curse of dimensionality across various experiments.
A new method for Gaussian filtering using gradient flows and Wasserstein metrics.
problem Approximating Gaussian and mixture-of-Gaussians filtering for complex systems.
method Variational approximation via gradient-flow representation on Wasserstein metric space.
result Competitive performance in posterior representation and parameter estimation for systems with multiplicative noise and multi-modal distributions.