This paper proves long-time accuracy of ensemble Kalman filters for chaotic and machine-learned systems.
problem Ensuring long-term accuracy of ensemble Kalman filters for complex dynamical systems.
method Established conditions for long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems.
result Ensemble Kalman filters maintain small estimation error over long time horizons for chaotic and machine-learned systems.
Paper introduces EnDKF for more accurate pose tracking.
problem Accurate pose tracking with directional uncertainty.
method EnDKF integrates unit-quaternion attitude representation for better directional uncertainty capture.
result Significant reduction in error compared to traditional methods.
This work preserves linear invariants in ensemble filters for non-Gaussian data assimilation.
problem Maintaining critical invariants like mass, stoichiometric balance, and charge in non-Gaussian data assimilation.
method Introducing a novel class of nonlinear ensemble filters using measure transport theory.
result Recovery of a constrained Kalman filter for Gaussian settings and combination with regularization techniques.
Ens-CGP synthesizes ensemble-based inference with Gaussian processes.
problem Ensemble-based inference and Gaussian process modeling.
method Formulates Ens-CGP as a conditional Gaussian process for ensemble moments.
result Ens-CGP provides a unified probabilistic foundation for Kalman-type methods.
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
This paper explores estimating chaotic dynamics and parameters using local ensemble Kalman filters.
problem Estimating chaotic dynamics and parameters from observations.
method Local ensemble Kalman filters with covariance and local domain localisation.
result Rigorously updating global parameters using a local domain ensemble Kalman filter.
This paper introduces a new perspective on multi-class ensemble classification that considers training an ensemble as a state estimation problem. The new perspective considers the final ensemble classifier model as a static state, which can be estimated using a Kalman filter that combines noisy estimates made by indivi…
Proposes a new method to enhance neural learning by maximizing information gain.
problem Improving neural learning by selecting key variables to maximize information gain.
method Adaptive Ensemble Kalman Filter to quantify uncertainty and maximize information gain.
result The proposed method enables the neural network to learn more effectively from stochastic systems.
EnSF improves accuracy in tracking high-dimensional nonlinear systems.
problem Low accuracy in high-dimensional, nonlinear filtering problems.
method Score-based diffusion model, mini-batch Monte Carlo estimator.
result EnSF outperforms state-of-the-art methods in tracking high-dimensional systems.
EnKO combines VI and EnKF for efficient latent dynamics inference.
problem Particle degeneracy and biased gradient estimators in SMC-based methods.
method EnKO: hybrid of VI and EnKF.
result EnKO outperforms SMC-based methods in predictive ability and particle efficiency.
ROAD-EnKFs use learned low-dimensional models to improve state reconstruction and forecasting.
problem Reconstructing and forecasting states of unknown or expensive systems.
method Learned low-dimensional surrogate models and ensemble Kalman filter integration.
result ROAD-EnKFs achieve higher accuracy at lower computational cost than existing methods.
Paper analyzes ensemble Kalman updates for effective dimension and localization.
problem Why small ensemble sizes work well in inverse problems and data assimilation.
method Non-asymptotic analysis of ensemble Kalman updates, focusing on effective dimension and localization.
result Rigorously explains why a small ensemble size is sufficient when prior covariance has moderate effective dimension.
Enhanced ensemble filters use machine learning to improve accuracy in filtering models.
problem Accuracy limitations of traditional ensemble Kalman filters.
method Introduces a measure neural mapping (MNM) to map joint predicted state and observation to updated state estimates.
result Superior root-mean-square-error performance compared to leading methods in filtering models.
EnKF's update is shown to be similar to Matheron's method in Gaussian process regression.
problem Data assimilation in high-dimensional systems.
method Empirical Matheron update applied to EnKF.
result Ensemble Kalman Filter's update is equivalent to an empirical Matheron update.
Proposes LAE-EnKF for improved nonlinear data assimilation.
problem Performance of EnKF deteriorates for strongly nonlinear dynamics.
method Reformulates assimilation in a learned latent space with linear dynamics.
result LAE-EnKF yields more accurate and stable assimilation.
A new ML-based filter improves data assimilation for nonlinear systems.
problem Improving data assimilation for nonlinear systems using ensemble methods.
method Developed a machine learning-based conditional mean filter (ML-EnCMF) integrating ANN and linear functions.
result ML-EnCMF outperforms EnKF and likelihood-based EnCMF in nonlinear systems.
Proposes a new method for nonlinear Bayesian updates using ensemble kernel regression.
problem Nonlinear and non-Gaussian Bayesian updates for complex systems.
method Combines Kalman filtering for observed components and kernel density estimation for unobserved components, with subsampling and clustering.
result Reduces estimation errors in highly nonlinear scenarios compared to standard linear updates.
Despite the success of ensemble classification methods in multi-class classification problems, ensemble methods based on approaches other than bagging have not been widely explored for multi-label classification problems. The Kalman Filter-based Heuristic Ensemble (KFHE) is an ensemble method that exploits the sensor f…
Robust Kalman filtering method for outlier detection.
problem Outliers and misspecified measurement models in state-space models.
method Combines generalised Bayesian inference with Kalman filters for robustness and efficiency.
result Matches or outperforms other robust filtering methods at lower computational cost.
This paper explores online learning of dynamics and state using ensemble Kalman filters.
problem Reconstructing dynamics from partial and noisy observations in real-time.
method Ensemble Kalman filter (EnKF) family of algorithms for online learning of dynamics and state.
result Demonstrates the efficiency and accuracy of online learning methods using Lorenz models.
A new filter adapts to heavy-tailed data without tuning, improving performance in challenging conditions.
problem Degraded performance of Kalman and EnKF in heavy-tailed distributions.
method Generalizes EnKF using t-distributions, estimating parameters via EM algorithm.
result Improves performance on challenging filtering problems with heavy-tailed noise.
A new method approximates deep neural networks using Kalman Filters.
problem Approximating deep neural networks with limited data.
method Matrix Ensemble Kalman Filter-based multi-arm ANN (MEnKF-ANN).
result MEnKF-ANN can adequately approximate LSTM networks and provide uncertainty estimates.
New distributed EnKF method for non-sequential assimilation of large datasets.
problem Computational intensity and order dependencies in traditional EnKF.
method Distributed computing for full model error covariance matrix.
result Non-sequential assimilation outperforms sequential in performance.
Bayesian method learns optimal momentum for landmark matching.
problem Finding a diffeomorphism between two sets of landmarks.
method Ensemble Kalman filter for derivative-free Bayesian inverse method.
result Efficient algorithm for various target shapes.
Bayesian inference for neural networks improves uncertainty quantification.
problem Improving predictive uncertainty in neural networks.
method Ensemble Kalman filter extensions and interacting particle systems.
result Effective methods for quantifying predictive uncertainty in neural networks.
Ensemble Kalman Filter improves GPSSM inference for online learning.
problem Non-mean-field variational inference issues in GPSSM.
method Combining EnKF with NMF variational inference.
result Improved online learning performance and data-fitting accuracy.
Research compares ML and Time Series methods for generating trading signals.
problem Efficiency of on-line learning Algorithms in generating trading signals.
method Used technical indicators and ensemble of Random Forests, also Kalman Filter.
result Kalman Filter outperformed Random Forests in on-line learning predictions of stock prices.
Bayesian EnKF improves sentence comprehension uncertainty modeling.
problem Uncertainty in human language comprehension, especially with ambiguous inputs.
method Bayesian framework using ensemble Kalman filter (EnKF) for uncertainty quantification.
result Enhanced model's ability to approximate human cognitive processing with linguistic ambiguities.
Deep learning improves chaotic dynamics filtering without ensemble.
problem Discovering efficient DA schemes for chaotic dynamics.
method Residual Convolutional Neural Network for the analysis step.
result Deep learning achieves ensemble filtering accuracy without an ensemble.
CG-EnKF and NS-EnKF outperform deep learning-based SF in data assimilation.
problem Data assimilation with non-linear perturbations.
method Two non-linear extensions of EnKF: CG-EnKF and NS-EnKF.
result CG-EnKF and NS-EnKF outperform SF in high-dimensional multiscale data assimilation.
A new method reduces high-dimensional filtering to quadratic complexity.
problem High-dimensional dynamical systems inference and simulation.
method Low-rank Kalman filtering using dynamical low-rank integrator.
result The method reproduces exact Kalman filter in low-rank limit.
Gaussian process regression is a machine learning approach which has been shown its power for estimation of unknown functions. However, Gaussian processes suffer from high computational complexity, as in a basic form they scale cubically with the number of observations. Several approaches based on inducing points were …
Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The distinguishing feature of these algorithms is that the Bayesian update step is implemen…
ATPF combines PF and EnKF for better inference in complex systems.
problem Weight degeneracy in PF and approximation errors in EnKF.
method Adversarial learning to improve posterior matching and incorporate kernel methods for optimization.
result ATPF provides theoretical guarantees and practical advantages over PF and EnKF.
Unified framework for ensemble transport-based smoothing of non-Gaussian time series.
problem Bayesian time series re-analysis with non-Gaussian distributions.
method Measure transport approach to derive consistent prior-to-posterior transformations.
result General ensemble framework for transport-based smoothing of state-space models.
The paper explores how multiway data from PDEs can be accurately tracked using EnKF with specific covariance and precision estimators.
problem Tracking sparse and multiway structures in dynamical processes governed by PDEs.
method Examined several multiway covariance and precision matrix estimators in the context of physics-driven forecasting and EnKF.
result Multiway data from Poisson and convection-diffusion PDEs can be accurately tracked using EnKF with appropriate estimators.
GEnBP combines EnKF and GaBP for efficient high-dimensional inference.
problem Efficient inference in high-dimensional models.
method Gaussian Ensemble Belief Propagation algorithm combining EnKF and GaBP.
result GEnBP outperforms existing methods in accuracy and efficiency.
We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that harnesses transportation of measures, convex optimization, and ideas from proba…
Combining LETKF and RC improves chaotic system prediction from noisy, sparse data.
problem Improving chaotic system prediction from imperfect observations and models.
method Combining LETKF and RC to predict spatio-temporal chaotic systems from noisy and sparsely distributed observations.
result The proposed method using LETKF and RC outperforms LETKF in predicting chaotic systems from noisy and sparse observations.
A new ensemble filter uses transport maps and MMD optimization for high-dimensional data assimilation.
problem High-dimensional data assimilation challenges in ensemble filtering.
method Optimized Maximum Mean Discrepancy (MMD) for transport map construction.
result Significant improvement in robustness and posterior approximation.
A new EnKF method for elliptic PDEs reduces dimensionality for accurate state estimation.
problem Elliptic PDEs in fluid flows make traditional EnKF regularization ineffective.
method Low-rank factorization of the Kalman gain based on the Jacobian spectrum.
result Inference can be performed in a low-dimensional subspace of the state space.
The standard probabilistic perspective on machine learning gives rise to empirical risk-minimization tasks that are frequently solved by stochastic gradient descent (SGD) and variants thereof. We present a formulation of these tasks as classical inverse or filtering problems and, furthermore, we propose an efficient, g…
This paper uses Bayesian optimization to efficiently identify stochastic dynamical systems.
problem Efficiently identifying linear stochastic dynamical systems with unknown coefficients and noise variances.
method Adaptive Bayesian optimization with ensemble Gaussian processes (EGP) and Kalman filter recursion.
result BO-based estimator achieves RMSE below the Cramer-Rao bound, improving robustness and consistency.
Improved Kalman filter for Stiefel manifold measurements.
problem Improving accuracy in measurements on Stiefel manifolds.
method Generalization of extended Kalman filter for Stiefel manifold-valued measurements.
result Significant improvement over raw measurements.
BI-EqNO improves Bayesian inference with flexible neural operators.
problem Inaccurate estimation of marginal likelihoods in approximate Bayesian methods.
method Equivariant neural operator framework for generalized approximate Bayesian inference.
result BI-EqNO enhances both deterministic and stochastic approaches to Bayesian inference.
EnFF uses flows to speed up DA in high dimensions.
problem Efficiently assimilating noisy data in high-dimensional systems.
method Flow Matching (FM) for training-free, scalable data assimilation.
result EnFF accelerates DA with improved cost-accuracy tradeoffs and scalability.
HKF uses neural networks to adapt Kalman filters for dynamic channel tracking.
problem Tracking channels with varying dynamics and Doppler values.
method Combines Kalman filters with hypernetworks for dynamic adaptation.
result HKF achieves up to 2dB gain over Kalman filters at high Doppler values.
EnKBS smoothes complex systems with future observations for causal inference.
problem Improving state estimation in complex systems with rapid dynamics.
method Continuous-time ensemble Kalman-Bucy smoother for nonlinear dynamical systems.
result EnKBS provides derivative-free framework with high skill in various scientific problems.