ACI uses Bayesian data assimilation to trace causes from effects in complex systems.
problem Capturing instantaneous, time-evolving causal relationships in complex, high-dimensional systems.
method Assimilative causal inference (ACI) leverages Bayesian data assimilation to trace causes backward from observed effects.
result ACI provides online tracking of causal roles that may reverse intermittently and reveals how far effects propagate.
EnFF uses flows to speed up DA in high dimensions.
problem Efficiently assimilating noisy data in high-dimensional systems.
method Flow Matching (FM) for training-free, scalable data assimilation.
result EnFF accelerates DA with improved cost-accuracy tradeoffs and scalability.
Novel method for nonlinear data assimilation using Langevin sampling.
problem Nonlinear data assimilation challenges in Bayesian filtering.
method Score-based sequential Langevin sampling (SSLS) with dynamic models and annealing.
result Asymptotic stability and error bounds for local posterior sampling.
Latent-EnSF improves data assimilation for high-dimensional systems with sparse observations.
problem Challenges in high-dimensional, nonlinear Bayesian filtering with sparse observations.
method A novel data assimilation method using latent representations and a coupled VAE for efficient state encoding and reconstruction.
result Latent-EnSF outperforms traditional methods in accuracy, convergence, and efficiency for complex systems.
Prequential posteriors tackle data assimilation for deep generative forecasting models.
problem Challenges in assimilating data into deep generative forecasting models due to intractable likelihood functions.
method Introduces prequential posteriors based on a predictive-sequential loss function, proving consistency under mild conditions, and using parallelizable SMC samplers for scalable inference.
result Prequential posteriors concentrate around parameters with optimal predictive performance, validating method on synthetic and real-world datasets.
BRPC online Bayesian calibration handles gradual and abrupt system changes.
problem Aligning model outputs with field observations in evolving systems.
method Bayesian Recursive Projected Calibration (BRPC) for streaming data under simulator mismatch and nonstationarity.
result Improves calibration accuracy under gradual changes and robustness under abrupt regime shifts.
New methods use RL and DA to improve dosing precision and reduce side effects.
problem Improving precision and safety of anticancer drug dosing.
method Bayesian data assimilation and reinforcement learning.
result Significantly reduces incidence of severe side effects.
New method for data assimilation using score-based models.
problem Bayesian inverse problem of identifying plausible state trajectories.
method Score-based data assimilation, learning a score-based generative model of state trajectories.
result Effective method for zero-shot observation scenarios.
BI-EqNO improves Bayesian inference with flexible neural operators.
problem Inaccurate estimation of marginal likelihoods in approximate Bayesian methods.
method Equivariant neural operator framework for generalized approximate Bayesian inference.
result BI-EqNO enhances both deterministic and stochastic approaches to Bayesian inference.
MEDIDA discovers model errors in chaotic systems using sparse regression and data assimilation.
problem Model errors in chaotic systems lead to significant discrepancies between model predictions and real-world states.
method MEDIDA combines Bayesian sparse regression and data assimilation to estimate and interpret model errors from noisy observations.
result MEDIDA successfully identifies different types of model errors in the chaotic Kuramoto-Sivashinsky system.
The reconstruction from observations of high-dimensional chaotic dynamics such as geophysical flows is hampered by (i) the partial and noisy observations that can realistically be obtained, (ii) the need to learn from long time series of data, and (iii) the unstable nature of the dynamics. To achieve such inference fro…
Develops Φ-DVAE for assimilating unstructured data into physical models.
problem Challenges in incorporating unstructured data into physical models.
method Physics-informed dynamical variational autoencoder (Φ-DVAE) combining latent state-space model and VAE. result Demonstrates data-efficient dynamics encoding with competitive performance and uncertainty quantification.
Artificial neural networks estimate model parameters from observations, reducing model errors.
problem Estimating parameters of convection-permitting models from observations.
method Training Bayesian neural networks and point estimate neural networks on atmospheric state observations.
result Artificial neural networks can estimate model parameters and their statistics.
This paper explores online learning of dynamics and state using ensemble Kalman filters.
problem Reconstructing dynamics from partial and noisy observations in real-time.
method Ensemble Kalman filter (EnKF) family of algorithms for online learning of dynamics and state.
result Demonstrates the efficiency and accuracy of online learning methods using Lorenz models.
Improving Bayesian filtering with strictly proper scoring rules
problem Bayesian filtering of partially and noisily observed dynamical systems
method Proper scoring ensemble filter (PSEF)
result Accurate approximation of challenging filtering distributions
Online DEM improves tracking of latent states in dynamic systems.
problem Tracking latent states in dynamic systems with online updates.
method Specializes DEM for online data assimilation, separating temporal scales.
result ODEM can track latent states of a non-linear generative model.
SDA method reduces memory and time for assimilating noisy geophysical data.
problem Challenges in identifying state trajectories of high-dimensional geophysical systems.
method Score-based data assimilation with modified score network architecture.
result Promising results for a two-layer quasi-geostrophic model.
ACI identifies cause-effect relationships and causal influence ranges in dynamical systems.
problem Detecting and quantifying causal influence ranges in complex systems.
method Bayesian data assimilation and assimilative causal inference (ACI) to trace causes back from observed effects.
result Mathematically rigorous formulations of forward and backward causal influence ranges (CIRs) for nonlinear dynamical systems.
SOAD model improves data assimilation for nonlinear systems.
problem Challenges in classical data assimilation with high nonlinearity.
method State-Observation Augmented Diffusion (SOAD) model for data-driven assimilation.
result SOAD model matches true posterior distribution under mild assumptions.
Simulator imperfection, often known as model error, is ubiquitous in practical data assimilation problems. Despite the enormous efforts dedicated to addressing this problem, properly handling simulator imperfection in data assimilation remains to be a challenging task. In this work, we propose an approach to dealing wi…
Introduces triangular transport for uncertain data.
problem Uncertainty in complex systems without known probabilistic representations.
method Characterizes and manipulates unknown probability distributions using triangular transport maps.
result Triangular transport guarantees desirable mathematical and computational properties.
The concept of mathematical modeling is widespread across almost all of the fields of contemporary science and engineering. Because of the existing necessity of predictions the behavior of natural phenomena, the researchers develop more and more complex models. However, despite their ability to better forecasting, the …
LD-EnSF speeds up data assimilation with sparse observations.
problem Efficiently assimilate sparse and noisy data into complex dynamical systems.
method LD-EnSF uses latent dynamics networks and history-aware LSTM encoders to process sparse observations without full-space simulations.
result Achieves significant speedups over existing methods while maintaining high accuracy.
EnSF uses image inpainting to handle partial observations in data assimilation.
problem Data assimilation challenges with partial observations.
method EnSF integrates image inpainting with diffusion models to predict unobserved states.
result EnSF successfully tracks SQG dynamics with partial observations.
SURGIN uses generative models to infer subsurface flow data efficiently.
problem Inefficient and task-specific inversion methods for subsurface multiphase flow.
method SURGIN integrates U-FNO surrogate with SGM for zero-shot conditional generation.
result Decent inference of heterogeneous geological fields and flow dynamics with uncertainty quantification.
Machine learning improves solving inverse problems and integrating data.
problem Solving complex inverse problems and integrating data effectively.
method Integrates machine learning techniques with inverse problems and data assimilation.
result Demonstrates machine learning's potential to enhance these fields.
New method calibrates predictions in chaotic systems using variational inference.
problem Uncertainty in data assimilation for chaotic systems.
method Variational inference applied to multivariate Gaussian distribution.
result Nearly perfectly calibrated predictions in chaotic Lorenz-96 dynamics.
Combines machine learning and data assimilation for improved forecasting.
problem Improving forecast accuracy with noisy observations.
method Sequentially learns a machine-learning model using an ensemble Kalman filter.
result The combined model achieves good forecast skill and computational efficiency.
New method combines neural networks and data assimilation for indoor air quality prediction.
problem Accurate and fast prediction of indoor air quality using real-time data.
method Combines Data Assimilation and Machine Learning using a Convolutional neural network and Long-Short-Term-Memory.
result Improved accuracy of dynamic system representation by integrating real data.
Stochastic methods improve data assimilation with high-frequency sensor data.
problem Computational challenges in data assimilation with high-frequency sensor data.
method Adapted stochastic approximation methods to handle high-frequency observations.
result Produces high-quality estimates using all observations without compromising statistical accuracy.
This paper learns state, dynamics, and filtering algorithms together for data assimilation.
problem Costly parameter tuning and inaccurate dynamics models hinder data assimilation algorithms.
method Auto-differentiable data assimilation framework that learns state, dynamics, and parameters via gradient-based optimization.
result Several data assimilation methods can be learned or tuned within this framework.
Proposes a new method for data assimilation using closed-form conditional diffusion models.
problem Data assimilation for systems with complex, non-Gaussian probability distributions.
method Uses kernel density estimation to model joint distributions and leverages the score function for efficient evaluation.
result Outperforms ensemble Kalman and particle filters in nonlinear data assimilation problems.
DAISI improves data assimilation for complex systems with noisy observations.
problem Limited accuracy of classical DA methods in complex, nonlinear systems.
method Generative models with inverse sampling for flexible probabilistic inference.
result DAISI achieves accurate filtering results in challenging nonlinear systems.
Bayesian-SINDy learns differential equations from noisy data quickly.
problem Learning correct model equations from limited and noisy data.
method Bayesian-SINDy framework using Gaussian approximations.
result Bayesian-SINDy is more robust and accurate in learning correct model equations from noisy data.
Proposes LAE-EnKF for improved nonlinear data assimilation.
problem Performance of EnKF deteriorates for strongly nonlinear dynamics.
method Reformulates assimilation in a learned latent space with linear dynamics.
result LAE-EnKF yields more accurate and stable assimilation.
Deep learning speeds up pressure prediction in carbon storage reservoirs.
problem Accurately forecasting reservoir pressure in geologic carbon storage projects with sparse well data.
method Combining InSAR surface displacement data with deep learning and data assimilation techniques.
result Workflow can predict reservoir pressure with high efficiency and uncertainty quantification.
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
DA-PredGAN uses GANs for accurate COVID-19 spread predictions and data assimilation.
problem Predicting and understanding the spread of COVID-19.
method Generative adversarial network (GAN) for predictions and data assimilation.
result DA-PredGAN accurately predicts and assimilates COVID-19 spread data.
Adaptive algorithm improves nonlinear data assimilation for non-Gaussian systems.
problem Challenges of non-Gaussian statistics in data assimilation.
method Triangular measure transport with P-spline basis functions and an information criterion.
result Automatic selection of parsimonious parametrization for efficient adaptation.
Enhances PCE surrogates using transfer learning for expensive simulations.
problem Over-sampling in PCE for expensive forward models.
method Transfer learning from similar tasks to a new task with limited training data.
result Improves scalability and accuracy of PCE surrogates.
EnCF improves data assimilation for implicit, non-smooth observations.
problem Data assimilation challenges with implicit, many-to-one observations.
method EnCF uses a stochastic controlled flow to update forecast distributions.
result EnCF outperforms Kalman filters for non-Gaussian, implicit observations.
CG-EnKF and NS-EnKF outperform deep learning-based SF in data assimilation.
problem Data assimilation with non-linear perturbations.
method Two non-linear extensions of EnKF: CG-EnKF and NS-EnKF.
result CG-EnKF and NS-EnKF outperform SF in high-dimensional multiscale data assimilation.
MASF improves score-based filters for high-dimensional nonlinear systems with spatially sparse measurements.
problem Challenges in data assimilation for nonlinear, high-dimensional systems with spatially sparse measurements.
method Developed a forward process tailored for filtering that transforms the system state toward the measurement space, enabling a theoretically sound formulation of the likelihood score.
result MASF shows improved performance over existing score-based filters and ensemble-type Kalman filters, achieving up to a 28.2× wall-clock speedup.
PARyOpt is a python based implementation of the Bayesian optimization routine designed for remote and asynchronous function evaluations. Bayesian optimization is especially attractive for computational optimization due to its low cost function footprint as well as the ability to account for uncertainties in data. A key…
A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future states. The method consists in applying iteratively a data assimilation step, here…
EnKF's update is shown to be similar to Matheron's method in Gaussian process regression.
problem Data assimilation in high-dimensional systems.
method Empirical Matheron update applied to EnKF.
result Ensemble Kalman Filter's update is equivalent to an empirical Matheron update.
Epidemiological model updates infection rates in China, US, Italy.
problem Evaluate policy interventions for mitigating the 2019-nCov pandemic.
method Custom SITR model with variational data assimilation for real-time updates.
result Model robust to initial conditions, infers infection numbers and parameters.
New method reduces DSI complexity using RAE and LSTM for better posterior predictions.
problem Reducing complexity in data-space inversion for subsurface flow simulations.
method Recurrent Autoencoder (RAE) for dimension reduction and LSTM for flow-rate time series representation.
result RAE-based parameterization outperforms existing DSI treatments in statistical agreement with reference results.