Stochastic parameterizations account for uncertainty in the representation of unresolved sub-grid processes by sampling from the distribution of possible sub-grid forcings. Some existing stochastic parameterizations utilize data-driven approaches to characterize uncertainty, but these approaches require significant str…
Climate projections suffer from uncertain equilibrium climate sensitivity. The reason behind this uncertainty is the resolution of global climate models, which is too coarse to resolve key processes such as clouds and convection. These processes are approximated using heuristics in a process called parameterization. Th…
DD-SP uses ML to improve SP for Lorenz 96 systems, outperforming LR and DD-P.
problem Improving computational efficiency in weather/climate modeling.
method Data-driven super-parameterization using recurrent neural networks.
result DD-SP is more accurate and cheaper than SP, especially with scale separation.
New method calibrates predictions in chaotic systems using variational inference.
problem Uncertainty in data assimilation for chaotic systems.
method Variational inference applied to multivariate Gaussian distribution.
result Nearly perfectly calibrated predictions in chaotic Lorenz-96 dynamics.
Combining LETKF and RC improves chaotic system prediction from noisy, sparse data.
problem Improving chaotic system prediction from imperfect observations and models.
method Combining LETKF and RC to predict spatio-temporal chaotic systems from noisy and sparsely distributed observations.
result The proposed method using LETKF and RC outperforms LETKF in predicting chaotic systems from noisy and sparse observations.
In this paper, the performance of three deep learning methods for predicting short-term evolution and for reproducing the long-term statistics of a multi-scale spatio-temporal Lorenz 96 system is examined. The methods are: echo state network (a type of reservoir computing, RC-ESN), deep feed-forward artificial neural n…
Analog methods improve forecast accuracy in complex models.
problem Improving forecast accuracy in complex models like Lorenz-96.
method Constructing analogs using variational autoencoders for ensemble data assimilation.
result Constructed analogs perform as well as a full ensemble square root filter.
EnEMF uses Epanechnikov kernel for high-dimensional filtering, improving accuracy and robustness.
problem Suboptimal Gaussian mixture kernel density estimates in high-dimensional settings.
method Ensemble Epanechnikov mixture filter (EnEMF) using optimal Epanechnikov kernel.
result EnEMF reduces error per particle on high-dimensional systems like Lorenz '96.
CG-EnKF and NS-EnKF outperform deep learning-based SF in data assimilation.
problem Data assimilation with non-linear perturbations.
method Two non-linear extensions of EnKF: CG-EnKF and NS-EnKF.
result CG-EnKF and NS-EnKF outperform SF in high-dimensional multiscale data assimilation.
A new method predicts non-Markovian closure terms for complex systems.
problem Predicting the effect of unresolved variables on resolved dynamics in high-dimensional systems.
method Mamba-Assisted Closure (MAC) framework: sequence model trained to predict closure from resolved trajectory, coupled with reduced-order equations.
result Substantially outperforms existing methods in predictive accuracy and long-time stability.
E&E uses contrastive learning to speed up SBI for high-dimensional systems.
problem Challenges in training high-dimensional emulators for complex systems.
method Contrastive learning for low-dimensional latent embedding and fast emulator.
result Superior performance in non-identifiable parameter estimation tasks.
A hybrid method combines data assimilation and machine learning to predict chaotic dynamics from sparse noisy data.
problem Predicting chaotic dynamics from sparse and noisy observations.
method Iterative application of ensemble Kalman filter for data assimilation and neural network for model emulation.
result The hybrid method successfully predicts chaotic dynamics up to two Lyapunov times, retrieves positive Lyapunov exponents, and more energetic frequencies.
Deep learning improves chaotic dynamics filtering without ensemble.
problem Discovering efficient DA schemes for chaotic dynamics.
method Residual Convolutional Neural Network for the analysis step.
result Deep learning achieves ensemble filtering accuracy without an ensemble.
New parameterization tackles stochasticity in weather models.
problem Uncertainty in small-scale processes in weather models.
method Bayesian neural network with Hamiltonian Monte Carlo for uncertainty quantification and memory.
result Shows skillful forecasts and trustworthy uncertainty quantifications.
Enhanced ensemble filters use machine learning to improve accuracy in filtering models.
problem Accuracy limitations of traditional ensemble Kalman filters.
method Introduces a measure neural mapping (MNM) to map joint predicted state and observation to updated state estimates.
result Superior root-mean-square-error performance compared to leading methods in filtering models.
We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that harnesses transportation of measures, convex optimization, and ideas from proba…
While most classical approaches to Granger causality detection repose upon linear time series assumptions, many interactions in neuroscience and economics applications are nonlinear. We develop an approach to nonlinear Granger causality detection using multilayer perceptrons where the input to the network is the past t…
AD-EnKFs use machine learning to improve data assimilation in high-dimensional systems.
problem Data assimilation in high-dimensional, unknown dynamics systems.
method Auto-differentiable ensemble Kalman filters blending machine learning and ensemble Kalman filters.
result AD-EnKFs outperform existing methods in the Lorenz-96 model.
Develops theory for data-driven methods in dynamical systems.
problem Lack of analysis for data-driven methods in dynamical systems.
method Establishes existence of mapping and properties of operator learning architecture.
result Novel universal approximation theorems for smoothing and forecasting.
This paper learns state, dynamics, and filtering algorithms together for data assimilation.
problem Costly parameter tuning and inaccurate dynamics models hinder data assimilation algorithms.
method Auto-differentiable data assimilation framework that learns state, dynamics, and parameters via gradient-based optimization.
result Several data assimilation methods can be learned or tuned within this framework.
Deep density methods improve filtering in high-dimensional systems.
problem Nonlinear filtering in high-dimensional systems.
method Two deep density methods based on Feynman-Kac formulas and neural networks.
result Logarithmic deep backward stochastic differential equation filter outperforms classical methods in high dimensions.
In this work, a novel sequential Monte Carlo filter is introduced which aims at efficient sampling of high-dimensional state spaces with a limited number of particles. Particles are pushed forward from the prior to the posterior density using a sequence of mappings that minimizes the Kullback-Leibler divergence between…
New method uses neural networks to efficiently approximate Bayesian inference for complex models.
problem Efficiently approximating Bayesian inference for complex models with varying temperatures.
method Fully amortized neural posterior estimator trained on a single forward pass.
result Achieves competitive posterior approximations across various temperatures and benchmarks.
A new framework reduces inconsistencies in chaotic surrogate modeling.
problem Consistency issues between probabilistic objectives and dynamical system dynamics.
method KAFFEE (Kalman-Aware Framework For Ergodic Emulation), a differentiable extended Kalman filter.
result KAFFEE mitigates the dynamic-probabilistic consistency gap, improving reconstruction and predictive scores.
GC-KAN uses KANs to detect Granger causality in time series data.
problem Detecting causal relationships in nonlinear time series data.
method Developed GC-KAN framework using Kolmogorov-Arnold networks for Granger causality detection.
result KANs outperform MLPs in identifying sparse Granger causal relationships.
Long-lead forecasting for spatio-temporal systems can often entail complex nonlinear dynamics that are difficult to specify it a priori. Current statistical methodologies for modeling these processes are often highly parameterized and thus, challenging to implement from a computational perspective. One potential parsim…
Dynamical weather and climate prediction models underpin many studies of the Earth system and hold the promise of being able to make robust projections of future climate change based on physical laws. However, simulations from these models still show many differences compared with observations. Machine learning has bee…
Proposes a new method for data assimilation using closed-form conditional diffusion models.
problem Data assimilation for systems with complex, non-Gaussian probability distributions.
method Uses kernel density estimation to model joint distributions and leverages the score function for efficient evaluation.
result Outperforms ensemble Kalman and particle filters in nonlinear data assimilation problems.
EnSF improves accuracy in tracking high-dimensional nonlinear systems.
problem Low accuracy in high-dimensional, nonlinear filtering problems.
method Score-based diffusion model, mini-batch Monte Carlo estimator.
result EnSF outperforms state-of-the-art methods in tracking high-dimensional systems.
Unified framework for blending ML and mechanistic models in dynamical systems.
problem Learning dynamical systems from noisy, partially observed data.
method A unifying framework that combines mechanistic and machine learning approaches.
result Proves that hybrid models can learn memory-dependent model error.
A new ML-based filter improves data assimilation for nonlinear systems.
problem Improving data assimilation for nonlinear systems using ensemble methods.
method Developed a machine learning-based conditional mean filter (ML-EnCMF) integrating ANN and linear functions.
result ML-EnCMF outperforms EnKF and likelihood-based EnCMF in nonlinear systems.
The conditional-mean barrier helps diagnose deterministic surrogates missing uncertainty.
problem Uncertainty in deterministic surrogates for complex systems.
method Developed diagnostics to locate the conditional-mean barrier and prove its necessity for distributional objectives.
result Crossing the barrier requires a loss that scores distributions, not point predictions.
The paper introduces BCART models for aggregate claim amount, improving frequency-severity and joint modeling.
problem Modeling aggregate claim amount with frequency-severity and joint dependencies.
method Developed three types of BCART models: frequency-severity, sequential, and joint models. Used various distributions for claim severity data.
result Weibull distribution outperforms gamma and lognormal for right-skewed, heavy-tailed claim severity data.
The paper uses model-based trees to create interpretable surrogate models for complex machine learning models.
problem Interpreting complex machine learning models.
method Using model-based trees to partition feature space and create interpretable models.
result Model-based trees generate optimal surrogate models that balance interpretability and performance.
Gauge Flow Models use a learnable Gauge Field in Generative Flow Models.
problem Improving generative model performance.
method Integrates a learnable Gauge Field into Flow ODEs.
result Gauge Flow Models outperform traditional Flow Models in Flow Matching experiments.
The study examines how model predictions hold up under model extensions.
problem Model predictions may not be robust under model extensions, limiting their applicability.
method The study uses causal ordering to assess robustness of qualitative model predictions and characterizes model extensions that preserve predictions.
result Conditions and techniques are provided to assess robustness of model predictions under model extensions.
Revises Bayesian model averaging for foundation models.
problem Ensemble pre-trained and lightly-finetuned foundation models for improved classification performance.
method Introduces trainable linear classifiers and computationally cheaper model averaging scheme (OMA).
result Ensembled models can better predict on various datasets.
Paper introduces symmetric divergence link models for probability distributions.
problem Symmetric divergence measures for probability distributions.
method Two general classes of link models: one for survival functions and another for cumulative probability distribution functions.
result Advantages of symmetric divergence measures over asymmetric measures for model averaging and feature assessment.
New method to handle credit portfolio model uncertainties.
problem Model risk in credit portfolio models.
method Demonstrates comprehensive yet easy-to-implement approach to uncertainty in model parameters.
result Comprehensive method to deal with model uncertainties.
The paper tests stock return models and uses LSTM to predict stock returns.
problem Validating stock return models and predicting stock returns.
method Used Fama-French three-factor, four-factor, and five-factor models; also used LSTM model.
result Fama-French five-factor model shows better validity for stock returns.
Researchers review challenges in interpreting additive models, especially neural additive models.
problem Challenges in interpreting additive models, particularly neural additive models.
method Review of generalized additive models and discussion of nonidentifiability.
result Challenges in claiming interpretability or suitability for safety-critical applications of additive models.
Proposes a decision-theoretic approach for enhancing model interpretability in Bayesian frameworks.
problem Challenges the traditional approach of restricting model structure for interpretability in Bayesian frameworks.
method Introduces an interpretability utility function and a two-step method involving a reference model and a proxy model.
result Demonstrates that the proposed method generates more accurate models with the same level of interpretability.
Novel hybrid modeling combines ML and physics for real-time diagnosis.
problem Real-time diagnosis of complex systems.
method Combines machine learning and physics-based models to create reduced-order models.
result Generated models are two orders of magnitude simpler, improving efficiency.
CRS model improves ranking data modeling with theoretical guarantees.
problem Lack of rich, multimodal models for ranking data.
method Contextual Repeated Selection (CRS) model for multimodal ranking data.
result CRS model significantly outperforms existing methods in various ranking contexts.
Interpretable machine learning has become a strong competitor for traditional black-box models. However, the possible loss of the predictive performance for gaining interpretability is often inevitable, putting practitioners in a dilemma of choosing between high accuracy (black-box models) and interpretability (interpr…
Sigma models linked to Gross-Neveu models via quiver varieties.
problem Understanding the relationship between sigma models and Gross-Neveu models.
method Exploring the mathematical correspondence between sigma models and Gross-Neveu models, including their geometric and trigonometric/elliptic deformations.
result Sigma models are mathematically equivalent to Gross-Neveu models under certain conditions.
Simple models are preferred over complex models, but over-simplistic models could lead to erroneous interpretations. The classical approach is to start with a simple model, whose shortcomings are assessed in residual-based model diagnostics. Eventually, one increases the complexity of this initial overly simple model a…
Matryoshka hides secret models in a carrier model, achieving high capacity and robustness.
problem Stealing functionality of private ML data by hiding models in a carrier model.
method Parameter sharing approach exploiting the learning capacity of the carrier model.
result Hides a 26x larger secret model or 8 secret models in the carrier model.