Machine learning models emulate and approximate complex mappings in model physics.
problem Developing and ensuring accurate physical parameterizations.
method Machine learning tools to emulate and approximate mappings.
result ML can improve parameterizations and enforce physical constraints.
FaIRGP model improves climate emulation with physical interpretability.
problem Lack of physical interpretability in data-driven emulators.
method Bayesian approach to a data-driven emulator of energy balance equations.
result Demonstrates skillful emulation of global and spatial surface temperatures.
A GPU-based workflow for building physics emulators of hypersonic flows
problem Resolving complex physical phenomena in hypersonic flows
method Fully GPU-based workflow integrating accelerated data generation and neural emulators
result Physics emulators remain reliable beyond their training distribution
AutoKE automates embedding physical knowledge into neural networks for complex engineering problems.
problem Complex physical equations in engineering problems.
method AutoKE framework using deep neural networks, equation parsing, automatic differentiation, adaptive weights, and NAS.
result Automatically embeds physical knowledge into neural networks for complex equations efficiently.
Bayesian emulator tackles models with discontinuities efficiently.
problem Uncertainty quantification of models with multiple discontinuities.
method TENSE framework, designed correlation structures, single emulator object.
result Efficient emulation of complex models with multiple discontinuities.
Physics-constrained GANs generate samples that meet deterministic constraints.
problem Ensuring GAN-generated samples comply with physical constraints.
method Enforce deterministic constraints via modified loss function.
result Physics-constrained GANs produce samples that accurately meet underlying constraints.
Develop a framework to evaluate the reliability of probabilistic emulation of physical systems.
problem Evaluating the reliability of probabilistic forecasts in physical systems.
method Developing a framework to assess the reliability of probabilistic emulation across diverse 2D spatiotemporal systems.
result CRPS-trained ensembles achieve more reliable uncertainties on single-step prediction and autoregressive rollouts.
E&E uses contrastive learning to speed up SBI for high-dimensional systems.
problem Challenges in training high-dimensional emulators for complex systems.
method Contrastive learning for low-dimensional latent embedding and fast emulator.
result Superior performance in non-identifiable parameter estimation tasks.
HierGP improves emulator efficiency for sparse, structured data.
problem Sparse, structured data in expensive simulations.
method Hierarchical shrinkage GP framework with cumulative shrinkage priors.
result HierGP identifies structured sparse features from limited data.
New framework bridges climate science and ML for easier climate model emulation.
problem High computational costs and mistrust of ML methods in climate models.
method Integrating climate science and machine learning perspectives to design easy-to-adopt emulators.
result Demonstrated reliability of emulators designed to address specific tasks.
New method learns chaotic dynamics from single noisy trajectory.
problem Chaos in complex systems is hard to model accurately with machine learning.
method Adversarial optimal transport objectives to learn summary statistics and emulator from single noisy data.
result Emulators trained with proposed objectives have significantly improved long-term statistical fidelity.
Fast emulators built with neural search accelerate expensive scientific simulations.
problem Slow execution of accurate simulations limits scientific discovery.
method Neural architecture search to build accurate emulators with limited data.
result Simulations accelerated by up to 2 billion times in various scientific fields.
ClimART dataset benchmarks ML emulators for atmospheric RT in climate models.
problem Lack of a comprehensive dataset and standardized practices for ML benchmarking in climate models.
method Builds ClimART, a large dataset with over 10 million samples, and presents novel baselines.
result Indicates shortcomings of prior datasets and network architectures.
COCA accelerates N-body simulations by correcting ML errors.
problem Computational expense and limited trustworthiness of ML emulations.
method Hybrid framework combining ML and N-body simulator in an emulated frame of reference. result COCA reduces emulation errors with fewer force evaluations.
Generative model emulates climate model for 100-year forecasts.
problem Challenges in accurately simulating long-term climate data.
method Integrates DYffusion with SFNO for stable, accurate climate simulations.
result Achieves near gold-standard performance for climate model emulation.
SPF uses a hierarchical approach to efficiently emulate climate changes.
problem Slow and unstable climate emulation for long horizons.
method Spatiotemporal Pyramid Flows (SPF) model data hierarchically across spatial and temporal scales.
result SPF outperforms flow matching baselines and pre-trained models on ClimateBench.
Machine learning speeds up CRTM model predictions for weather forecasting.
problem Insufficient computational efficiency of radiative transfer models.
method Probabilistic neural network emulator of CRTM.
result Emulator predicts brightness temperatures with RMSE < 0.1 K for clear sky conditions.
In this work, sequence-to-sequence (seq2seq) models, originally developed for language translation, are used to predict the temporal evolution of complex, multi-physics computer simulations. The predictive performance of seq2seq models is compared to state transition models for datasets generated with multi-physics cod…
Simulating complex physical systems often involves solving partial differential equations (PDEs) with some closures due to the presence of multi-scale physics that cannot be fully resolved. Therefore, reliable and accurate closure models for unresolved physics remains an important requirement for many computational phy…
Cohesion uses deep Koopman operators to generate long-range forecasts of chaotic dynamics.
problem Challenges in data-driven emulation of chaotic dynamics, especially long-range skill decay.
method Generative modeling with coherent priors estimated using reduced-order models.
result Superior long-range forecasting skill on chaotic systems, including climate dynamics.
EIDGM model estimates DE parameters from RCS data.
problem Estimating DE parameters from RCS data with heterogeneities.
method Physics-informed neural network emulator + Wasserstein GAN parameter generator.
result EIDGM accurately captures diverse parameter distributions.
This work speeds up DFT simulations using approximate Gaussian processes.
problem Slow DFT simulations due to large data sets.
method Approximate Gaussian processes (sparse variational GP, stochastic variational GP, deep kernel learned GP) to speed up DFT model predictions.
result Calibrated DFT models can predict properties of experimentally unobserved nuclides.
A method for making machine learning units-equivariant using dimensional analysis.
problem Ensuring machine learning models respect dimensional consistency.
method Constructing dimensionless inputs and applying equivariant machine learning methods.
result Improved accuracy in tasks requiring dimensional consistency.
This work combines machine learning with physical models to solve inverse problems efficiently.
problem Solving inverse problems in the presence of missing physics and recovering parameters.
method Variational autoencoding with a physically structured decoder network and stochastic local approximations.
result The method accelerates inference for Bayesian inverse problems and acts as a regularizer encoding prior physical information.
Method trains emulators to estimate posterior probabilities safely.
problem Uncertainty in slow forward model calculations.
method Trains emulators while estimating posterior probabilities with MCMC, propagating error.
result Demonstrates robust posterior inference for ΛCDM cosmology model. A new emulator connects observables directly from data.
problem Constructing fast and accurate surrogate models for robust predictions.
method Introduces Multiparameter Eigenvalue Problem (MEP) emulator trained with Eigenvector Continuation (EC) and Parametric Matrix Model (PMM) data.
result The MEP emulator can make predictions directly from observables to observables.
How spiking networks are able to perform probabilistic inference is an intriguing question, not only for understanding information processing in the brain, but also for transferring these computational principles to neuromorphic silicon circuits. A number of computationally powerful spiking network models have been pro…
Study compares 29 emulators across 60 test functions and 40 datasets.
problem Comparing the strengths and weaknesses of different emulators.
method Large-scale, fully reproducible comparison using R package duqling.
result Detailed empirical insights into emulator strengths and weaknesses.
A new method uses variational autoencoders to speed up greenhouse gas sensitivity calculations.
problem Computational inefficiency in generating LPDM sensitivities from gas mole fraction observations.
method Developed a convolutional variational autoencoder (CVAE) to emulate LPDM sensitivities in a low-dimensional space.
result The CVAE-based emulator outperforms traditional methods and can be applied to various LPDMs.
Flatland is a simple, lightweight environment for fast prototyping and testing of reinforcement learning agents. It is of lower complexity compared to similar 3D platforms (e.g. DeepMind Lab or VizDoom), but emulates physical properties of the real world, such as continuity, multi-modal partially-observable states with…
Paper predicts turbulent flows using physics-informed deep learning.
problem Predicting turbulent flows from fluid simulations.
method Hybrid approach combining RANS and LES with trainable spectral filters and U-net.
result Significant reduction in prediction error for 60 frames ahead.
New algorithm speeds up Bayesian UQ for high-dimensional inverse problems.
problem Computational inefficiency in Bayesian inference for high-dimensional inverse problems.
method Deep neural network-based autoencoder for dimension reduction and emulation phase.
result Computational efficiency up to three orders of magnitude with scalable Bayesian UQ.
Thermalizer stabilizes autoregressive models for long-term predictions in chaotic systems.
problem Long-term predictions in chaotic spatiotemporal systems are unreliable due to trajectory divergence.
method Diffusion models are used to implicitly estimate the score of an invariant measure, which stabilizes autoregressive emulators by applying denoising during inference.
result Thermalization extends the time horizon of stable predictions by an order of magnitude in chaotic systems.
Approximate Bayesian Computation (ABC) provides methods for Bayesian inference in simulation-based stochastic models which do not permit tractable likelihoods. We present a new ABC method which uses probabilistic neural emulator networks to learn synthetic likelihoods on simulated data -- both local emulators which app…
Deep learning models match traditional surrogate models in accuracy and speed for satellite remote sensing.
problem Limited computational power hinders high-resolution numerical model simulations.
method Deep learning framework applied to satellite remote sensing data.
result Deep learning models can accurately and efficiently emulate numerical models.
Neural-network emulators predict sea-level changes due to Antarctic ice melt.
problem High computational cost and time in projecting sea-level changes.
method Built neural-network emulators of sea-level change using GRD effects from future Antarctic Ice Sheet mass change.
result Neural-network emulators are as accurate as baseline machine learning emulators and offer substantial computational efficiency.
Method maps imperfect simulations to observed stellar spectra using unsupervised domain adaptation.
problem Mapping from large sets of imperfect simulations and observational data.
method Adversarial autoencoders, cycle-consistency constraint, and generative surrogate physics emulator network.
result Reconstructed spectra quality and discovery of new spectral features.
Generative models emulate climate model outputs for impact assessment.
problem Outdated climate model projections hinder adaptation and mitigation planning.
method Score-based diffusion on a spherical mesh, trained on monthly ESM fields.
result Generative models produce distributions closely matching ESM outputs.
Bayesian approach for learning spatiotemporal systems from noisy data.
problem Efficiently modeling and learning from spatiotemporal dynamical systems with noisy data.
method Hierarchical state-space models with Gaussian process regression for efficient interpolation and training.
result Efficient modeling and learning of spatiotemporal dynamics using Bayesian methods.
New method integrates computer models from different disciplines with better predictive performance.
problem Integration of multi-disciplinary computer models with distinct complexities and computation times.
method Developed a linked deep Gaussian process (DGP) method that integrates individual Gaussian process emulators in a network.
result Linked deep Gaussian process emulators outperform standard LGP emulators and single DGPs fitted to the network as a whole.
RADIS uses deep regression to create efficient importance sampling for model inversion and emulation.
problem Efficiently sampling from posterior distributions for model inversion and emulation.
method RADIS uses a deep architecture of nested importance sampling schemes to construct a non-parametric emulator that mimics the posterior distribution.
result RADIS asymptotically converges to an exact sampler under mild conditions and can be used as a surrogate model.
This paper analyzes machine learning workflows in climate modeling.
problem Challenges in integrating machine learning with climate modeling.
method Analysis of case studies focusing on design patterns and workflow structure.
result Synthesis of workflow design patterns across diverse projects in ML-enabled climate modeling.
In this paper, five different approaches for reduced-order modeling of brittle fracture in geomaterials, specifically concrete, are presented and compared. Four of the five methods rely on machine learning (ML) algorithms to approximate important aspects of the brittle fracture problem. In addition to the ML algorithms…
InVAErt networks use data-driven methods for system synthesis and identifiability analysis.
problem Model synthesis and identifiability analysis for complex systems.
method Deterministic encoder and decoder, normalizing flow, variational encoder, loss function penalty coefficients, latent space sampling.
result Validation through various system types, demonstrating effectiveness of the framework.
A new method for training deep Gaussian processes using stochastic imputation.
problem Efficiently training deep Gaussian processes with varying regimes or sharp changes.
method Stochastic imputation to transform DGPs into linked GPs for efficient training.
result The method produces fast and analytically tractable predictions from DGP emulators.
Transformers can emulate various algorithms by prompting, proving universality.
problem How to emulate algorithms using fixed-weight Transformers.
method Two modes of in-context algorithm emulation: task-specific and prompt-programmable. Constructing prompts that encode algorithm parameters into token representations.
result Fixed-weight Transformers can emulate a broad class of algorithms via prompts.
Paper develops a method to create accurate emulators of expensive computer codes.
problem High cost and complexity of running complex computer codes.
method Active learning with Gaussian processes to construct emulators.
result Accurate and compact emulators created for expensive codes.
A new method for designing accurate emulators using deep learning with interval calibration.
problem Designing accurate emulators for scientific processes with modern machine learning methods.
method Learn-by-Calibrating (LbC) approach based on interval calibration.
result Significant improvements in generalization error over widely-used loss functions.