This research proposes a new method to improve model predictions using data-driven correction models.
problem Model misspecification leads to suboptimal decisions in tasks like analysis and optimization.
method Develops a correction model operator with implicit attributes to mitigate model misspecification.
result Improves model predictions and end-goal insights through appropriate choices of correction properties.
RCUKF combines data-driven modeling and Bayesian estimation for accurate system state estimation.
problem Challenges in obtaining reliable process models for complex systems.
method Integrates reservoir computing with unscented Kalman filtering.
result Demonstrated effectiveness on benchmark problems and real-time vehicle trajectory estimation.
Develops a new method for uncertainty quantification in high-dimensional learning.
problem Challenges in uncertainty quantification in high-dimensional regression or learning problems.
method Data-driven approach for UQ that corrects bias terms from training data.
result Non-asymptotic confidence intervals that avoid overestimating uncertainty.
Data-driven approach learns effective equations for phase field interfaces.
problem Learning accurate equations for phase field interface dynamics.
method Data-driven identification of partial differential equations from phase field data.
result Data-driven equations outperform analytical approximations in certain regimes.
This paper analyzes data-driven Newsvendor problems and finds a wide range of possible regrets.
problem Guessing the number drawn from an unknown distribution with asymmetric costs.
method Unified analysis using the notion of clustered distributions and new lower bounds.
result The entire spectrum of achievable regrets from 1 / n 1/\sqrt{n} 1/ n to 1 / n 1/n 1/ n is possible. Estimates reliability of nuclear fuel using advanced modeling techniques.
problem Determining the reliability of TRISO-coated particle fuel, which has small failure probabilities and expensive computational models.
method Coupled active learning, multifidelity modeling, and subset simulation.
result Multifidelity modeling strategies consistently reduce the number of high-fidelity model calls.
New technique tracks geometric properties to correct base algorithms' poor performance.
problem Discrepancy between empirical performance and theoretical regret bounds in linear bandits.
method Data-driven technique that incorporates geometric information to formulate frequentist regret bound.
result Course-corrected algorithms achieve minimax optimal regret of i l d e O ( d T ) ilde{\mathcal{O}}(d\sqrt{T}) i l d e O ( d T ) . A new data-driven model forecasts electricity prices efficiently.
problem Forecasting electricity prices using traditional methods.
method Integrates data-driven and fundamental models, learns from historical data.
result Significantly improves forecasting accuracy compared to existing models.
SCaSML improves PDE solvers by correcting errors efficiently.
problem Reliable and error-free high-dimensional PDE solutions.
method Defect correction method to derive a Structural-preserving Law of Defect.
result SCaSML achieves faster convergence and reduced errors in high-dimensional PDEs.
Deep Autotuner corrects singing pitch without scores, using vocal and accompaniment spectral data.
problem Automatic pitch correction without musical scores for singing performances.
method Convolutional Gated Recurrent Unit (CGRU) model trained on karaoke data.
result The model predicts pitch correction from vocal and accompaniment spectral contents, making the voice sound in tune with the accompaniment.
Deep Autotuner corrects singing pitch using neural networks.
problem Automatic pitch correction for singing performances.
method Neural network model trained on spectrograms of singing and accompaniment.
result Neural network predicts continuous pitch shifts, allowing for improvisation and harmonization.
New optimization method corrects data-driven optimizer's curse.
problem Over-optimistic evaluation in data-driven optimization.
method Smoothed f f f -Divergence Distributionally Robust Optimization (DRO). result Statistical bound on out-of-sample performance nearly tightest.
A hybrid method combines model-based and data-driven approaches for multiscale constitutive responses.
problem High computational costs and inaccuracies in nonlinear multiscale methods.
method Hybrid methodology combining model-based constitutive laws, data-driven corrections, and computational multiscale approaches.
result Model-data-driven approach improves macroscale simulations with similar accuracy and computational cost.
A deep learning model corrects precipitation bias without expert knowledge.
problem Precipitation bias in numerical predictions due to limited observation and models.
method Data-driven deep learning model with Denoising Autoencoder and Ordinal Regression blocks.
result The model achieves the best correcting performance and TS compared to classical methods.
Regression learns Mori-Zwanzig operators for dynamical systems.
problem Learning Mori-Zwanzig operators for complex dynamical systems.
method Statistical regression to extract Markov and memory operators.
result Regression models improve learning of memory-dependent corrections.
Deep learning improves low-fidelity dynamical models with scarce high-fidelity data.
problem Improving low-fidelity models with limited high-fidelity data.
method Transfer learning using a deep neural network to correct a low-fidelity model.
result An improved DNN model with high accuracy to underlying dynamics.
Algorithm learns stochastic system dynamics from data.
problem Recovering interpretable symbolic expressions for stochastic systems.
method Data-driven, trajectory averaging, drift-informed correction.
result Recover coefficients and densities to within 5% and 0.01 in total variation, respectively.
Method estimates treatment effects with continuous values, correcting for confounding.
problem Estimating treatment effects with continuous values, dealing with confounding.
method Two-stage kernel ridge regression: first stage learns response, second stage corrects for distribution shift.
result Optimal learning bounds achieved without estimating treatment density, adapts to unknown overlap and kernel spectral decay.
A main challenge of data-driven sciences is how to make maximal use of the progressively expanding databases of experimental datasets in order to keep research cumulative. We introduce the idea of a modeling-based dataset retrieval engine designed for relating a researcher's experimental dataset to earlier work in the …
The paper solves optimal bounds for separating data points in high dimensions.
problem Correcting AI errors and analyzing vulnerabilities in high-dimensional data.
method General stochastic separation theorems with optimal probability estimates.
result Explicit and optimal estimates of separation probabilities for important classes of distributions.
L2D-CD learns to defer expert recommendations in causal discovery.
problem Combining expert knowledge with data-driven results in causal discovery when expert recommendations may contradict data.
method Adapting learning-to-defer algorithms for pairwise causal discovery, L2D-CD learns a deferral function to select between expert recommendations and data-driven methods.
result L2D-CD outperforms both causal discovery methods and the expert used in isolation, identifying domains where the expert's performance is strong or weak.
A new model combines data-driven and model-based methods for accurate air quality prediction.
problem Accurate air quality forecasts are crucial for public health.
method Combines model-based strategy and data-driven method using PTC model.
result The PTC model achieves excellent performance compared to baseline models.
A new boosting method corrects endogeneity bias in instrumental variable regression.
problem Endogeneity bias in instrumental variable regression.
method Causal Gradient Boosting (boostIV) that builds on gradient boosting algorithm.
result boostIV is consistent and performs well in finite samples compared to other methods.
A k-space deep learning method corrects EPI ghost artifacts without a reference scan.
problem Nyquist ghost artifacts in EPI MRI due to phase mismatch between even and odd echoes.
method Structured low-rank Hankel matrix approaches combined with data-driven Hankel matrix decomposition and deep convolutional neural networks.
result The proposed k-space deep learning method outperforms existing methods in image quality and computing time.
Bayesian method corrects bias in estimating average treatment effects from observational data.
problem Estimating average treatment effects from observational data with selection bias and missing counterfactuals.
method Data-driven modification to an arbitrary prior based on the propensity score to correct for posterior bias.
result Significant improvement in estimation accuracy and uncertainty quantification compared to unmodified priors.
Differentiable Algorithm Networks (DAN) enable composable robot learning.
problem Training robots to learn from limited data and imperfect models.
method Composable architecture of neural network modules, each encoding a differentiable robot algorithm and model, trained end-to-end from data.
result DAN modules adapt to one another and compensate for imperfect models and algorithms, achieving best overall system performance.
Proposes robust assortment optimization from observational data.
problem Real-world scenarios often violate assumptions of stable customer preferences and correct choice models.
method Develops a robust framework that accounts for potential distributional shifts in customer choice behavior.
result Uncovered the notion of ``robust item-wise coverage'' as the minimal data requirement for sample-efficient robust assortment learning.
Deep generative models improve global precipitation forecasts.
problem Accurately forecasting extreme rainfall is challenging and costly.
method Trained a Conditional Generative Adversarial Network (CorrectorGAN) to correct and super-resolve global precipitation forecasts.
result CorrectorGAN produces high-resolution, bias-corrected forecasts in seconds.
The paper improves semi-supervised learning for large data by correcting inconsistent methods.
problem Inconsistent behavior of semi-supervised learning methods in large data limits.
method Data-driven parametrization and theoretical analysis of asymptotic performances.
result Significant performance gains observed on practical data classification.
PBC improves AI and dynamical subseasonal forecasts by reducing biases.
problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.
Safe offline RL for chemical reactors using input convex neural networks.
problem Safe control of exothermic polymerization reactors using historical data.
method Gymnasium-compatible simulation, behaviour cloning, implicit Q-learning, input convex neural networks (PICNNs).
result Offline RL with convex action correction outperforms traditional control approaches.
LatentNN corrects neural network attenuation bias in astronomical data.
problem Neural networks underestimate extreme values due to measurement errors.
method Jointly optimizes network parameters and latent input values.
result LatentNN reduces attenuation bias across various signal-to-noise ratios.
Gemini uses inexpensive measurements to correct biases in expensive property evaluations.
problem Accurate estimation of materials properties using expensive measurements is hindered in scientific discovery campaigns.
method Gemini is a data-driven model that corrects systematic biases between property evaluation methods using inexpensive measurements.
result Gemini reduces the number of expensive evaluations needed for Bayesian optimization in materials discovery.
Bayesian autoencoders discover physics from noisy data.
problem Challenges in identifying governing equations and coordinates from noisy, low-data real-world data.
method Bayesian SINDy autoencoders with hierarchical Bayesian sparsifying prior and adaptive empirical Bayesian method.
result Better physics discovery with lower data and fewer training epochs, along with valid uncertainty quantification.
Hybrid models combine domain knowledge and data-driven learning for Earth observation.
problem Challenges in modelling Earth observation data with either purely mechanistic or data-driven methods.
method Gaussian process convolution models, specifically latent force models (LFMs), integrating physical knowledge into multioutput GP models.
result Model automatically estimates soil moisture persistence and discovers latent forces related to precipitation.
While computer and communication technologies have provided effective means to scale up many aspects of education, the submission and grading of assessments such as homework assignments and tests remains a weak link. In this paper, we study the problem of automatically grading the kinds of open response mathematical qu…
Proposes a new method combining Reservoir Computing and Normalizing Flow for predicting stochastic dynamical systems.
problem Predicting and capturing long-term behaviors of stochastic dynamical systems.
method Data-driven framework combining Reservoir Computing and Normalizing Flow, integrating error modeling and both approaches virtues.
result Successfully predicts the long-term evolution of stochastic dynamical systems and replicates dynamical behaviors.
This study analyzes decision-making in diverse environments where past data may not predict future outcomes.
problem How to make decisions when past data is not indicative of future outcomes due to unobserved confounders.
method Developed a framework to analyze and bound the performance of data-driven policies in heterogeneous environments.
result Established a method to upper bound the asymptotic worst-case regret of policies and analyzed the performance of Sample Average Approximation (SAA).
New method uses machine learning to analyze catalyst reactions.
problem Understanding complex reaction mechanisms in catalytic materials.
method Combining transient kinetics and machine learning.
result Correct estimates of micro-kinetic coefficients and mechanism.
Post-ADC inference corrects bias in statistical inference after active data collection.
problem Bias in inference after active data collection.
method Post-ADC inference framework that corrects bias from both ADC process and data-driven target construction.
result Valid inference for data collected by SMBO methods like GP-UCB and TPE.
Hybrid model improves weather forecasting accuracy.
problem Combining physics and machine learning for better weather predictions.
method Offline and online training of a neural network to correct model errors in the IFS.
result The hybrid model reduces forecast errors and improves accuracy.
Automates bias control in reinforcement learning algorithms.
problem Overestimation bias in reinforcement learning algorithms.
method Data-driven approach for automatic selection of bias control hyperparameters.
result Significant reduction in the number of interactions while maintaining performance.
Machine learning predicts nuclear physics parameters with high accuracy.
problem Predicting nuclear physics parameters for superheavy elements.
method Gradient boosted trees algorithm trained on nuclear data.
result Predictions have standard deviation from 0.00035 to 0.73.
New algorithms estimate unknown training examples to improve ML model generalization.
problem Distribution shift between training and testing data leads to poor generalization.
method Combining species-estimation techniques with data-driven methods.
result Correcting the training set with unknown examples improves model robustness.
Proposes a scalable framework for extracting data manifold geometry.
problem Efficiently mapping and learning data manifold geometry.
method Score-based pullback Riemannian geometry integrating pullback Riemannian geometry and generative models.
result High-quality geodesics and reliable intrinsic dimension estimation.
Improved latent dynamics identification framework reduces training time and improves accuracy.
problem Accurate numerical solutions of partial differential equations require computationally expensive solvers.
method Sequential decoder training (mLaSDI) to correct residual errors from previous stages.
result mLaSDI consistently outperforms standard LaSDI, achieving lower prediction errors and reduced training time.
New method bounds hardware noise without assumptions.
problem Estimating hardware noise without assumptions.
method Machine Learning and Conformal Prediction.
result Theoretical upper bounds of fidelity.
Novel autoencoder method approximates Koopman operator in low dimensions.
problem Challenges in approximating finite Koopman operators using data-driven methods.
method Mori-Zwanzig autoencoder (MZ-AE) for robust Koopman operator approximation.
result Improved predictive capability and robust long-term statistical performance.