PFNs4BO uses neural processes for flexible Bayesian Optimization.
problem Efficient surrogate modeling for Bayesian Optimization.
method In-context learning of PFNs to approximate posterior predictive distribution.
result PFNs outperform traditional GP, BNN in BO tasks.
Develops a numerical algorithm for stochastic impulse control using regression surrogates.
problem Optimal impulse control in stochastic processes.
method Generates statistical surrogates for continuation and intervention functions, recursively trained over simulated state trajectories.
result Demonstrates flexibility and extensibility of the numerical scheme through case studies.
The paper proposes a method to assess surrogate heterogeneity in non-randomized data.
problem Lack of methods to evaluate surrogate heterogeneity in non-randomized data.
method Proposes a framework using meta-learners to assess surrogate heterogeneity in real-world data.
result Identifies individuals for whom the surrogate is a valid replacement of the primary outcome.
Paper tackles federated learning with personalised bandit algorithms.
problem Optimizing local and global objectives in a heterogeneous environment.
method Surrogate objective function combining client preferences and global knowledge; phase-based elimination algorithm.
result Achieves sublinear regret with logarithmic communication overhead.
Local surrogate explainers vary in objectives, leading to incomparable explanations.
problem Variability in objectives among local surrogate explainers.
method Review of multiple local surrogate explainers, focusing on extracted information.
result Diverse explanations from similar methods due to differing objectives.
DeepICMGP surrogate models multiple outputs efficiently.
problem Challenges in modeling dependencies between multiple outputs using traditional multi-output GPs.
method Introduces hierarchical coregionalization structures across layers in DGPs.
result Demonstrates competitive performance and active learning strategies.
Proposes a method for inference in high-dimensional classification with non-differentiable surrogate losses.
problem Lack of inference procedures for identifying driving factors in high-dimensional classification with non-differentiable surrogate losses.
method Kernel-smoothed decorrelated score and cross-fitted version for hypothesis tests and interval estimators.
result Valid and superior inference methods for high-dimensional classification with non-differentiable surrogate losses.
MFNets constructs efficient multifidelity surrogates from diverse information sources.
problem Creating accurate surrogates from multiple, potentially costly or inaccurate data sources.
method Directed acyclic graph of connections, gradient-based minimization of least squares objective, flexible information source structure.
result Error reduction by orders-of-magnitude, especially in low-data scenarios.
New model improves QGP simulation efficiency and accuracy.
problem Limited QGP simulation runs due to high computational cost.
method Additive Multi-Index Gaussian process (AdMIn-GP) model.
result Significantly improved surrogate modeling performance.
Gradient-informed BNNs improve Bayesian optimization performance.
problem Improving Bayesian optimization with gradient information.
method Gradient-informed loss function for Bayesian neural networks.
result Gradient information enhances BNN predictions and BO convergence.
Deep Gaussian Processes improve likelihood-free inference for complex distributions.
problem Limited flexibility of Bayesian Optimization with GPs for multimodal distributions.
method Proposes Deep Gaussian Processes (DGPs) as a surrogate model for likelihood-free inference.
result DGPs outperform GPs on multimodal distributions while maintaining comparable performance on unimodal cases.
Unified approach for federated learning using MM optimization.
problem Scaling stochastic optimization to federated learning.
method Unified Majorize-Minimize (MM) framework for stochastic optimization, extended to federated learning.
result Unified algorithm \QSMM\ for federated learning that aggregates surrogate majorizing functions.
New method uses AI predictions as cheaper alternatives to expensive outcomes.
problem Using expensive outcomes for statistical inference.
method Recalibrated prediction-powered inference using machine learning techniques.
result Significant gains in effective sample size over existing PPI proposals.
SCIENCE improves prediction intervals for individual causal effects.
problem Wide prediction intervals limit practical utility of causal inference.
method Surrogate-assisted conformal inference for efficient individual causal effects.
result SCIENCE produces more efficient prediction intervals for individual causal effects.
Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining variational Bayesian inference and MCMC simulation in order to improve their ov…
Active sampling improves design space exploration for analog circuits.
problem Efficiently exploring the space of design features in analog circuits with many parameters.
method Combining drastic dimension reduction with sensitivity analysis and Bayesian surrogate modeling for active sampling.
result The proposed active sampling flow outperforms traditional Monte-Carlo sampling.
Optimizing expensive black-box systems with limited data is an extremely challenging problem. As a resolution, we present a new surrogate optimization approach by addressing two gaps in prior research -- unimportant input variables and inefficient treatment of uncertainty associated with the black-box output. We first …
Adaptive learning rates improve FTPL's BOBW guarantees in bandit problems.
problem Improving Follow-the-Perturbed-Leader's BOBW guarantees in bandit problems.
method Introducing surrogate probability functions to compute adaptive learning rates without exact probabilities.
result BOBW guarantees for FTPL with Pareto perturbations for any α>1. Enhanced kernel framework for advanced data forecasting.
problem Complex mechanical behaviors and timefrequency dynamics in aircraft systems.
method Frequency-aware surrogate modeling with SMT kernels, extending kernel types and incorporating derivatives.
result Improved accuracy in forecasting CO2 concentrations and airline passenger traffic.
Bayesian model uses physics constraints for semi-supervised surrogate learning.
problem Lack of labeled data in fine-grained model training.
method Probabilistic generative model with virtual observables.
result Enables semi-supervised training with unlabeled data.
Proposes a method to classify binary data from multiple unlabeled datasets.
problem High annotation costs in training classifiers from weakly supervised data.
method Introduces surrogate set classification (SSC) to predict data origin from multiple unlabeled datasets, then uses this to train a binary classifier.
result Demonstrates superior performance compared to existing methods.
For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an efficient and scalable computational technique for a state-of-the-art Markov Chain…
A new method for creating simpler models from complex ones.
problem Creating accurate approximations of complex models at reduced costs.
method Sequential adaptive surrogate modeling based on locally spectral expansions.
result Stochastic spectral embedding (SSE) shows good approximation capabilities and scalability.
Enhances DGP surrogates for efficient active learning.
problem Efficiently learning from expensive simulations with abrupt changes.
method Novel elliptical slice sampling for uncertainty quantification and active learning.
result Smaller training sets lead to effective and computationally tractable models.
Semi-implicit variational inference (SIVI) is introduced to expand the commonly used analytic variational distribution family, by mixing the variational parameter with a flexible distribution. This mixing distribution can assume any density function, explicit or not, as long as independent random samples can be generat…
PILNO uses neural operators to solve PDEs efficiently on point clouds.
problem Solving partial differential equations (PDEs) on point cloud data efficiently.
method Physics-informed low-rank neural operator framework combining low-rank kernel approximations and an encoder-decoder architecture.
result PILNO efficiently approximates solution operators of PDEs on point cloud data, satisfying PDE constraints and boundary conditions.
Due to limited computational power, performing uncertainty quantification analyses with complex computational models can be a challenging task. This is exacerbated in the context of stochastic simulators, the response of which to a given set of input parameters, rather than being a deterministic value, is a random vari…
BO method identifies sparse subspaces for efficient high-dimensional optimization.
problem Efficient optimization of high-dimensional black-box functions.
method Sparse Gaussian process surrogate models on axis-aligned subspaces with Hamiltonian Monte Carlo inference.
result SAASBO achieves excellent performance on synthetic and real-world problems.
This work combines machine learning with physical models to solve inverse problems efficiently.
problem Solving inverse problems in the presence of missing physics and recovering parameters.
method Variational autoencoding with a physically structured decoder network and stochastic local approximations.
result The method accelerates inference for Bayesian inverse problems and acts as a regularizer encoding prior physical information.
Study uses machine learning to optimize stock trading strategies.
problem Optimizing stock trading strategies with machine learning.
method Dynamic programming and deep learning for nonlinear price impact.
result NN surrogates accurately approximate optimal strategies.
Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning framework. Surrogate and relaxation methods exist but tend to be specific to a given…
New method combines machine learning with data assimilation for model error correction.
problem Correcting model errors using sparse and noisy observations.
method Hybrid machine learning and data assimilation methods.
result Tendency correction outperforms resolvent correction in data assimilation experiments.
In computer experiments, a mathematical model implemented on a computer is used to represent complex physical phenomena. These models, known as computer simulators, enable experimental study of a virtual representation of the complex phenomena. Simulators can be thought of as complex functions that take many inputs and…
Bayesian optimization has shown to be a fundamental global optimization algorithm in many applications: ranging from automatic machine learning, robotics, reinforcement learning, experimental design, simulations, etc. The most popular and effective Bayesian optimization relies on a surrogate model in the form of a Gaus…
Efficient surrogate modeling for complex PDEs with physical laws.
problem High computational cost of repeated PDE simulations.
method LC-prior Gaussian process with POD and RBF-FD.
result Significantly reduced computational cost and improved accuracy.
DeepRV accelerates spatiotemporal inference using neural priors.
problem Intractable scaling of Gaussian Processes for large datasets.
method Neural-network surrogate replacing GP prior sampling with O(N2) complexity. result DeepRV achieves highest fidelity to exact GPs while significantly speeding up inference.
New bounds show polyhedral surrogates are optimal for generalization.
problem Proving generalization rates for polyhedral loss functions.
method Developed two general results for polyhedral surrogates.
result Polyhedral surrogates provide linear surrogate regret bounds, translating directly to target rates.
Unified framework for deferring queries to top-k experts, improving accuracy-cost trade-offs.
problem Limitation of existing L2D frameworks to single-expert deferral.
method Top-k Learning-to-Defer framework, including adaptive Top-k(x) variant. result Superior accuracy-cost trade-offs with multi-expert deferral.
Sketching accelerates structured prediction methods for large datasets.
problem Scaling surrogate kernel methods for large datasets.
method Sketching approximations applied to input and output feature maps.
result Achieves close-to-optimal rates with reduced sketch size.
Motivated by Supervised Opinion Analysis, we propose a novel framework devoted to Structured Output Learning with Abstention (SOLA). The structure prediction model is able to abstain from predicting some labels in the structured output at a cost chosen by the user in a flexible way. For that purpose, we decompose the p…
A new graph generator uses heat diffusion on graph Laplacians to create new graph structures.
problem Creating realistic and diverse graph structures for various applications.
method Adapting the Generator Matching paradigm to graph data, using graph Laplacian and heat kernel for diffusion.
result The method effectively generates graphs with structural properties of real and synthetic graphs.
MF-GLaM models improve stochastic simulator emulation with multifidelity data.
problem Challenging to emulate stochastic simulators' full conditional probability distribution.
method Proposes MF-GLaMs to efficiently emulate HF stochastic simulators using LF data.
result MF-GLaMs achieve improved accuracy or comparable performance at reduced cost.
BKTF uses tensor factorization for Bayesian optimization of complex functions.
problem Complex functions with nonstationary, nonseparable, and multimodal features.
method Bayesian Kernelized Tensor Factorization (BKTF) approximates complex functions using a low-rank tensor CP decomposition with GP priors.
result BKTF provides flexible and effective surrogate modeling with uncertainty quantification.
Pseudo-Bayesian Optimization improves black-box function optimization using simple local regression.
problem Optimizing expensive black-box functions with uncertainty quantification.
method Axiomatic framework for convergence guarantees, combined with simple local regression and randomized prior.
result Empirically superior algorithms outperform state-of-the-art benchmarks in various applications.
A neural network speeds up bond-associated peridynamics simulations.
problem High computational costs in bond-associated peridynamics.
method Message-passing neural network (MPNN) for bond-associated peridynamic material correspondence formulation.
result Significantly reduces computation time via GPU acceleration.
ExKMC improves explainable k-means clustering by balancing accuracy and simplicity.
problem Limited explainable methods for unsupervised learning.
method Develops ExKMC, a new algorithm that uses a decision tree with k′ leaves to explain k-means clustering, trading explainability for accuracy. result ExKMC produces a low-cost clustering that outperforms existing methods.
Generating adversarial examples is a critical step for evaluating and improving the robustness of learning machines. So far, most existing methods only work for classification and are not designed to alter the true performance measure of the problem at hand. We introduce a novel flexible approach named Houdini for gene…
Local GP approach improves simulation efficiency for large datasets.
problem High computational cost of traditional Gaussian processes for large-scale simulations.
method Hybridizes global and local GP approximations with strategic placement of inducing points.
result Local inducing points enhance accuracy and computational efficiency.