A new method combines Gaussian Processes to optimize under uncertainty.
problem Bayesian Optimization's weakness in fitting Gaussian Processes.
method Wasserstein Barycenter Gaussian Process (WBGP) approach.
result WBGP-BO converges to the optimum, improving on vanilla BO.
Optimizes Gaussian process hyperparameters using Bayesian autoregression.
problem Optimizing hyperparameters for Matérn kernel temporal Gaussian processes.
method Recursive Bayesian estimation for autoregressive parameters.
result Outperforms traditional optimization methods in runtime and accuracy.
New method optimizes processes under constraints using bivariate Gaussian models.
problem Optimizing processes with constraints using traditional methods.
method Developed a constrained expected improvement acquisition function using bivariate Gaussian process models.
result Demonstrated improved performance in a manufacturing cure process optimization.
Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian Processes, this method may not be adapted for non-stationary functions involved in the op…
Gaussian process priors are commonly used in aerospace design for performing Bayesian optimization. Nonetheless, Gaussian processes suffer two significant drawbacks: outliers are a priori assumed unlikely, and the posterior variance conditioned on observed data depends only on the locations of those data, not the assoc…
New method for global optimization of Gaussian processes reduces computational time.
problem Nonconvex optimization problems with Gaussian processes trained on few data points.
method Reduced-space formulation with branch-and-bound solver and McCormick relaxations.
result Significantly reduced computational time compared to state-of-the-art methods.
This thesis tackles Gaussian Process challenges in low dimensions.
problem Constructing models for large datasets and selecting optimal models.
method Samplet-based approach to efficiently construct and train Gaussian Processes.
result Reduces cubic computational complexity to log-linear scale.
Bayesian optimization sped up with scalable Gaussian processes.
problem Optimizing functions with derivative information and large datasets.
method Combines derivative acceleration and scalable Gaussian process models.
result Significant speedup in optimization convergence for large datasets.
New method to assess uncertainty in Bayesian optimization.
problem Uncertainty quantification in Bayesian optimization.
method Constructing confidence regions of the maximum point or value of the objective function.
result Unified uncertainty quantification framework for various sampling policies and stopping criteria.
Optimizes functions on manifolds using Gaussian processes and graph models.
problem Optimizing functions on unknown manifolds with limited data.
method Graph Gaussian process surrogate model for sequential optimization.
result Established regret bounds for the proposed algorithm.
A new method reduces energy consumption in machine learning by using multiple, less costly data sources.
problem High computational and energy costs in machine learning model training.
method Augmented Gaussian Process (AGP-MISO) with multi-source optimization.
result The AGP-MISO method reduces computational time and energy consumption compared to traditional approaches.
New algorithms use Gaussian processes to optimize stopping times in financial markets.
problem Optimizing stopping times in financial time series with specific applications.
method Gaussian and Deep Gaussian Process models to analytically evaluate optimal stopping value functions and policies.
result Proposed algorithms outperform benchmarks on various financial time series datasets.
The study optimizes wind farm yaw control using Gaussian process regression and high-fidelity simulations.
problem Improving yaw control inputs for maximum power production in wind farms.
method Gaussian process regression and modifier adaptation scheme based on high-fidelity simulation data.
result Both modifier adaptation and Bayesian optimization improve power production with smaller yaw misalignments.
Combines Gaussian process and Geometric Harmonics for better uncertainty estimation.
problem Uncertainty estimation in kernel-based methods.
method Combines Gaussian process and Geometric Harmonics.
result Alternative interpretations of uncertainty and accelerated Bayesian Optimization.
Paper improves regret bounds for Gaussian process upper confidence bound in Bayesian optimization.
problem Minimizing regret in Gaussian process bandit optimization.
method Gaussian process upper confidence bound (GP-UCB) algorithm with refined analysis.
result Achieves O ( T ln 2 T ) O(\sqrt{T \ln^2 T}) O ( T ln 2 T ) cumulative regret under squared exponential kernel. Distributed Quantum Gaussian Processes improve modeling in multi-agent systems.
problem Limited expressivity of classical kernels in complex domains.
method Distributed Quantum Gaussian Process (DQGP) with DR-ADMM algorithm.
result Enhanced modeling capabilities and scalability in multi-agent systems.
The paper improves Gaussian process models for efficient batch optimization.
problem Poor scaling and optimization loop issues in Gaussian process models.
method Dual GP parameterization for linear scaling and non-Gaussian likelihood updates.
result Extends sparse models to greedy batch fantasizing acquisition functions.
The paper improves Gaussian process regression by optimizing hyperparameters.
problem Hyperparameter tuning for Gaussian process regression models.
method Adaptive sparse variational approximations using variational Bayes.
result Minimax optimal rates of convergence for variational posterior.
Enhanced Gaussian process models accelerate optimization and posterior approximation.
problem Improving the accuracy and speed of Gaussian process models for optimization and inference.
method Introduces a random exploration step to classical GP-UCB algorithms, facilitating faster convergence.
result New algorithms achieve nearly optimal convergence rates and provide bounds for Hellinger distance.
VOGP efficiently identifies Pareto optimal solutions in black-box vector optimization.
problem Black-box vector optimization with incomplete order relations.
method VOGP is an adaptive elimination algorithm using Gaussian process bandits.
result VOGP achieves theoretical guarantees with sample complexity bounds.
This paper optimizes Bayesian acquisition functions in Gaussian Processes for better optimization.
problem Improving the efficiency of Bayesian optimization methods.
method Analysis of different acquisition functions and optimizers for optimizing Bayesian acquisition functions.
result Optimization of acquisition functions leads to faster and more accurate sampling points.
A new knot selection method speeds up sparse Gaussian process approximations.
problem Efficiently selecting knots for sparse Gaussian processes.
method One-at-a-time Bayesian optimization for knot selection.
result Competitive performance with reduced computational cost.
Optical scatterometry is a method to measure the size and shape of periodic micro- or nanostructures on surfaces. For this purpose the geometry parameters of the structures are obtained by reproducing experimental measurement results through numerical simulations. We compare the performance of Bayesian optimization to …
Improves Bayesian optimization using Gaussian process Thompson sampling.
problem Global optimization of Gaussian process posterior samples.
method Carefully selects starting points for gradient-based multi-start optimizers, identifies all local optima via univariate global rootfinding, and optimizes the posterior sample.
result Dramatic improvements in overall performance of Bayesian optimization.
Gaussian processes struggle with compositional functions, but deep Gaussian processes can outperform.
problem Gaussian process regression struggles with compositional functions.
method We study information-theoretic lower bounds for posterior contraction rates in Gaussian process regression for a continuous regression model.
result Posterior based on any mean-zero Gaussian process can only recover the truth at a rate strictly slower than the minimax rate for generalized additive functions.
Deep Gaussian Processes improve likelihood-free inference for complex distributions.
problem Limited flexibility of Bayesian Optimization with GPs for multimodal distributions.
method Proposes Deep Gaussian Processes (DGPs) as a surrogate model for likelihood-free inference.
result DGPs outperform GPs on multimodal distributions while maintaining comparable performance on unimodal cases.
A new method uses Gaussian Processes to solve power flow problems with uncertain renewable and load inputs.
problem Solving power flow problems with uncertain renewable and load inputs.
method Non-parametric Bayesian inference-based uncertainty propagation using Gaussian Processes.
result The method provides reasonably accurate solutions with fewer samples and time compared to Monte-Carlo simulations.
Bayesian approach uses Gaussian process for reinforcement learning.
problem Robotic locomotion environments
method Bayesian actor-critic, model-free reinforcement learning with Gaussian process for exploration and policy optimization.
result Gaussian process method outperforms current algorithms in robotic locomotion environments.
In the last five years, the financial industry has been impacted by the emergence of digitalization and machine learning. In this article, we explore two methods that have undergone rapid development in recent years: Gaussian processes and Bayesian optimization. Gaussian processes can be seen as a generalization of Gau…
Simplified DGPs training by fixing inducing inputs to subset of data.
problem Challenging training of deep Gaussian processes.
method Fixed subset of data for inducing inputs, variational sampling.
result Significant reduction in trainable parameters and computation cost without performance degradation.
Efficiently searches through Gaussian process kernels using symbolic representation and Bayesian optimization.
problem Manual selection of kernels in Gaussian processes is complex and computationally expensive.
method Proposes a novel method using symbolic representation and Bayesian optimization to search through a structured kernel space.
result Empirically shows a computationally more efficient way of searching through a discrete kernel space.
GP CC-OPF solves uncertain power grid optimization with Gaussian Process.
problem Uncertainty in power grid operations due to high renewables integration.
method Data-driven Gaussian Process regression for solving non-convex CC-OPF problem.
result Effective economic dispatch optimization in uncertain power grids.
Bayesian optimization on networks using Gaussian process models.
problem Optimizing expensive black-box functions on network structures.
method Developed Bayesian optimization algorithms with Gaussian process surrogates tailored to network geometry.
result Established regret bounds for smooth objective functions and analyzed practical cases.
Bayesian optimization with Gaussian process as surrogate model has been successfully applied to analog circuit synthesis. In the traditional Gaussian process regression model, the kernel functions are defined explicitly. The computational complexity of training is O(N 3 ), and the computation complexity of prediction i…
Proposes a more efficient knot selection method for sparse Gaussian processes.
problem Optimizing marginal likelihood for knot selection leads to suboptimal and inefficient placement of knots.
method Uses Bayesian optimization to propose knots one at a time, avoiding multimodal surface issues.
result Improves both accuracy and speed of knot selection compared to current methods.
Paper proposes no-regret algorithms for private GP bandit optimization.
problem Private Gaussian process bandit optimization.
method Combines uniform kernel approximator with random perturbations for differentially private GP bandit algorithms.
result Provable no-regret algorithms for stationary kernel functions in two DP settings.
Ada-BKB optimizes black-box functions on continuous domains with adaptive discretization.
problem Optimizing functions with continuous domains using Gaussian process optimization.
method Adaptive discretization of the function domain to avoid non-convex optimization costs.
result Ada-BKB algorithm runs in O ( T 2 d e x t e f f 2 ) O(T^2 d_ ext{eff}^2) O ( T 2 d e x t e f f 2 ) , significantly faster than existing methods. A new algorithm uses concavity in Gaussian processes to optimize decisions in bandit problems.
problem Optimizing decisions in sequential problems with context-dependent rewards.
method Proposes a UCB algorithm using a shape-constrained reward function estimator based on a Gaussian Process model with concavity constraints.
result Derives regret bounds for the proposed UCB algorithm.
Optimizes black-box functions with varying costs across multiple sources.
problem Optimizing black-box functions with varying costs across multiple sources.
method Uses Augmented Gaussian Process and Gaussian Process to model fidelity and location-dependent costs, respectively. Uses Confidence Bound acquisition function to select sources and locations.
result The approach significantly outperforms existing methods on Hyperparameters Optimization tasks.
Safe Gaussian Process Bandit Optimization with sub-linear regret bounds.
problem Sequential decision-making under uncertainty and safety constraints.
method Developed SGP-UCB, a safe variant of GP-UCB with modifications to respect safety constraints.
result First sub-linear regret bounds for safe Gaussian Process Bandit Optimization.
A new GP interpolation method for better predictive distributions in ranges of interest.
problem Improving predictive distributions in specific ranges of interest.
method Relaxed Gaussian process interpolation, relaxing interpolation constraints outside ranges of interest.
result Better predictive distributions in ranges of interest, especially in non-stationary cases.
This paper simplifies MTGP derivations for Gaussian processes.
problem Understanding the derivations of Multi-task Gaussian Process formulations and their gradients.
method Friendly derivations of Multi-task Gaussian Process formulations and their gradients.
result Simplified derivations of Multi-task Gaussian Process formulations and gradients.
A new method speeds up Bayesian Optimization for hyperparameter tuning.
problem Efficient hyperparameter tuning for machine learning models.
method Lazy Gaussian Processes approximation to reduce cubic complexity to quadratic.
result Significant speedup in Bayesian Optimization, up to 162x in single node.
We apply numerical methods in combination with finite-difference-time-domain (FDTD) simulations to optimize transmission properties of plasmonic mirror color filters using a multi-objective figure of merit over a five-dimensional parameter space by utilizing novel multi-fidelity Gaussian processes approach. We compare …
A new method for efficient Gaussian process inference using sparse approximations.
problem Scalable and accurate inference for latent Gaussian processes.
method Variational approximation with sparse inverse Cholesky factors and double Kullback-Leibler minimization.
result The proposed method can achieve highly accurate approximations with polylogarithmic time complexity.
RAMBO optimizes multi-regime problems by discovering and modeling distinct energy basins.
problem Multi-regime problems in molecular conformation and drug discovery.
method Dirichlet Process Mixture of Gaussian Processes with adaptive hyperparameters and concentration parameters.
result Consistent improvements over state-of-the-art on multi-regime objectives.
Combines VI and EP for better Gaussian process hyperparameter learning.
problem Improving hyperparameter learning in Gaussian processes for better performance.
method Hybrid training procedure combining Variational Inference (VI) for posterior inference and Expectation Propagation (EP) for hyperparameter learning.
result The hybrid training procedure provides a better learning objective and generalizes better than using only VI or EP.
A new kernel for probability measures based on optimal transport.
problem Efficiently comparing and modeling distributions.
method Kernel over probability measures using regularized optimal transport and Hilbertian embedding.
result The proposed kernel enables Gaussian process modeling on distributions with theoretical and computational advantages.