The study evaluates 15 scalarizing functions in Bayesian multiobjective optimization.
problem Using scalarizing functions in computationally expensive multi- and many-objective optimization.
method 15 scalarizing functions were studied and compared using Gaussian process models and expected improvement as infill criterion.
result Different scalarizing functions have varying performance on benchmark problems with different numbers of objectives.
A new approach for efficient batch multiobjective optimization using Thompson sampling.
problem Inefficient batch multiobjective optimization due to expensive oracles and hard inner optimization.
method Proposes a Thompson sampling approach (qextttPOTS) that chooses Pareto optimal candidates sequentially. result Empirically superior performance compared to classical evolutionary approaches and MOBO.
Paper proposes a robust method for inferring parameters in multiobjective optimization.
problem Uncertainty in hypothetical decision-making problem, data quality, and parameter space.
method Wasserstein distributionally robust approach for inverse multiobjective optimization.
result WRO-IMOP minimizes worst-case expected loss over a Wasserstein ball of distributions.
Bayesian method reduces misclassification errors in ranking Pareto-optimal solutions.
problem Identifying true Pareto-optimal solutions in noisy multiobjective optimization.
method Sequential allocation of extra samples using stochastic kriging to build predictive distributions.
result The proposed method outperforms existing algorithms in reducing misclassification errors.
Hybrid Bayesian MOT uses neural networks to improve model aspects, achieving state-of-the-art performance.
problem Improving multiobject tracking performance across various scenarios.
method Hybrid approach combining neural network enhancements with Bayesian estimation and belief propagation.
result State-of-the-art performance in autonomous driving dataset evaluation.
Refined theorem on linear perturbations with applications in singularity theory and optimization.
problem Linear perturbations and their implications in singularity theory and optimization.
method New perspective of Hausdorff measures for refined transversality theorem.
result Applications in singularity theory and optimization.
Pareto MTL finds optimal solutions for multiple tasks with different trade-offs.
problem Finding a single optimal solution for multiple conflicting tasks.
method Formulate multi-task learning as multiobjective optimization, decompose into subproblems, solve in parallel.
result Generates well-representative Pareto optimal solutions for different trade-offs.
The paper shows how to simplify complex optimization problems into simpler ones.
problem Complex multiobjective optimization problems.
method Proving strongly convex problems are simplicial under certain conditions and demonstrating transformations.
result Strongly convex problems can be simplified into simpler ones via generic linear perturbations.
Bayesian method helps decision-makers find preferred solutions in multi-objective optimization.
problem Identifying preferred solutions from the Pareto set in multi-objective optimization problems.
method Bayesian model to estimate decision-maker's utility function based on pairwise comparisons, guided by a principled elicitation strategy.
result Superior performance in finding high-utility solutions with a small number of queries.
A novel approach finds optimal compromise solutions in many-objective Bayesian optimization.
problem Extending multiobjective Bayesian optimization to many objectives.
method Kalai-Smorodinski solution in copula space, tailored Bayesian optimization algorithm.
result The Kalai-Smorodinski solution is found to be interpretable and insensitive to objective transformations.
The paper tackles lexicographic multiarmed bandit problems with bounded regret.
problem Selecting lexicographic optimal arms in multiobjective bandit problems.
method Defining lexicographic regret, considering prior information, and proposing algorithms for both settings.
result Achieves uniformly bounded regret in time for both prior settings and sublinear gap-free regret in the prior-free case.
New issue found in value-based reinforcement learning for stochastic environments.
problem Value-based reinforcement learning struggles with stochastic state transitions.
method Demonstrated using a multiobjective Markov Decision Process (MOMDP).
result Approaches may converge to Pareto-dominated solutions instead of optimal ones.
Algorithm approximates regularization path for deep neural networks efficiently.
problem Computing the regularization path for high-dimensional deep neural networks.
method Multiobjective continuation method for non-smooth objectives.
result Approximation of the entire Pareto front for regularization path.
Optimizes deep learning models for ocean dynamics using Fourier neural operators.
problem Efficiently training deep learning models for ocean dynamics with optimal hyperparameters.
method Multiobjective hyperparameter optimization with DeepHyper for Fourier neural operators.
result Optimal hyperparameters significantly improved model performance in ocean dynamics forecasting.
A novel neural network approach for optimization problems.
problem Constrained optimization problems.
method Neural Optimization Machine (NOM) using a specially designed NN architecture and training procedure.
result Solves optimization problems efficiently, especially in high-dimensional spaces.
New method optimizes ML models under poisoned data, improving robustness.
problem Vulnerability of ML models to poisoned data attacks.
method Multiobjective bilevel optimization to consider hyperparameter learning and attack effects.
result Current approaches underestimate model robustness and regularization benefits.
Given a set of human's decisions that are observed, inverse optimization has been developed and utilized to infer the underlying decision making problem. The majority of existing studies assumes that the decision making problem is with a single objective function, and attributes data divergence to noises, errors or bou…
Paper tackles end-to-end training of complex neural networks using DIP method.
problem Training complex heterogeneous neural network models end-to-end.
method Deep Innovation Protection (DIP) method using multiobjective optimization.
result End-to-end training of complex heterogeneous neural network models is possible.
Selecting the best policy to keep the balance between what a company holds in cash and what is placed in alternative investments is by no means straightforward. We here introduce PyCaMa, a Python module for multiobjective cash management based on linear programming that allows to derive optimal policies for cash manage…
The paper simplifies strongly convex problems to simplicial structures.
problem Strongly convex problems with Cr smoothness. method Generic linear perturbations and singularity theory.
result Strongly convex C1 problems are C0 simplicial. A new framework enables real-time task trade-off control.
problem Conflict between multiple related tasks in a fixed model capacity.
method Formulates MTL as a preference-conditioned multiobjective optimization problem; uses a hypernetwork-based neural network.
result A single model can handle different trade-off preferences among multiple tasks.
Regularisation improves ML classifier stability against poisoning attacks.
problem Poisoning attacks degrade ML algorithms' performance; current attacks ignore hyperparameters.
method Proposed a multiobjective bilevel optimisation problem to consider hyperparameter effects.
result L2 regularisation enhances learning algorithm stability and mitigates poisoning attacks. The authors define a class of functions on Riemannian manifolds, which is called geodesic semilocal E-preinvex functions, as a generalization of geodesic semilocal E-convex and geodesic semi E-preinvex functions and some of its properties are established. Furthermore, a nonlinear fractional multiobjective programming i…
Three approaches learn personalized treatment policies for UTI patients.
problem Learning optimal treatment policies in multiobjective settings with fully observed outcomes.
method Indirect and direct approaches using predictive models and without intermediate models.
result All approaches outperform clinicians in achieving better performance on all outcomes and trade-offs.
We introduce COCO, an open source platform for Comparing Continuous Optimizers in a black-box setting. COCO aims at automatizing the tedious and repetitive task of benchmarking numerical optimization algorithms to the greatest possible extent. The platform and the underlying methodology allow to benchmark in the same f…
New method optimizes PCA for better prediction and variance.
problem Improve PCA for better prediction and variance.
method Jointly optimize prediction error and variance explained.
result Our method outperforms existing approaches in both prediction and variance.
Strong geodesic convex function and strong monotone vector field of order m on Riemannian manifolds have been established. A characterization of strong geodesic convex function of order m for the continuously differentiable functions has been discussed. The relation between the solution of a new variational inequal…
Pareto optimal centralized risk sharing with multiple agents
problem Centralized risk sharing with endogenous prices
method Inclusive and fair Pareto optimality
result Equivalence between inclusive and fair Pareto optimality and balanced sequential optimization
Portfolio managers are typically constrained by turnover limits, minimum and maximum stock positions, cardinality, a target market capitalization and sometimes the need to hew to a style (such as growth or value). In addition, portfolio managers often use multifactor stock models to choose stocks based upon their respe…
A common practice in most of deep convolutional neural architectures is to employ fully-connected layers followed by Softmax activation to minimize cross-entropy loss for the sake of classification. Recent studies show that substitution or addition of the Softmax objective to the cost functions of support vector machin…
In this paper we introduce a new classification algorithm called Optimization of Distributions Differences (ODD). The algorithm aims to find a transformation from the feature space to a new space where the instances in the same class are as close as possible to one another while the gravity centers of these classes are…
Bayesian optimization with cost-awareness using Gittins index.
problem Optimizing unknown functions with limited data evaluations and costs.
method Developed a connection between cost-aware Bayesian optimization and the Pandora's Box problem, using the Gittins index as an acquisition function.
result The Gittins index-based acquisition function performs well in cost-aware Bayesian optimization, especially in high dimensions.
Topological Bayesian Optimization finds optimal structures using topological data.
problem Optimizing complex structured data like material or neural network structures.
method Extract topological information from structures using persistent homology, apply Bayesian optimization with kernels for persistence diagrams.
result Topological information improves search efficiency for optimal structures.
Proposes a generalized XGBoost method for nonconvex loss functions.
problem Limited to convex loss functions in XGBoost.
method Extends XGBoost to use nonconvex loss functions and multivariate loss functions.
result Generalized XGBoost method can model multiple parameters in various distributions.
SCoreBO improves Bayesian optimization by learning hyperparameters and self-correcting.
problem Efficient hyperparameter tuning for Gaussian process models in Bayesian optimization.
method Introduces SAL and SCoreBO, which prioritize hyperparameter learning and perform simultaneous optimization and learning.
result SCoreBO outperforms state-of-the-art methods on traditional benchmarks and atypical tasks.
New method for fully distributed Bayesian optimization with high parallelism.
problem Scalability and parallelization in Bayesian optimization.
method Formulated Bayesian optimization as a partially observable Markov decision process and applied stochastic policies.
result Demonstrated superior performance of the proposed method in various benchmarks and applications.
Bayesian optimization finds best hyperparameters for deep learning models.
problem Finding optimal hyperparameters in high-dimensional space.
method Bayesian optimization, Gaussian processes, and adaptive experimentation.
result Ax, BoTorch, and GPyTorch provide a powerful and simple framework for hyperparameter optimization.
Bayesian optimization uses shared latent variables for multiple systems.
problem Optimizing systems with limited data and unknown relationships.
method Shared latent variables, Bayesian inference, probabilistic metamodel.
result Performance improvement in zero-, one-, and few-shot settings.
Bayesian optimization sped up with scalable Gaussian processes.
problem Optimizing functions with derivative information and large datasets.
method Combines derivative acceleration and scalable Gaussian process models.
result Significant speedup in optimization convergence for large datasets.
Bayesian optimization for multi-objective and multi-point search.
problem Efficiently optimize unknown multi-objective functions with high evaluation costs.
method Proposes a Bayesian optimization algorithm that considers both multi-objective and multi-point search problems, using an acquisition function and an efficient gradient estimation method.
result Shows comparable or superior performance to heuristic methods via numerical experiments.
When hyperparameter optimization of a machine learning algorithm is repeated for multiple datasets it is possible to transfer knowledge to an optimization run on a new dataset. We develop a new hyperparameter-free ensemble model for Bayesian optimization that is a generalization of two existing transfer learning extens…
Two batch Bayesian optimization algorithms with regret guarantees.
problem Efficiently optimizing multiple objectives in batch feedback settings.
method Gaussian process upper confidence bound and Thompson sampling approaches.
result Frequentist regret guarantees and numerical results.
A fast Bayesian optimization method using threshold-guided marginal likelihood maximization.
problem Efficiently optimizing models with Gaussian process regression.
method Guided marginal likelihood maximization with a pre-defined threshold to reduce model selection steps.
result Significantly reduces execution time without compromising optimization quality.
A heuristic method refines search space for Bayesian optimization with low budget.
problem Efficiently optimize objective function with limited evaluation budget.
method Divide search space into promising regions to refine Bayesian optimization.
result Bayesian optimization with proposed method outperforms standard Bayesian optimization.
New method to assess uncertainty in Bayesian optimization.
problem Uncertainty quantification in Bayesian optimization.
method Constructing confidence regions of the maximum point or value of the objective function.
result Unified uncertainty quantification framework for various sampling policies and stopping criteria.
Bayesian optimization simplifies bioprocess engineering experiments.
problem Complex biological systems and experimental uncertainty.
method Adapts classical Bayesian optimization for bioprocess engineering.
result Provides accessible introduction to Bayesian optimization for practitioners.
Unified Bayesian Optimization framework for model selection balancing effectiveness and training efficiency.
problem Balancing model effectiveness and training efficiency in machine learning model selection.
method Proposes a unified Bayesian Optimization framework to jointly optimize model effectiveness and training efficiency.
result Models selected using the proposed framework significantly improve training efficiency while maintaining strong effectiveness.
Proposes OBS, a method to adaptively combine Bayesian models online.
problem Learning optimal combinations of Bayesian models in online learning.
method Empirical Bayes lens, Online Bayesian Stacking (OBS).
result Establishes a novel connection between OBS and portfolio selection.