This paper develops a method to approximate the whole Pareto set for expensive multi-objective optimization.
problem Finding an approximate Pareto front with limited expensive evaluations.
method A novel learning-based method to approximate the whole Pareto set for multi-objective Bayesian optimization (MOBO).
result The method approximates the whole Pareto set, not just a finite set, for MOBO.
A new method for diverse Pareto solutions in multi-objective learning.
problem Maximizing diversity while maximizing hypervolume in Pareto solutions.
method Annealed Stein Variational Gradient Descent (SVGD) with diverse gradient directions.
result SVH-MOL achieves superior performance in multi-objective and multi-task learning.
New method generates continuous Pareto sets for multi-task learning.
problem Challenges in finding optimal solutions for correlated multi-task learning problems.
method Efficiently generates locally continuous Pareto sets and fronts in multi-objective optimization problems.
result Demonstrates continuous analysis of Pareto optimal solutions in machine learning problems.
Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other. Recently, a novel method is proposed to find one single Pareto optimal solution with…
A-GPS learns to generate Pareto sets efficiently with user preferences.
problem Online discrete multi-objective optimization with user preferences.
method Generative model with class probability estimator (CPE) for non-dominance and preference alignment.
result Amortized generative model for efficient Pareto set approximation.
PALS extends PAL for optimizing stochastic simulators efficiently.
problem Optimizing stochastic simulators with high output variance and expensive evaluations.
method Bayesian optimization with probabilistic models, extending PAL for stochastic settings.
result PALS outperforms other methods in optimizing stochastic simulators.
This work fills the gap in understanding multi-objective learning generalization.
problem Lack of statistical learning theory insights into multi-objective learning generalization.
method Established generalization bounds and excess bounds for multi-objective learning.
result Showed that all Pareto-optimal solutions can be approximated by empirically Pareto-optimal ones, but not vice versa.
We propose a strategy for approximating Pareto optimal sets based on the global analysis framework proposed by Smale (Dynamical systems, New York, 1973, pp. 531-544). The method highlights and exploits the underlying manifold structure of the Pareto sets, approximating Pareto optima by means of simplicial complexes. Th…
The paper proposes a new method to learn choice functions using Pareto-embeddings.
problem Learning subset choices from feature vectors.
method Embedding choice alternatives into a higher-dimensional utility space and identifying choice sets with Pareto-optimal points. Minimizing a differentiable loss function.
result The feasibility of learning a Pareto-embedding demonstrated on benchmark datasets.
SVH-PSL uses Stein Variational Gradient Descent and Hypernetworks to improve Pareto set learning for expensive MOO.
problem Fragmented surrogate models and pseudo-local optima in expensive multi-objective optimization problems.
method SVH-PSL integrates Stein Variational Gradient Descent (SVGD) with Hypernetworks to address fragmentation and pseudo-local optima.
result SVH-PSL significantly improves the quality of the learned Pareto set, offering a promising solution for expensive MOO.
Paper proposes Adaptive Pareto Exploration for identifying Pareto optimal arms in multi-objective scenarios.
problem Identifying Pareto optimal arms in multi-objective scenarios with relaxed constraints.
method Adaptive Pareto Exploration strategy for different relaxations of Pareto Set Identification.
result Reduction in sample complexity when identifying at most k Pareto optimal arms.
Algorithm identifies Pareto front in multi-objective bandits efficiently.
problem Sequentially learning the Pareto front in multi-objective bandits.
method Efficient algorithm achieving optimal sample complexity.
result Correct answer with high probability in minimal rounds.
Algorithm identifies Pareto optimal designs efficiently for noisy, multi-objective functions.
problem Optimizing multi-objective functions with noisy data and large design spaces.
method Adaptive discretization and tree-based approach to identify Pareto optimal designs.
result Algorithm identifies Pareto optimal designs with fewer evaluations than exhaustive search.
Study on Pareto optimality in multi-objective bandit problems.
problem Pareto optimality in multi-objective multi-armed bandit problems.
method Formulated adversarial multi-objective multi-armed bandit, defined Pareto regrets, presented algorithms, established upper and lower bounds.
result New algorithms are optimal in adversarial settings and nearly optimal in stochastic settings.
New ABC method improves Bézier simplex fitting for noisy data.
problem Overfitting in Bézier simplex fitting when sample points are not on the Pareto set.
method Extended Bézier simplex model to a probabilistic one and proposed a new learning algorithm based on approximate Bayesian computation (ABC) with Wasserstein distance.
result The new algorithm converges on a finite sample and outperforms deterministic methods on noisy instances.
In this paper we propose the multi-objective contextual bandit problem with similarity information. This problem extends the classical contextual bandit problem with similarity information by introducing multiple and possibly conflicting objectives. Since the best arm in each objective can be different given the contex…
Algorithm identifies Pareto front using multiple context directions and reuses exploration samples.
problem Identifying a set of arms with undominated mean reward vectors in linear bandits.
method Proposes a new estimator that updates estimates along multiple context directions and reuses exploration samples.
result Optimal sample complexity and logarithmic regret compared to optimal algorithms.
The paper tackles identifying Pareto Set with constraints using bandit feedback.
problem Identifying the Pareto Set under feasibility constraints in a multivariate bandit setting.
method Fixed-confidence identification algorithm that outperforms existing methods.
result The sample complexity of the proposed algorithm is near-optimal.
New algorithms identify Pareto optimal sets in multi-objective bandit problems.
problem Identifying Pareto optimal sets in multi-objective bandit problems.
method Empirical Gap Elimination (EGE) algorithms combining hardness estimation and elimination schemes.
result Two EGE algorithms have exponentially decaying error probabilities with budget.
This paper solves aggregation of Pareto optimal models by using Bayesian priors and weighted averaging.
problem How to rationally aggregate Pareto optimal models while preserving Pareto efficiency.
method Four logical steps: 1) Bayesian models, 2) Prior as preference ranking, 3) Consistent aggregation, 4) Weighted average of priors.
result All rational/consistent aggregation rules follow a generalized hierarchical Bayesian model.
Diversification improves profits for heavy-tailed investments.
problem Investment portfolios of Pareto-distributed returns.
method Stochastic dominance and majorization order.
result Diversification increases first-order stochastic dominance for heavy-tailed returns.
Proposes a new way to represent and analyze Pareto front surfaces.
problem Identifying and analyzing Pareto front surfaces in multi-objective optimization.
method Parameterizes Pareto front surfaces using polar coordinates and scalar-valued length functions.
result Derives statistics of Pareto front surfaces and develops visualisation techniques.
This paper surveys gradient-based multi-objective deep learning methods.
problem Balancing multiple conflicting objectives in deep learning models.
method Gradient-based techniques adapted from Multi-Objective Optimization.
result Comprehensive survey of gradient-based multi-objective deep learning algorithms.
Paper proves Pareto efficient insurance for multiple entities.
problem Optimizing insurance for multiple policyholders and insurers.
method Sum-minimization characterization and pairwise implementability analysis.
result Characterization of Pareto efficient insurance arrangements.
New method finds exact Pareto front for MO-MDPs efficiently.
problem Finding the exact Pareto front for MO-MDPs is challenging.
method Investigates geometric structure, develops efficient algorithm.
result Pareto front is on boundary of convex polytope of deterministic policies.
Algorithm identifies Pareto set in bandits with contaminated feedback.
problem Identifying Pareto set in multi-objective bandits with adversarial contamination.
method Sample median-based multi-objective adaptive elimination algorithm.
result Sample complexity bound that depends on contamination probability.
New method for identifying best designs in vector optimization with uncertain feedback.
problem Optimizing vector-valued outcomes with uncertain preferences.
method Stochastic bandit feedback, polyhedral ordering cone, (ε,δ)-PAC Pareto set identification. result Sample complexity characterized and matched by the naïve elimination algorithm.
Active learning improves SR by proposing experiments in data-limited settings.
problem Efficiently gathering data for symbolic regression with physical constraints.
method Query by committee using the Pareto frontier of equations, with physical constraints.
result Reduces data required for SR and achieves state-of-the-art results.
Paper proposes PSIPS for identifying Pareto set with correlated objectives.
problem Identifying the best answer among items with multiple conflicting metrics.
method Posterior sampling in stopping and sampling rules for structure and correlation.
result PSIPS is asymptotically optimal and demonstrates good empirical performance.
The paper tackles the trade-off between fairness and accuracy in machine learning models.
problem Ensuring fairness in machine learning often reduces model accuracy.
method The paper introduces formal tools for reconciling the fairness-accuracy tension using Pareto optimality from multi-objective optimization.
result The Chebyshev scalarization scheme is superior for finding Pareto optimal solutions compared to the linear scalarization scheme.
A multiobjective optimization problem is simplicial if the Pareto set and front are homeomorphic to a simplex and, under the homeomorphisms, each face of the simplex corresponds to the Pareto set and front of a subproblem. In this paper, we show that strongly convex problems are simplicial under a mild assumption on th…
A multiobjective optimization problem is Cr simplicial if the Pareto set and the Pareto front are Cr diffeomorphic to a simplex and, under the Cr diffeomorphisms, each face of the simplex corresponds to the Pareto set and the Pareto front of a subproblem, where 0≤r≤∞. In the paper titled "Topolo…
Pareto Testing optimizes model performance under multiple constraints.
problem Optimizing machine learning models with multiple conflicting objectives.
method Two-stage process combining optimization and statistical testing.
result Models can be configured to satisfy multiple statistical guarantees and objectives.
Proposes MOGFNs for generating diverse Pareto optimal solutions in multi-objective optimization.
problem Generating diverse candidates in multi-objective optimization with conflicting objectives.
method Introduces MOGFNs based on GFlowNets, with two variants: MOGFN-PC and MOGFN-AL.
result Improved candidate diversity compared to existing methods.
Proposes Pareto efficient fairness for supervised learning models.
problem Ensuring fairness in machine learning models without sacrificing accuracy.
method Formulates a bilevel optimization problem to find Pareto efficient classifiers.
result Guaranteed solution on Pareto frontier for convex and non-convex objectives.
This paper analyzes MORL and proposes efficient algorithms to learn Pareto optimal policies.
problem Understanding and efficiently learning Pareto optimal policies in multi-objective reinforcement learning.
method Systematic analysis of optimization targets, reformulation of Tchebycheff scalarization, online UCB-based algorithm, preference-free framework.
result Identification of Tchebycheff scalarization as a favorable method and efficient algorithms for learning Pareto optimal policies.
This paper studies an entropy-based multi-objective Bayesian optimization (MBO). The entropy search is successful approach to Bayesian optimization. However, for MBO, existing entropy-based methods ignore trade-off among objectives or introduce unreliable approximations. We propose a novel entropy-based MBO called Pare…
Study dynamic Pareto-optimal allocations in multi-period economies with time-consistent risk measures.
problem Optimal allocation in multi-period pure-exchange economies with stochastic endowments and time-consistent risk measures.
method Introduced dynamic Pareto-optimal allocation processes and derived recursive and comonotone improvement theorems.
result Dynamic Pareto-optimal allocation processes can be constructed recursively and are comonotone.
We identify and optimize the fairness-accuracy tradeoff through TAF Curves and FAUC metrics.
problem Balancing fairness and accuracy in machine learning models for high-stakes decisions.
method Developed TAF Curves and FAUC metric to quantify the tradeoff, and introduced FairStacks framework to expand the Pareto frontier.
result FairStacks framework expands the empirical Pareto frontier and improves the FAUC for model ensembles.
BADR framework optimizes fairness metrics efficiently.
problem Fairness-inefficient models in machine learning.
method Bilevel Adaptive Rescalarisation procedure.
result BADR framework recovers optimal Pareto-efficient models.
New method finds all Nash equilibria via vector optimization.
problem Finding all Nash equilibria in games.
method Formulate vector optimization problem to find Pareto optimal solutions.
result Characterize set of all Nash equilibria as Pareto optimal solutions.
This work improves cost-aware Bayesian optimization by introducing Pareto-efficient acquisition functions.
problem Cost variability in hyperparameter evaluations affects the efficiency of Bayesian optimization.
method Reformulated cost-aware Bayesian optimization as Pareto efficiency, proposing a novel Pareto-efficient expected improvement.
result Pareto-efficient acquisition functions significantly outperform previous solutions, providing finer control over cost-accuracy trade-offs.
Paper tackles entity matching over multi-source data, optimizing alignment and mitigating negative transfer.
problem Learning effective entity matching models over multi-source large-scale data with relaxed assumptions.
method Proposes a Relaxed Multi-source Large-scale Entity-matching (RMLE) problem and Incentive Compatible Pareto Alignment (ICPA) method.
result Optimized cross-source alignments and mitigated negative transfer, improving entity matching accuracy.
Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the evaluation of the functions in question are expensive. Traditional methods for mult…
Optimization of conflicting functions is of paramount importance in decision making, and real world applications frequently involve data that is uncertain or unknown, resulting in multi-objective optimization (MOO) problems of stochastic type. We study the stochastic multi-gradient (SMG) method, seen as an extension of…
Optimal algorithms identify non-dominated arms in multi-output linear bandit models.
problem Identifying the Pareto Set in multi-output linear bandit models.
method Design-based algorithms for Pareto Set Identification (PSI) in a structured multi-output linear bandit model.
result Nearly optimal guarantees in both fixed-budget and fixed-confidence settings.
A new method for faster multi-objective optimization by evaluating objectives separately.
problem Finding the Pareto front of trade-offs between multiple objectives efficiently.
method Knowledge Gradient with decoupled evaluations, accounting for different costs.
result The method significantly outperforms existing approaches in terms of evaluation cost.
Random variables of the generalized Pareto distribution, can be transformed to that of the Pareto distribution. Explicit expressions exist for the maximum likelihood estimators of the parameters of the Pareto distribution. The performance of the estimation of the shape parameter of generalized Pareto distributed using …