The paper shows how to simplify complex optimization problems into simpler ones.
problem Complex multiobjective optimization problems.
method Proving strongly convex problems are simplicial under certain conditions and demonstrating transformations.
result Strongly convex problems can be simplified into simpler ones via generic linear perturbations.
The paper simplifies strongly convex problems to simplicial structures.
problem Strongly convex problems with Cr smoothness. method Generic linear perturbations and singularity theory.
result Strongly convex C1 problems are C0 simplicial. We propose a strategy for approximating Pareto optimal sets based on the global analysis framework proposed by Smale (Dynamical systems, New York, 1973, pp. 531-544). The method highlights and exploits the underlying manifold structure of the Pareto sets, approximating Pareto optima by means of simplicial complexes. Th…
Paper proposes Adaptive Pareto Exploration for identifying Pareto optimal arms in multi-objective scenarios.
problem Identifying Pareto optimal arms in multi-objective scenarios with relaxed constraints.
method Adaptive Pareto Exploration strategy for different relaxations of Pareto Set Identification.
result Reduction in sample complexity when identifying at most k Pareto optimal arms.
This paper develops a method to approximate the whole Pareto set for expensive multi-objective optimization.
problem Finding an approximate Pareto front with limited expensive evaluations.
method A novel learning-based method to approximate the whole Pareto set for multi-objective Bayesian optimization (MOBO).
result The method approximates the whole Pareto set, not just a finite set, for MOBO.
Study on Pareto optimality in multi-objective bandit problems.
problem Pareto optimality in multi-objective multi-armed bandit problems.
method Formulated adversarial multi-objective multi-armed bandit, defined Pareto regrets, presented algorithms, established upper and lower bounds.
result New algorithms are optimal in adversarial settings and nearly optimal in stochastic settings.
A new method for diverse Pareto solutions in multi-objective learning.
problem Maximizing diversity while maximizing hypervolume in Pareto solutions.
method Annealed Stein Variational Gradient Descent (SVGD) with diverse gradient directions.
result SVH-MOL achieves superior performance in multi-objective and multi-task learning.
A-GPS learns to generate Pareto sets efficiently with user preferences.
problem Online discrete multi-objective optimization with user preferences.
method Generative model with class probability estimator (CPE) for non-dominance and preference alignment.
result Amortized generative model for efficient Pareto set approximation.
New method generates continuous Pareto sets for multi-task learning.
problem Challenges in finding optimal solutions for correlated multi-task learning problems.
method Efficiently generates locally continuous Pareto sets and fronts in multi-objective optimization problems.
result Demonstrates continuous analysis of Pareto optimal solutions in machine learning problems.
The paper tackles identifying Pareto Set with constraints using bandit feedback.
problem Identifying the Pareto Set under feasibility constraints in a multivariate bandit setting.
method Fixed-confidence identification algorithm that outperforms existing methods.
result The sample complexity of the proposed algorithm is near-optimal.
Pareto MTL finds optimal solutions for multiple tasks with different trade-offs.
problem Finding a single optimal solution for multiple conflicting tasks.
method Formulate multi-task learning as multiobjective optimization, decompose into subproblems, solve in parallel.
result Generates well-representative Pareto optimal solutions for different trade-offs.
New algorithms identify Pareto optimal sets in multi-objective bandit problems.
problem Identifying Pareto optimal sets in multi-objective bandit problems.
method Empirical Gap Elimination (EGE) algorithms combining hardness estimation and elimination schemes.
result Two EGE algorithms have exponentially decaying error probabilities with budget.
Generalizes risk sharing models to a continuum of agents.
problem Risk sharing among a large number of heterogeneous agents.
method Modeling agents as points in a measure space, using risk measures on a probability space, and deriving dual representations.
result Explicit formulas for specific risk measures (entropic and expected shortfall) and applications to Pareto efficiency.
This paper solves aggregation of Pareto optimal models by using Bayesian priors and weighted averaging.
problem How to rationally aggregate Pareto optimal models while preserving Pareto efficiency.
method Four logical steps: 1) Bayesian models, 2) Prior as preference ranking, 3) Consistent aggregation, 4) Weighted average of priors.
result All rational/consistent aggregation rules follow a generalized hierarchical Bayesian model.
Diversification improves profits for heavy-tailed investments.
problem Investment portfolios of Pareto-distributed returns.
method Stochastic dominance and majorization order.
result Diversification increases first-order stochastic dominance for heavy-tailed returns.
Proposes a new way to represent and analyze Pareto front surfaces.
problem Identifying and analyzing Pareto front surfaces in multi-objective optimization.
method Parameterizes Pareto front surfaces using polar coordinates and scalar-valued length functions.
result Derives statistics of Pareto front surfaces and develops visualisation techniques.
Algorithm identifies Pareto optimal designs efficiently for noisy, multi-objective functions.
problem Optimizing multi-objective functions with noisy data and large design spaces.
method Adaptive discretization and tree-based approach to identify Pareto optimal designs.
result Algorithm identifies Pareto optimal designs with fewer evaluations than exhaustive search.
Paper proves Pareto efficient insurance for multiple entities.
problem Optimizing insurance for multiple policyholders and insurers.
method Sum-minimization characterization and pairwise implementability analysis.
result Characterization of Pareto efficient insurance arrangements.
PALS extends PAL for optimizing stochastic simulators efficiently.
problem Optimizing stochastic simulators with high output variance and expensive evaluations.
method Bayesian optimization with probabilistic models, extending PAL for stochastic settings.
result PALS outperforms other methods in optimizing stochastic simulators.
PFES uses entropy of Pareto-frontier for multi-objective Bayesian optimization.
problem Bayesian optimization for multi-objective problems, especially trade-off among objectives.
method Pareto-frontier entropy search (PFES) incorporating trade-off relation.
result PFES effectively incorporates dependency among objectives conditioned on Pareto-frontier.
New ABC method improves Bézier simplex fitting for noisy data.
problem Overfitting in Bézier simplex fitting when sample points are not on the Pareto set.
method Extended Bézier simplex model to a probabilistic one and proposed a new learning algorithm based on approximate Bayesian computation (ABC) with Wasserstein distance.
result The new algorithm converges on a finite sample and outperforms deterministic methods on noisy instances.
New method finds exact Pareto front for MO-MDPs efficiently.
problem Finding the exact Pareto front for MO-MDPs is challenging.
method Investigates geometric structure, develops efficient algorithm.
result Pareto front is on boundary of convex polytope of deterministic policies.
New method for identifying best designs in vector optimization with uncertain feedback.
problem Optimizing vector-valued outcomes with uncertain preferences.
method Stochastic bandit feedback, polyhedral ordering cone, (ε,δ)-PAC Pareto set identification. result Sample complexity characterized and matched by the naïve elimination algorithm.
Algorithm identifies Pareto set in bandits with contaminated feedback.
problem Identifying Pareto set in multi-objective bandits with adversarial contamination.
method Sample median-based multi-objective adaptive elimination algorithm.
result Sample complexity bound that depends on contamination probability.
Paper proposes PSIPS for identifying Pareto set with correlated objectives.
problem Identifying the best answer among items with multiple conflicting metrics.
method Posterior sampling in stopping and sampling rules for structure and correlation.
result PSIPS is asymptotically optimal and demonstrates good empirical performance.
SVH-PSL uses Stein Variational Gradient Descent and Hypernetworks to improve Pareto set learning for expensive MOO.
problem Fragmented surrogate models and pseudo-local optima in expensive multi-objective optimization problems.
method SVH-PSL integrates Stein Variational Gradient Descent (SVGD) with Hypernetworks to address fragmentation and pseudo-local optima.
result SVH-PSL significantly improves the quality of the learned Pareto set, offering a promising solution for expensive MOO.
Unified framework for medical image segmentation using active and semi-supervised learning.
problem Training medical image segmentation models with limited annotated data.
method RegAL, a unified active semi-supervised framework that optimizes sample acquisition and unlabeled data utilization.
result RegAL consistently outperforms state-of-the-art methods across various datasets and metrics under extreme annotation scarcity.
The paper proposes a new method to learn choice functions using Pareto-embeddings.
problem Learning subset choices from feature vectors.
method Embedding choice alternatives into a higher-dimensional utility space and identifying choice sets with Pareto-optimal points. Minimizing a differentiable loss function.
result The feasibility of learning a Pareto-embedding demonstrated on benchmark datasets.
This work fills the gap in understanding multi-objective learning generalization.
problem Lack of statistical learning theory insights into multi-objective learning generalization.
method Established generalization bounds and excess bounds for multi-objective learning.
result Showed that all Pareto-optimal solutions can be approximated by empirically Pareto-optimal ones, but not vice versa.
Algorithm identifies Pareto front in multi-objective bandits efficiently.
problem Sequentially learning the Pareto front in multi-objective bandits.
method Efficient algorithm achieving optimal sample complexity.
result Correct answer with high probability in minimal rounds.
The paper studies the convergence of SAA for systemic risk measures.
problem Theoretical convergence of SAA for set-valued systemic risk measures.
method General theory and specific case study with mixed-integer programming formulations.
result Theoretical convergence results for SAA under Wijsman and Hausdorff topologies.
In this paper we propose the multi-objective contextual bandit problem with similarity information. This problem extends the classical contextual bandit problem with similarity information by introducing multiple and possibly conflicting objectives. Since the best arm in each objective can be different given the contex…
Study dynamic Pareto-optimal allocations in multi-period economies with time-consistent risk measures.
problem Optimal allocation in multi-period pure-exchange economies with stochastic endowments and time-consistent risk measures.
method Introduced dynamic Pareto-optimal allocation processes and derived recursive and comonotone improvement theorems.
result Dynamic Pareto-optimal allocation processes can be constructed recursively and are comonotone.
No communication allows optimal instance-dependent regret guarantees in multi-player bandits.
problem Achieving optimal instance-dependent regret in multi-player multi-armed bandits without communication.
method Characterization of Pareto optimal trade-offs and development of an algorithm.
result Achieving optimal instance-dependent regret requires strict sub-optimality in other regimes.
Algorithm identifies Pareto front using multiple context directions and reuses exploration samples.
problem Identifying a set of arms with undominated mean reward vectors in linear bandits.
method Proposes a new estimator that updates estimates along multiple context directions and reuses exploration samples.
result Optimal sample complexity and logarithmic regret compared to optimal algorithms.
New method finds all Nash equilibria via vector optimization.
problem Finding all Nash equilibria in games.
method Formulate vector optimization problem to find Pareto optimal solutions.
result Characterize set of all Nash equilibria as Pareto optimal solutions.
Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the evaluation of the functions in question are expensive. Traditional methods for mult…
Optimal algorithms identify non-dominated arms in multi-output linear bandit models.
problem Identifying the Pareto Set in multi-output linear bandit models.
method Design-based algorithms for Pareto Set Identification (PSI) in a structured multi-output linear bandit model.
result Nearly optimal guarantees in both fixed-budget and fixed-confidence settings.
Optimizing nonlinear systems involving expensive computer experiments with regard to conflicting objectives is a common challenge. When the number of experiments is severely restricted and/or when the number of objectives increases, uncovering the whole set of Pareto optimal solutions is out of reach, even for surrogat…
Random variables of the generalized Pareto distribution, can be transformed to that of the Pareto distribution. Explicit expressions exist for the maximum likelihood estimators of the parameters of the Pareto distribution. The performance of the estimation of the shape parameter of generalized Pareto distributed using …
In order to study the phenomenon in detail that income distribution follows Pareto law, we analyze the database of high income companies in Japan. We find a quantitative relation between the average capital of the companies and the Pareto index. The larger the average capital becomes, the smaller the Pareto index becom…
The paper analyzes reinsurance strategies in peer-to-peer insurance schemes.
problem Strategic interaction between plan managers and reinsurers in P2P insurance.
method Develops two game-theoretic contract designs: Pareto and Bowley designs, deriving optimal contracts and analyzing their welfare effects.
result The Bowley design yields a unique optimal contract, while the Pareto design allows for multiple Pareto-optimal contracts.
We solve a portfolio selection problem with four objectives, finding convex scalarizations for part of the Pareto front.
problem Portfolio selection with four objectives: mean, variance, skewness, and kurtosis.
method Linearly scalarize MVSK objectives into a convex polynomial Fλ over the probability simplex, compute optimizers for each λ. result Identify a set of hyper-parameters for which the scalarization is convex, allowing computation of part of the Pareto front.
Pareto optimal centralized risk sharing with multiple agents
problem Centralized risk sharing with endogenous prices
method Inclusive and fair Pareto optimality
result Equivalence between inclusive and fair Pareto optimality and balanced sequential optimization
This paper improves fraud prevention rule sets in fintech by generating diverse rules and finding Pareto-optimal subsets.
problem Improving the quality and flexibility of fraud prevention rule sets in fintech.
method Introducing SpectralRules for generating diverse rules, and PORS for finding Pareto-optimal subsets.
result SpectralRules generates diverse rules that improve the quality of final rule subsets.
New Bayesian method improves Pareto front estimation in multitask finetuning.
problem Efficiently estimating Pareto fronts for multitask finetuning.
method Variational Model Merging using non-Gaussian posteriors.
result More flexible posteriors lead to better Pareto front estimates.
Agents prefer non-diversification in markets with extreme losses.
problem Optimal risk allocation and equilibria in markets with extremely heavy-tailed losses.
method Analysis of super-Pareto loss distributions and stochastic dominance.
result Non-diversification is preferred in markets with super-Pareto losses.
Pareto Testing optimizes model performance under multiple constraints.
problem Optimizing machine learning models with multiple conflicting objectives.
method Two-stage process combining optimization and statistical testing.
result Models can be configured to satisfy multiple statistical guarantees and objectives.