Paper proposes EMO-based AE generation for black-box settings.
problem Designing robust adversarial examples for black-box models.
method Evolutionary Multi-objective Optimization (EMO) for generating various types of adversarial examples.
result EMO-based method generates AEs that are robust and applicable to high-resolution images.
Generative model generates images with multiple object classes.
problem Generating images with multiple object classes.
method Conditional Deep Convolutional GAN architecture, stabilized against collapse.
result System generates diverse samples with inter-object relationships.
Develops a framework for multi-objective learning in diffusion models with limited labeled data.
problem Achieving good trade-offs in multi-objective learning with diffusion models requires a generalist model class with larger capacity than individual tasks.
method Proposes a two-stage training procedure: first fitting specialist models from limited paired data, then distilling them into a generalist model.
result Establishes generalization bounds showing the number of paired samples depends only on specialist model complexity.
Deep generative models (DGMs) have shown promise in image generation. However, most of the existing work learn the model by simply optimizing a divergence between the marginal distributions of the model and the data, and often fail to capture the rich structures and relations in multi-object images. Human knowledge is …
In order to decode the human brain, Multivariate Pattern (MVP) classification generates cognitive models by using functional Magnetic Resonance Imaging (fMRI) datasets. As a standard pipeline in the MVP analysis, brain patterns in multi-subject fMRI dataset must be mapped to a shared space and then a classification mod…
The paper explores a Multi-Objective RL approach for trading that generalizes reward functions.
problem Improving performance in single-asset trading through adaptive reward functions.
method Developed a Multi-Objective Deep Reinforcement Learning algorithm to generalize reward functions and discount factors.
result The Multi-Objective algorithm demonstrates increased predictive stability and better performance in sparse reward scenarios.
Nonnegative matrix factorization (NMF) is a powerful class of feature extraction techniques that has been successfully applied in many fields, namely in signal and image processing. Current NMF techniques have been limited to a single-objective problem in either its linear or nonlinear kernel-based formulation. In this…
Pessimistic estimator improves multi-objective policy optimization.
problem Optimizing multi-objective policies from existing data.
method Pessimistic estimator based on inverse propensity scores (IPS).
result Pessimistic estimator outperforms naive IPS estimator in theory and experiments.
This work fills the gap in understanding multi-objective learning generalization.
problem Lack of statistical learning theory insights into multi-objective learning generalization.
method Established generalization bounds and excess bounds for multi-objective learning.
result Showed that all Pareto-optimal solutions can be approximated by empirically Pareto-optimal ones, but not vice versa.
Study KKT conditions for multi-objective optimization on Hadamard manifolds.
problem Optimizing multi-objective interval-valued functions on Hadamard manifolds.
method Developed KKT conditions for Pareto optimal solutions under different ordering and convexity notions.
result Results are more general than on Euclidean spaces.
This paper surveys gradient-based multi-objective deep learning methods.
problem Balancing multiple conflicting objectives in deep learning models.
method Gradient-based techniques adapted from Multi-Objective Optimization.
result Comprehensive survey of gradient-based multi-objective deep learning algorithms.
FlexiBO optimizes deep neural networks by balancing cost and performance.
problem Optimizing deep neural networks for multiple objectives incurs high costs.
method Decouples and weights cost in multi-objective Bayesian optimization.
result FlexiBO discovers designs with lower hypervolume error.
Paper tackles multi-object reinforcement learning, improving skill extrapolation.
problem Learning robust manipulation tasks in multi-object settings.
method Introduces a linear relation network module to enhance skill generalization.
result Agents can extrapolate and generalize to any new object number, scaling linearly.
Proposes MOGFNs for generating diverse Pareto optimal solutions in multi-objective optimization.
problem Generating diverse candidates in multi-objective optimization with conflicting objectives.
method Introduces MOGFNs based on GFlowNets, with two variants: MOGFN-PC and MOGFN-AL.
result Improved candidate diversity compared to existing methods.
MO-PaDGAN improves multi-objective optimization by generating diverse and high-performing designs.
problem Challenges in parameterizing engineering designs for multi-objective optimization.
method MO-PaDGAN uses a generative adversarial network with a Determinantal Point Processes loss function to address these challenges.
result MO-PaDGAN generates designs with improved performance and coverage, even surpassing training data.
A new Adamize method improves multi-objective recommender systems.
problem Improving recommendation systems with multiple conflicting objectives.
method Developed a multi-objective model-agnostic Adamize method that corrects and stabilizes gradients.
result Significant improvements in recommendation systems, measured by hypervolume, coverage, and spacing.
Neural Architecture Search aims at automatically finding neural architectures that are competitive with architectures designed by human experts. While recent approaches have achieved state-of-the-art predictive performance for image recognition, they are problematic under resource constraints for two reasons: (1)the ne…
Proof of convergence for multi-objective optimization using inverse reinforcement learning.
problem Proving convergence in multi-objective optimization problems.
method Wasserstein inverse reinforcement learning with projective subgradient method and gradient descent.
result Convergence of inverse reinforcement learning for multi-objective optimization.
New method improves neural architecture search by optimizing for both performance and diversity.
problem Traditional multi-objective NAS fails to address practical constraints and niches.
method Formulated as quality diversity optimization, introduces multifidelity optimizers.
result Quality diversity NAS outperforms multi-objective NAS in quality and efficiency.
Proof shows imitation of expert's reward and solutions in multi-objective optimization.
problem Multi-objective optimization with reward and solution imitation.
method Wasserstein inverse reinforcement learning.
result Wasserstein inverse reinforcement learning enables imitation of expert's reward and solutions in multi-objective optimization.
Study on Pareto optimality in multi-objective bandit problems.
problem Pareto optimality in multi-objective multi-armed bandit problems.
method Formulated adversarial multi-objective multi-armed bandit, defined Pareto regrets, presented algorithms, established upper and lower bounds.
result New algorithms are optimal in adversarial settings and nearly optimal in stochastic settings.
Enhances portfolio optimization under uncertainty using robust multi-objective methods.
problem Uncertainties in real-world portfolio optimization scenarios.
method Robust multi-objective optimization with benchmark comparisons.
result More reliable and adaptable portfolio strategies for market uncertainties.
New method tackles non-smooth tensor data for better recovery.
problem Non-smooth changes in tensor data degrade traditional t-SVD methods.
method Learnable tensor nuclear norm, Alternating Proximal Multiplier Method (APMM), multi-objective tensor recovery framework.
result The proposed method effectively recovers tensor data with non-smooth changes.
Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial layout (i.e., bounding boxes + class labels in an image lattice) and style (i.e.…
This paper develops a method to approximate the whole Pareto set for expensive multi-objective optimization.
problem Finding an approximate Pareto front with limited expensive evaluations.
method A novel learning-based method to approximate the whole Pareto set for multi-objective Bayesian optimization (MOBO).
result The method approximates the whole Pareto set, not just a finite set, for MOBO.
New framework converts multi-objective to single-objective optimisation.
problem Solving multi-objective optimisation problems.
method Formalises scalarisation into mathematical framework, uses R2 utilities.
result R2 utilities are monotone and submodular, optimised by greedy algorithms.
Many real-world applications are characterized by a number of conflicting performance measures. As optimizing in a multi-objective setting leads to a set of non-dominated solutions, a preference function is required for selecting the solution with the appropriate trade-off between the objectives. The question is: how g…
Develops a new method to improve performance in multi-objective learning problems.
problem Gradient bias in multi-objective learning leading to degraded performance.
method Stochastic Multi-objective gradient Correction (MoCo) method that guarantees convergence without increasing batch size.
result Demonstrates effectiveness of MoCo method in simulations on multi-task learning.
Simple greedy algorithms can excel in multi-objective bandits with multiple good arms.
problem Optimizing multiple objectives in bandits is traditionally harder.
method Introduced greedy algorithms that exploit multiple good arms for multiple objectives.
result Simple greedy algorithms achieve strong performance in multi-objective bandits.
MWGraD solves multi-objective distributional optimization using particle-based gradient descent.
problem Simultaneously minimize multiple objective functionals over probability distributions.
method Iterative particle-based algorithm MWGraD, estimating and aggregating Wasserstein gradients.
result Demonstrates effectiveness on synthetic and real-world datasets.
This paper introduces a new scalable multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We develop a high-performance MODRL framework that supports both single-policy and multi-policy strategies, as well as both linear and non-linear approaches to action selection. The experimental …
Wind farm layout optimisation tackles space constraints with Bayesian multi-objective approach.
problem Optimizing wind farm layout due to limited space and conflicting objectives.
method Set-based multi-objective Bayesian optimisation using Gaussian process.
result Demonstrates potential of set-based Bayesian multi-objective optimisation for wind farm layout.
A drone-based MOT algorithm tracks vehicles using neural network detections and TPMBM filter.
problem Tracking multiple vehicles from drone-mounted cameras.
method Neural network for object detection, TPMBM filter for trajectory estimation, von-Mises Fisher distribution for DOA.
result TPMBM filter optimally estimates vehicle trajectories.
The paper introduces a new metric to quantify uncertainty's impact on multiple objectives.
problem Quantifying the impact of uncertainty on multiple objectives in complex systems.
method Proposes the mean multi-objective cost of uncertainty (multi-objective MOCU) to quantify uncertainty.
result Demonstrates the effectiveness of the multi-objective MOCU in real-world applications.
This paper introduces multi-objective hyperparameter optimization in machine learning.
problem Optimizing machine learning pipelines for multiple objectives, not just accuracy.
method Survey of optimization strategies and applications in multi-objective hyperparameter optimization.
result The importance and utility of multi-objective hyperparameter optimization in applied machine learning.
Many reinforcement-learning researchers treat the reward function as a part of the environment, meaning that the agent can only know the reward of a state if it encounters that state in a trial run. However, we argue that this is an unnecessary limitation and instead, the reward function should be provided to the learn…
The nonnegative matrix factorization is a widely used, flexible matrix decomposition, finding applications in biology, image and signal processing and information retrieval, among other areas. Here we present a related matrix factorization. A multi-objective optimization problem finds conical combinations of templates …
BOAT optimizes multiple antibody properties efficiently.
problem Balancing multiple drug-like properties in antibody design.
method Bayesian optimization framework coupling surrogate modeling and genetic algorithm.
result Competitive performance with state-of-the-art multi-objective protein optimization methods.
Bayesian optimisation framework for multi-objective decision-making from choice data.
problem Optimizing multi-objective functions via choice judgements.
method Gaussian process prior and novel likelihood model for choice data.
result Proposes a novel Bayesian framework for learning latent functions from choice data.
MOBO-OSD optimizes multi-objective functions using orthogonal search directions.
problem Challenging multi-objective optimization problem.
method Solves multiple constrained optimization problems along orthogonal search directions.
result Consistently outperforms state-of-the-art algorithms.
Introduces R-SSM for modeling multi-object dynamics with GNNs and normalizing flows.
problem Complex interactions and evolutions in multi-object systems are hard to model.
method Relational state-space model (R-SSM) using graph neural networks (GNNs) and normalizing flows.
result Empirically validated on synthetic and real datasets.
A new method for diverse Pareto solutions in multi-objective learning.
problem Maximizing diversity while maximizing hypervolume in Pareto solutions.
method Annealed Stein Variational Gradient Descent (SVGD) with diverse gradient directions.
result SVH-MOL achieves superior performance in multi-objective and multi-task learning.
This paper introduces a new scalarization method for multi-objective optimization.
problem Efficiently optimizing multiple conflicting objectives in black box settings.
method Introduces a novel hypervolume scalarization function and uses it to approximate the hypervolume indicator metric.
result Provable convergence to the entire Pareto frontier using random scalarizations and Bayesian optimization.
A new method for multi-objective Bayesian optimization.
problem Finding optimal compromises between competing objectives.
method Joint Entropy Search (JES) acquisition function for multi-objective Bayesian optimization.
result JES outperforms existing methods in terms of hypervolume and its variants.
A new method for incorporating preferences in multi-objective Bayesian optimization.
problem Incorporating preferences in computationally expensive multi-objective optimization problems.
method Building independent surrogate models on each objective function and using Generalised value distribution to approximate the scalarizing function.
result The proposed multi-surrogate approach outperforms the mono-surrogate approach on benchmark and real-world problems.
MORBO improves multi-objective BO for high-dimensional problems.
problem Optimizing multiple objectives in high-dimensional spaces with expensive evaluations.
method Parallel local BO in multiple regions with coordinated strategy.
result Significant improvement in sample efficiency for high-dimensional problems.
Paper approximates solutions for complex decision processes with limited precision.
problem Approximating the set of all solutions for Multi-objective Markov Decision Processes.
method Limited precision approach based on White's multi-objective value-iteration dynamic programming algorithm.
result The number of calculated solutions is tractable and approximates the true Pareto front.
Boosting theory extended to handle cost-sensitive and multi-objective losses.
problem Real-world prediction problems with different error costs.
method Developed a comprehensive theory of cost-sensitive and multi-objective boosting.
result Established a dichotomy for binary classification and a more intricate landscape for multiclass settings.