arXiv research

This paper develops a new method for eliciting more flexible metrics, improving fairness and applicability.

Study creates web interface to elicit user-preferred metrics.

Proposes a method to select fair performance metrics through metric elicitation.

This thesis formalizes metric selection for machine learning applications.

In this paper we propose an approach to preference elicitation that is suitable to large configuration spaces beyond the reach of existing state-of-the-art approaches. Our setwise max-margin method can be viewed as a generalization of max-margin learning to sets, and can produce a set of "diverse" items that can be use…

Formulates a Dueling Bandits problem for eliciting Kemeny rankings.

We propose a cost-effective framework for preference elicitation and aggregation under the Plackett-Luce model with features. Given a budget, our framework iteratively computes the most cost-effective elicitation questions in order to help the agents make a better group decision. We illustrate the viability of the fram…

We state the problem of inverse reinforcement learning in terms of preference elicitation, resulting in a principled (Bayesian) statistical formulation. This generalises previous work on Bayesian inverse reinforcement learning and allows us to obtain a posterior distribution on the agent's preferences, policy and optio…

Study shows LLM-advisors match human performance in eliciting preferences but struggle with conflicting needs and trust.

A framework for eliciting utility functions from investor preferences.

Framework uses IRL and RL to elicit and optimize risk preferences robustly to noise.

Platform uses queries to elicit investor preferences for portfolio trades, improving allocation efficiency.

In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining which policy to execute by maximising the user's intrinsic utility function over t…

Given a binary prediction problem, which performance metric should the classifier optimize? We address this question by formalizing the problem of Metric Elicitation. The goal of metric elicitation is to discover the performance metric of a practitioner, which reflects her innate rewards (costs) for correct (incorrect)…

Bayesian method helps decision-makers find preferred solutions in multi-objective optimization.

We tackle the problem of constructive preference elicitation, that is the problem of learning user preferences over very large decision problems, involving a combinatorial space of possible outcomes. In this setting, the suggested configuration is synthesized on-the-fly by solving a constrained optimization problem, wh…

Decision maker's preferences are often captured by some choice functions which are used to rank prospects. In this paper, we consider ambiguity in choice functions over a multi-attribute prospect space. Our main result is a robust preference model where the optimal decision is based on the worst-case choice function fr…

New algorithm speeds up user preference learning in conversational contexts.

Study on identifying most preferred policy in bandits with vector-valued rewards.

Motivated by an application of eliciting users' preferences, we investigate the problem of learning hemimetrics, i.e., pairwise distances among a set of $n$ items that satisfy triangle inequalities and non-negativity constraints. In our application, the (asymmetric) distances quantify private costs a user incurs when s…

Paper analyzes finite-time guarantees for preference-based RL.

Duel-Evolve uses LLM self-preferences for test-time optimization of discrete outputs.

Effective techniques for eliciting user preferences have taken on added importance as recommender systems (RSs) become increasingly interactive and conversational. A common and conceptually appealing Bayesian criterion for selecting queries is expected value of information (EVOI). Unfortunately, it is computationally p…

GBS uses machine learning to design products based on consumer preferences.

This study measures price risk aversion using indirect utility functions in a lab experiment.

Extends Mallows model to handle item indifference in rankings.

We consider the problem of probably approximately correct (PAC) ranking $n$ items by adaptively eliciting subset-wise preference feedback. At each round, the learner chooses a subset of $k$ items and observes stochastic feedback indicating preference information of the winner (most preferred) item of the chosen subset …

Response time improves alignment with diverse human preferences.

The paper enhances preference learning by incorporating response time data.

LLMs can be influenced by unseen dataset subtexts, revealing new ways to select data subsets.

Inverse classification uses an induced classifier as a queryable oracle to guide test instances towards a preferred posterior class label. The result produced from the process is a set of instance-specific feature perturbations, or recommendations, that optimally improve the probability of the class label. In this work…

New algorithm learns human preferences from few comparisons efficiently.

ELECTRE Tree infers ELECTRE Tri-B parameters using a machine learning approach.

Develops a statistical framework to measure uncertainty in model rankings based on human preferences.

Constructs new elicitable risk measures with multiplicative scoring functions.

There is tremendous interest in precision medicine as a means to improve patient outcomes by tailoring treatment to individual characteristics. An individualized treatment rule formalizes precision medicine as a map from patient information to a recommended treatment. A treatment rule is defined to be optimal if it max…

Sharpe et al. proposed the idea of having an expected utility maximizer choose a probability distribution for future wealth as an input to her investment problem instead of a utility function. They developed a computer program, called The Distribution Builder, as one way to elicit such a distribution. In a single-perio…

A property, or statistical functional, is said to be elicitable if it minimizes expected loss for some loss function. The study of which properties are elicitable sheds light on the capabilities and limitations of point estimation and empirical risk minimization. While recent work asks which properties are elicitable, …

We discuss equivalent axiomatic characterizations of distortion risk measures, and give a novel and concise proof of the characterization of elicitable distortion risk measures. Elicitability has recently been discussed as a desirable criterion for risk measures, motivated by statistical considerations of forecasting. …

The perception of facial beauty is a complex phenomenon depending on many, detailed and global facial features influencing each other. In the machine learning community this problem is typically tackled as a problem of supervised inference. However, it has been conjectured that this approach does not capture the comple…

Robustifies elicitable functionals to handle small distribution misspecifications.

Study generalizes property elicitation to imprecise probabilities.

A statistical functional, such as the mean or the median, is called elicitable if there is a scoring function or loss function such that the correct forecast of the functional is the unique minimizer of the expected score. Such scoring functions are called strictly consistent for the functional. The elicitability of a …

It is important to collect credible training samples $(x,y)$ for building data-intensive learning systems (e.g., a deep learning system). Asking people to report complex distribution $p(x)$, though theoretically viable, is challenging in practice. This is primarily due to the cognitive loads required for human agents t…

Off-policy reinforcement learning has many applications including: learning from demonstration, learning multiple goal seeking policies in parallel, and representing predictive knowledge. Recently there has been an proliferation of new policy-evaluation algorithms that fill a longstanding algorithmic void in reinforcem…

A method for eliciting expert beliefs using preferential questions and normalizing flows.

The paper analyzes elicitability of return risk measures and their scoring functions.

Proposes method for eliciting non-parametric joint priors using normalizing flows.