Response time improves alignment with diverse human preferences.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Study shows how diverse investors' learning and preferences shape financial markets.
Study optimal investment decisions for diverse risk-tolerant agents.
A new method reduces preference distortion in LLM alignment.
This work frames reward modelling from preferences as a causal problem.
Paper introduces Functional Effects Models to account for individual heterogeneity in panel data.
There is an increasing interest in estimating heterogeneity in causal effects in randomized and observational studies. However, little research has been conducted to understand heterogeneity in an instrumental variables study. In this work, we present a method to estimate heterogeneous causal effects using an instrumen…
The paper sorts big data by revealed preferences, improving consumer and policy decisions.
Study risk sharing among agents with varying risk preferences.
Generalizes risk sharing models to a continuum of agents.
LoCo-RLHF models diverse human feedback with contextual information.
We propose an extended public goods interaction model to study the evolution of cooperation in heterogeneous population. The investors are arranged on the well known scale-free type network, the Barabási-Albert model. Each investor is supposed to preferentially distribute capital to pools in its portfolio based on the …
Method tackles uncertainty in reward models for LLMs from heterogeneous human feedback.
In market modeling, one often treats buyers as a homogeneous group. In this paper we consider buyers with heterogeneous preferences and products available in many variants. Such a framework allows us to successfully model various market phenomena. In particular, we investigate how is the vendor's behavior influenced by…
New framework estimates treatment effects based on preferences.
Recent years have witnessed an increased focus on interpretability and the use of machine learning to inform policy analysis and decision making. This paper applies machine learning to examine travel behavior and, in particular, on modeling changes in travel modes when individuals are presented with a novel (on-demand)…
Reinforcement learning (RL) has achieved tremendous success as a general framework for learning how to make decisions. However, this success relies on the interactive hand-tuning of a reward function by RL experts. On the other hand, inverse reinforcement learning (IRL) seeks to learn a reward function from readily-obt…
Bayesian model identifies three types of travelers adapting to feedback.
GBS uses machine learning to design products based on consumer preferences.
This paper develops, in a Brownian information setting, an approach for analyzing the preference for information, a question that motivates the stochastic differential utility (SDU) due to Duffie and Epstein [Econometrica 60 (1992) 353-394]. For a class of backward stochastic differential equations (BSDEs) including th…
The dynamics of many socioeconomic systems is determined by the decision making process of agents. The decision process depends on agent's characteristics, such as preferences, risk aversion, behavioral biases, etc.. In addition, in some systems the size of agents can be highly heterogeneous leading to very different i…
Bayesian framework learns latent preference archetypes for many-objective optimization.
New study shows personalized content recommendations can lead to polarization of user preferences.
This paper analyzes consumer choices over lunchtime restaurants using data from a sample of several thousand anonymous mobile phone users in the San Francisco Bay Area. The data is used to identify users' approximate typical morning location, as well as their choices of lunchtime restaurants. We build a model where res…
The paper proposes a method to learn and leverage contextual preference distributions for better decision-making.
Upper bounds on utility for managing heterogeneous collectivised funds.
We consider the problem of learning the preferences of a heterogeneous population by observing choices from an assortment of products, ads, or other offerings. Our observation model takes a form common in assortment planning applications: each arriving customer is offered an assortment consisting of a subset of all pos…
Generative model reveals hidden interaction preferences in networks.
Optimizes pension mix of PAYGO, EET, and individual savings.
In this paper we model the problem of learning preferences of a population as an active learning problem. We propose an algorithm can adaptively choose pairs of items to show to users coming from a heterogeneous population, and use the obtained reward to decide which pair of items to show next. We provide computational…
We propose the Heterogeneous Thurstone Model (HTM) for aggregating ranked data, which can take the accuracy levels of different users into account. By allowing different noise distributions, the proposed HTM model maintains the generality of Thurstone's original framework, and as such, also extends the Bradley-Terry-Lu…
We study the market selection hypothesis in complete financial markets, populated by heterogeneous agents. We allow for a rich structure of heterogeneity: individuals may differ in their beliefs concerning the economy, information and learning mechanism, risk aversion, impatience and 'catching up with Joneses' preferen…
We develop a finite horizon continuous time market model, where risk averse investors maximize utility from terminal wealth by dynamically investing in a risk-free money market account, a stock written on a default-free dividend process, and a defaultable bond, whose prices are determined via equilibrium. We analyze fi…
Autonomous systems can substantially enhance a human's efficiency and effectiveness in complex environments. Machines, however, are often unable to observe the preferences of the humans that they serve. Despite the fact that the human's and machine's objectives are aligned, asymmetric information, along with heterogene…
Develops methods to correct bias in AI feedback for more accurate alignment.
FedConPE improves conversational recommender systems efficiency and privacy.
Study on self-consuming generative models with diverse human curation, focusing on convergence and stability.
Optimizes investment strategies for retirees with longevity risk.
This paper characterizes the equilibrium in a continuous time financial market populated by heterogeneous agents who differ in their rate of relative risk aversion and face convex portfolio constraints. The model is studied in an application to margin constraints and found to match real world observations about financi…
We study consumption behaviour in systems with heterogeneous interacting agents. Two different models are introduced, respectively with long and short range interactions among agents. At any time step an agent decides whether or not to consume a good, doing so if this provides positive utility. Utility is affected by i…
The paper optimizes reinsurance under uncertain dependence among insurers.
Adaptive reward models capture individual preferences from human feedback.
The way that people make choices or exhibit preferences can be strongly affected by the set of available alternatives, often called the choice set. Furthermore, there are usually heterogeneous preferences, either at an individual level within small groups or within sub-populations of large groups. Given the availabilit…
The paper optimizes pension policies with guarantees and sustainability constraints.
Study risk sharing with Lambda VaR under diverse beliefs.
Paper proposes personalized climate control for driver comfort.
This study develops a dynamic inverse optimization framework to recover hidden, time-varying preferences from observed allocation trajectories.
We develop a formalism to study linearized perturbations around the equilibria of a pure exchange economy. With the use of mean field theory techniques, we derive equations for the flow of products in an economy driven by heterogeneous preferences and probabilistic interaction between agents. We are able to show that i…