Bayesian optimization agent learns user preferences from pairwise comparisons.
problem Learning user preferences from unknown and infinite choices.
method Sequential Bayesian optimization with pairwise comparisons.
result Optimal agent strategy minimizes remaining system uncertainty.
Robot learns user preferences from brain signals.
problem Decoding user preferences for robot motions from brain signals.
method Proposes a novel approach using electroencephalography to decode user preferences from brain signals.
result Brain signals can reliably infer user preferences for robot trajectories.
CnGAN generates synthetic user preferences for non-overlapped users in cross-network recommender systems.
problem Cross-network recommender solutions ignore non-overlapped users, limiting their applicability.
method Multi-task learning, encoder-GAN architecture, user-based pairwise loss function.
result Generated user preferences improve recommendations for non-overlapped users, achieving superior performance.
New study shows personalized content recommendations can lead to polarization of user preferences.
problem Personalized content recommendations can alter user preferences, leading to polarization.
method Used a model of preference dynamics to explore how personalized content affects user preferences.
result Standard reward maximization algorithms achieve only constant regret in personalized recommendation environments.
New method adapts to user preferences dynamically, improving recommendation models.
problem Current recommendation models lack dynamic adaptation to changing user preferences.
method Preference Discerning with LLM-Enhanced Generative Retrieval
result Mender achieves state-of-the-art performance in adapting to evolving user preferences.
Model user preferences for conversational LLMs using weak rewards.
problem Lack of persistent user models in conversational LLMs leading to repeated user restatements.
method Vector-Adapted Retrieval Scoring (VARS) framework that updates user vectors online from weak scalar rewards.
result Full VARS agent achieves strongest overall performance, matches strong Reflection baseline in task success, and reduces user effort.
Study creates web interface to elicit user-preferred metrics.
problem Eliciting classification metrics that align with user preferences.
method Developed a web-based interface and conducted a user study.
result Users preferred metrics that align with their task and context.
Estimates users' preference for a site over others using engagement data.
problem Lack of data on users' interactions with other sites makes it hard to estimate preferences for a focal site.
method Uses Hierarchical Bayes Method with two estimation techniques: Markov Chain Monte Carlo and Stochastic Gradient with Langevin Dynamics.
result Good support found for the approach to computing personalized share of engagement.
DPA aligns LLMs with multi-objective rewards for diverse user preferences.
problem Fine-grained control over LLMs for diverse user needs.
method Integrates multi-objective reward modeling and directional preference control.
result DPA offers better performance trade-offs and intuitive user control over LLM generation.
Reduces learning regret with diverse user preferences.
problem Reducing regret in stochastic multi-armed bandit problems with diverse user preferences.
method Formulated a stochastic linear bandits model and proposed a Weighted Upper Confidence Bound (W-UCB) algorithm.
result Achieves constant regret when user preferences are sufficiently diverse.
TSPRA integrates topics, sentiment, and user preference for better online review prediction and analysis.
problem Improving online review prediction and sentiment analysis accuracy.
method HDP-based model combining topics, sentiment, and user preference.
result Outperforms state-of-the-art model FLAME in rating prediction and sentiment analysis.
Study shows significant differences in recommendation bias between model-based and memory-based algorithms.
problem Recommendation bias disparity across different algorithms and item categories.
method Examined bias disparity in a range of collaborative recommendation algorithms and item categories.
result Significant differences found between model-based and memory-based algorithms.
New algorithm uses negative user preferences to improve recommendation quality.
problem Insufficient utilization of negative user preferences in recommender systems.
method Explicitly models negative user preferences to recommend more positive items.
result Improves recommendation quality by increasing accuracy and reducing negative items.
FSPO optimizes synthetic preferences for LLM personalization.
problem Personalizing large language models for diverse users.
method FSPO reframes reward modeling as a meta-learning problem, using few labeled preferences and synthetic data.
result FSPO achieves high winrates in personalized responses, both synthetic and real.
Fashion preference is a fuzzy concept that depends on customer taste, prevailing norms in fashion product/style, henceforth used interchangeably, and a customer's perception of utility or fashionability, yet fashion e-retail relies on algorithmically generated search and recommendation systems that process structured d…
Model learns metrics and preferences from user comparisons.
problem Simultaneous metric and preference learning from user comparisons.
method Jointly learns a metric and latent ideal points for each user.
result Model captures individual preferences and learns metrics efficiently.
A-GPS learns to generate Pareto sets efficiently with user preferences.
problem Online discrete multi-objective optimization with user preferences.
method Generative model with class probability estimator (CPE) for non-dominance and preference alignment.
result Amortized generative model for efficient Pareto set approximation.
This paper learns user preferences from comparisons using Mahalanobis metrics.
problem Learning user preferences from paired comparisons with unknown metric.
method Estimates user ideal point and Mahalanobis metric from comparisons.
result Effectiveness of the algorithm demonstrated on synthetic and real-world data.
We tackle the problem of constructive preference elicitation, that is the problem of learning user preferences over very large decision problems, involving a combinatorial space of possible outcomes. In this setting, the suggested configuration is synthesized on-the-fly by solving a constrained optimization problem, wh…
Proposes auditing for envy-freeness in recommender systems to assess individual preferences.
problem Auditing fairness in recommender systems for individual preferences.
method Formulates a pure exploration problem in multi-armed bandits, proposing a sample-efficient algorithm with theoretical guarantees.
result Algorithm ensures fairness without deteriorating user experience on real-world datasets.
The paper explores using set-level ratings for better user-item preference prediction in recommender systems.
problem Capturing user preferences on individual items using set-level ratings.
method Developed collaborative filtering-based methods to model user behaviors in set-level ratings.
result Collaborative filtering-based models can recover and predict user preferences on individual items using set-level ratings.
Study shows LLM-advisors match human performance in eliciting preferences but struggle with conflicting needs and trust.
problem How do LLM-advisors perform in complex financial domains where domain expertise is crucial?
method Lab-based user study with 64 participants, focusing on three challenges: preference elicitation, personalized guidance, and relationship building.
result LLM-advisors can match human performance in preference elicitation but struggle with conflicting needs and trust issues.
Proposes CF-SFL to improve sparse data recommendation.
problem Poor performance of CF in sparse data.
method Generative user feedback loop to simulate user feedback.
result Improves recommendation results on multiple datasets.
Paper proposes a two-stage ranking for personalized TV recommendations.
problem Improving TV recommendation accuracy and efficiency.
method First, identifies potential candidates using user viewing patterns. Then, ranks them based on user preferences and program textual information.
result The proposed model outperforms in recommendation accuracy and efficiency.
SPMF improves social recommendation by considering trust and preference domains.
problem Ignoring trust and preference domain differences in social recommendations.
method SPMF uses matrix factorization with trust and preference segmentation.
result SPMF outperforms state-of-the-art recommendation algorithms.
While recommendation systems generally observe user behavior passively, there has been an increased interest in directly querying users to learn their specific preferences. In such settings, considering queries at different levels of granularity to optimize user information acquisition is crucial to efficiently providi…
PGRec improves recommendation by modeling user-item preferences as a graph and embedding it for better predictions.
problem Sparse user-item data in recommender systems.
method PGRec models user-item preferences as a PrefGraph, then uses deep learning and factorization to embed and predict user preferences.
result PGRec outperforms state-of-the-art methods by up to 3.2% in NDCG@10.
Estimates user preferences from noisy paired comparisons.
problem Estimating user preferences from noisy paired comparisons.
method Greedy information maximization strategies.
result Superior preference estimation over state-of-the-art methods.
A new method improves recommendation accuracy by learning from multiple networks and time-dependent user preferences.
problem Incomplete user profiles and dynamic user preferences degrade recommender quality.
method A cross-network time-aware recommender that learns from multiple source networks and develops current user models.
result The proposed solution achieves superior performance in accuracy, novelty, and diversity.
Jointly optimizes tree index and deep model for better recommendation accuracy.
problem Improving recommendation accuracy in large-scale recommender systems.
method Develops a joint optimization framework for tree index and user preference model.
result Significantly improves recommendation accuracy on real-world datasets.
Improved model for analyzing topics, sentiments, and user preferences in online reviews.
problem Inefficient processing of large-scale online review datasets.
method Developed variational inference models (vTSPRA, svTSPRA, ovTSPRA) for faster and more efficient processing of large datasets.
result The new models (svTSPRA, ovTSPRA) achieve better performance and faster convergence compared to the original TSPRA model.
Network-based models predict user preferences for items like movies and research articles.
problem Filtering and delivering personalized advice for users with many available products.
method Network models based on group memberships, using Monte Carlo sampling and Expectation-Maximization methods.
result Network models outperform leading approaches for recommendation.
A new algorithm improves top-k recommendation accuracy by considering item payoffs uncertainty.
problem Suboptimal performance in top-k recommendation rankings due to varying item payoffs. method Proposes a risk-seeking utility function for ranking items based on estimated preference scores.
result Risk-seeking ranking yields the best performance in top-k recommendations. Unified neural framework for multi-relational recommender systems.
problem Accurately capturing users' fine-grained preferences from diverse feedback types.
method Multi-Relational Memory Network (MRMN) framework that models fine-grained user-item relations and discriminates between feedback types.
result The proposed MRMN model outperforms state-of-the-art algorithms in various recommender scenarios.
IArxiv sorts daily papers by user preference using LDA.
problem Harder for scientists to stay updated with diverse research.
method LDA on paper corpus to extract topics, user preference learning.
result Sorts papers by user preference on underlying topics.
New MAB model incentivizes user arm-pulling with self-reinforcing preferences.
problem Balancing exploration and exploitation in recommender systems with incentivized user preferences.
method Proposes a new MAB model with random arm selection and two policies: At-Least-n Explore-Then-Commit and UCB-List. result Achieves O(logT) expected regret and O(logT) expected payment over a time horizon T. With online calendar services gaining popularity worldwide, calendar data has become one of the richest context sources for understanding human behavior. However, event scheduling is still time-consuming even with the development of online calendars. Although machine learning based event scheduling models have automate…
JIMA uses multi-level preference data to recommend composite items.
problem Recommending composite items efficiently with multi-level preference information.
method Joint Interaction Modeling (JIMA) approach that integrates multi-level preference data and interactions.
result JIMA outperforms advanced baselines in offline and online settings.
Proposes a new framework for resource-limited recommendation.
problem Resource constraints affect user choices in recommendation tasks.
method Interest-behavior multiplicative network with MRRNNs and resource-limited branch.
result Framework effectively predicts user interactions considering resource limitations.
MRIF models dynamic user interests at multiple temporal-ranges.
problem Capturing dynamic and multi-resolution user interests in recommendation.
method Multi-resolution Interest Fusion (MRIF) model that considers both temporal-ranges and drifts in user interests.
result MRIF outperforms state-of-the-art recommendation methods consistently.
Given a set of pairwise comparisons, the classical ranking problem computes a single ranking that best represents the preferences of all users. In this paper, we study the problem of inferring individual preferences, arising in the context of making personalized recommendations. In particular, we assume that there are …
AI assistants often give convincing but incorrect responses to match user beliefs.
problem Sycophancy in AI assistants that use human feedback.
method Examined five AI assistants across four tasks, analyzed human preference data, and compared model outputs against preference models.
result Sycophancy is a general behavior of AI assistants, driven in part by human preference judgments.
Study metric learning from limited preference comparisons, showing how low-dimensional structure can still reveal metric information.
problem Learning metric from limited pairwise preference comparisons.
method Ideal point model, divide-and-conquer approach for low-dimensional structure.
result Metric can be jointly identified even with limited comparisons when items exhibit low-dimensional structure.
A reciprocal recommendation problem is one where the goal of learning is not just to predict a user's preference towards a passive item (e.g., a book), but to recommend the targeted user on one side another user from the other side such that a mutual interest between the two exists. The problem thus is sharply differen…
Many real-world engineering problems rely on human preferences to guide their design and optimization. We present PrefOpt, an open source package to simplify sequential optimization tasks that incorporate human preference feedback. Our approach extends an existing latent variable model for binary preferences to allow f…
Bayesian method predicts individual and crowd preferences from small data.
problem Difficult to predict preferences from limited personal data and noisy labels.
method Combines matrix factorization with Gaussian processes for scalable inference.
result Method predicts preferences for new users and items not in training set.
We consider the task of collaborative preference completion: given a pool of items, a pool of users and a partially observed item-user rating matrix, the goal is to recover the \emph{personalized ranking} of each user over all of the items. Our approach is nonparametric: we assume that each item i and each user u h…
Proposes ADC for cross-domain recommendation balancing user preferences.
problem Users' preferences change across different domains (e.g., social media, e-commerce).
method Designs a neural architecture and cross-domain loss function to adaptively balance user preferences.
result ADC model effectively balances the impact of domains with different complexities.