Proposes ADC for cross-domain recommendation balancing user preferences.
problem Users' preferences change across different domains (e.g., social media, e-commerce).
method Designs a neural architecture and cross-domain loss function to adaptively balance user preferences.
result ADC model effectively balances the impact of domains with different complexities.
A new model CDT improves cross-domain recommendation by learning translation vectors.
problem Improving cross-domain recommendation by transferring user preferences across different platforms.
method Translation-based learning approach with embedding space and factorization machines.
result The proposed CDT model outperforms other cross-domain strategies in six publicly available tasks.
SPMF improves social recommendation by considering trust and preference domains.
problem Ignoring trust and preference domain differences in social recommendations.
method SPMF uses matrix factorization with trust and preference segmentation.
result SPMF outperforms state-of-the-art recommendation algorithms.
Study shows LLM-advisors match human performance in eliciting preferences but struggle with conflicting needs and trust.
problem How do LLM-advisors perform in complex financial domains where domain expertise is crucial?
method Lab-based user study with 64 participants, focusing on three challenges: preference elicitation, personalized guidance, and relationship building.
result LLM-advisors can match human performance in preference elicitation but struggle with conflicting needs and trust issues.
UBL R package handles utility-based learning problems in various domains.
problem Handling utility-based learning problems with non-uniform costs and benefits.
method Provides a set of methods for classification and regression tasks in R, allowing domain preferences specification and automatic inference.
result Facilitates utility-based predictive analytics in R, enhancing model performance.
MAXMINLCB optimizes unknown target functions with preference feedback using a Stackelberg game approach.
problem Optimizing unknown target functions with pairwise comparisons and human feedback.
method MAXMINLCB, a zero-sum Stackelberg game, balances exploration and exploitation.
result MAXMINLCB consistently outperforms existing algorithms with a rate-optimal regret guarantee.
Tutorials on preference learning with Gaussian Processes.
problem Understanding individual preferences and choices for efficient and personalized applications.
method Presentation of a comprehensive framework for preference learning with Gaussian Processes, incorporating rationality principles.
result Construction of preference learning models that encompass various utility models and scenarios.
Collaborative filtering (CF) aims to predict users' ratings on items according to historical user-item preference data. In many real-world applications, preference data are usually sparse, which would make models overfit and fail to give accurate predictions. Recently, several research works show that by transferring k…
Automates debiasing for large language model evaluations through Fisher random walk.
problem Rigorous and scalable evaluation of large language models.
method Semiparametric efficient estimator using Fisher random walk for weighted residual balancing.
result Efficient estimation of contextual preference scores for large language models.
Novel framework for teaching complexity in machine teaching models.
problem Understanding and comparing teaching models in batch and sequential settings.
method Developed a novel framework using preference functions to capture teaching complexity.
result Identified preference functions leading to linear teaching complexity in sequential models.
JIMA uses multi-level preference data to recommend composite items.
problem Recommending composite items efficiently with multi-level preference information.
method Joint Interaction Modeling (JIMA) approach that integrates multi-level preference data and interactions.
result JIMA outperforms advanced baselines in offline and online settings.
FinDPO uses preference optimization to improve financial sentiment analysis models.
problem Financial sentiment analysis models often fail to generalize to unseen data.
method FinDPO uses Direct Preference Optimization (DPO) to align LLMs with human preferences.
result FinDPO achieves state-of-the-art performance and maintains positive returns under realistic trading conditions.
The paper addresses poor calibration in fine-tuned LLMs after preference alignment.
problem Poor calibration in fine-tuned Large Language Models (LLMs) after preference alignment.
method Proposes a calibration-aware fine-tuning approach to restore calibration without compromising model performance.
result Demonstrates the effectiveness of the proposed methods through extensive experiments.
FSPO optimizes synthetic preferences for LLM personalization.
problem Personalizing large language models for diverse users.
method FSPO reframes reward modeling as a meta-learning problem, using few labeled preferences and synthetic data.
result FSPO achieves high winrates in personalized responses, both synthetic and real.
Proposes a bandit framework for dynamic user incentives.
problem Designing personalized incentives for users with evolving preferences.
method Combines greedy matching, UCB, and Markov chain theory.
result Algorithm provides theoretical regret bounds and practical examples.
A new model uses past consumption history to predict user preferences.
problem Predicting user preferences from past consumption history.
method Sequential Variational Autoencoder with a recurrent neural network.
result The model outperforms state-of-the-art methods by significant margins.
GuideR learns rules guided by user preferences for classification, regression, and survival analysis.
problem Lack of user preferences in rule learning algorithms.
method Guided sequential covering approach.
result User preferences improve rule quality in classification, regression, and survival analysis.
OSIL learns safe policies from unsafe demonstrations.
problem Offline safe imitation learning with implicit safety.
method Formulates CMDP, infers safety from non-preferred trajectories, learns cost model.
result OSIL learns safer policies without degrading reward performance.
Model predicts human food choices based on demographics.
problem Predicting human food choices from demographic data.
method Non-deterministic model based on NHANES dataset and behavioral studies.
result Generates synthetic data similar to original dataset.
Active IRL selects optimal human demonstrations for learning AI preferences.
problem Costly human demonstrations in IRL for autonomous systems.
method Information-theoretic acquisition function for selecting informative human demonstrations.
result Efficiently reduces human effort in learning AI preferences.
No free lunch theorems suggest inductive biases are needed, but we show neural networks prefer low-complexity data.
problem The need for inductive biases in machine learning.
method Analysis of Kolmogorov complexity and neural network behavior on various datasets.
result Neural networks prefer low-complexity data, suggesting inductive biases are not always necessary.
Gradient optimization improves preference elicitation for large item spaces.
problem Computational infeasibility of EVOI for large item spaces in recommender systems.
method Continuous formulation of EVOI as a differentiable network, optimized using gradient methods.
result Gradient-based EVOI optimization achieves state-of-the-art performance and scalability.
New algorithm speeds up user preference learning in conversational contexts.
problem Limited performance of existing conversational contextual bandit approaches.
method Proposes ConLinUCB framework and two algorithms, ConLinUCB-BS and ConLinUCB-MCR, with explorative key-term selection.
result Proves tighter regret bounds and achieves significant computational efficiency improvements.
New method uses analogy kernel for better object ranking.
problem Improving object ranking in preference learning.
method Introduces analogy kernel based on analogical proportions.
result Experimental results show competitive predictive accuracy.
New algorithm ensures fairness without sacrificing accuracy.
problem Ensuring fairness in machine learning without harming accuracy.
method Demographic-Agnostic Fairness without Harm (DAFH) algorithm.
result DAFH algorithm achieves higher accuracy than existing methods.
The paper optimizes pension policies with guarantees and sustainability constraints.
problem Designing optimal pension policies with guarantees and sustainability constraints.
method Dynamic utility model, stochastic domain, overlapping generations, time-consistent decision criterion.
result Optimal investment/pension policy computed for a general framework.
This paper interpolates reward functions to predict optimal value functions in MORL.
problem Finding optimal value functions in MORL requires recomputing for each set of weights.
method Interpolating reward function weights to smooth value function transformations.
result Smooth interpolation of optimal value functions over reward function weights.
Neural networks combining multiple data sources can reverse preferences, affecting decision reliability.
problem Preference reversals in neural networks under pooled data.
method Formalized through Case-Based Decision Theory, analyzed Gram geometry, introduced regularization, and developed auditing methods.
result Pooled refitting can reverse shared preferences, and conditions for preserving preferences are derived.
Enhances BO with expert preferences about abstract properties.
problem Lack of expert knowledge in BO for black-box experimental design.
method Human-AI collaboration to incorporate expert preferences into surrogate modeling.
result Superior performance compared to baselines in synthetic and real-world datasets.
TX-Ray analyzes and quantifies model knowledge transfer in NLP.
problem Insufficient methods for explaining and quantifying model knowledge transfer in NLP.
method Modified computer vision explainability principle to NLP, visualizing feature preference distributions.
result TX-Ray reveals how self-supervised models learn linguistic abstractions and improves generalization.
Domain Adaptation in 6G wireless networks: When is it green?
problem Energy consumption of Domain Adaptation (UDA) compared to single-task training in 6G wireless networks.
method Investigate energy consumption and propose a method to determine the minimum number of target domains for UDA to be more energy-efficient than retraining.
result Proposed a method to determine the minimum number of target domains for UDA to be more energy-efficient than retraining.
System learns user preferences to synthesize materials quickly.
problem Slow material synthesis for novice and expert users.
method Gaussian Process Regression for user preferences, neural network for real-time image predictions.
result Real-time material synthesis enables novice users to generate hundreds of models.
PrefOpt simplifies optimization with human preference feedback.
problem Design and optimization guided by human preferences.
method Extends latent variable model for binary preferences to include equivalent preference observations.
result Simplified sequential optimization tasks incorporating human feedback.
Paper fine-tunes LLMs using user edits, unifying preference, supervision, and reward feedback.
problem Adapting LLMs to user preferences and feedback types.
method Derives bounds for learning algorithms from user edits, proposes an ensembling procedure.
result Ensembling procedure outperforms individual feedback methods and robustly adapts to different user-edit distributions.
Mixed likelihood GPs improve model performance in human-in-the-loop experiments.
problem Lack of auxiliary information in traditional GPs for human responses.
method Propose mixed likelihood variational GPs to leverage auxiliary information.
result Modeling performance improvements across diverse applications.
Proposes a new ranking method based on analogical reasoning.
problem Object ranking using feature vectors.
method Analogical reasoning applied to instance-based learning and rank aggregation.
result Competitive results across various domains.
Optimizes molecular generation for chemist preferences.
problem Models lack inherent preferences for chemist-desired structures.
method Fine-tuning with Direct Preference Optimization.
result Approach is simple, efficient, and highly effective.
Method optimizes diffusion model generation to meet user preferences.
problem Optimizing diffusion model generation with only black-box target scores.
method Covariance-adaptive sequential optimization algorithm for black-box optimization.
result Proves superior performance in achieving better target scores.
Paper tackles cold-start domain adaptation with language descriptions.
problem Cold-start domain adaptation failure with scarce target data.
method Leverages textual descriptions to learn preferences from LLM, integrates into EM algorithm.
result Framework guides source selection for weak target signals, improves as data accumulates.
New bounds improve generalization for deep neural networks in domain adaptation.
problem Deriving tight generalization guarantees for deep neural networks in domain adaptation.
method Combining data-dependent PAC-Bayes analysis with importance weighting.
result A simple importance weighting extension provides the tightest estimable bound.
New method adapts to user preferences dynamically, improving recommendation models.
problem Current recommendation models lack dynamic adaptation to changing user preferences.
method Preference Discerning with LLM-Enhanced Generative Retrieval
result Mender achieves state-of-the-art performance in adapting to evolving user preferences.
Investment and consumption strategies optimized with uncertain parameters.
problem Investment and consumption preferences in an incomplete financial market with uncertain parameters.
method PDE characterization and semi-explicit saddle-point construction of forward preferences and optimal strategies.
result A specific relationship between initial investment preference and forward consumption preference is necessary.
DPS uses posterior sampling for preference-based RL, achieving a first regret guarantee.
problem Formal frameworks for preference-based RL with theoretical analysis.
method Preference-based posterior sampling, Bayesian credit assignment.
result First asymptotic Bayesian no-regret rate for preference-based RL.
Enhances preference learning by incorporating response times into binary choices.
problem Limited information from binary choices about preference strength.
method Combines choices and response times using the EZ diffusion model.
result Response times improve utility estimation for strong preferences.
Bayesian optimization learns DM preferences for multi-outcome experiments.
problem Optimizing expensive experiments with unknown utility functions and multiple outcomes.
method Alternates preference learning and Bayesian optimization, using pairwise comparisons.
result Preference exploration strategies improve Bayesian optimization performance.
New study shows personalized content recommendations can lead to polarization of user preferences.
problem Personalized content recommendations can alter user preferences, leading to polarization.
method Used a model of preference dynamics to explore how personalized content affects user preferences.
result Standard reward maximization algorithms achieve only constant regret in personalized recommendation environments.
Bayesian optimization agent learns user preferences from pairwise comparisons.
problem Learning user preferences from unknown and infinite choices.
method Sequential Bayesian optimization with pairwise comparisons.
result Optimal agent strategy minimizes remaining system uncertainty.
New RLHF framework handles general preference oracles without reward functions.
problem Handling general preference oracles without assuming a reward function.
method Developed a minimax game between two LLMs for RLHF under a general preference oracle, focusing on KL-regularized preference.
result Proposed algorithms for efficient offline and online RLHF learning.