Upper and lower bounds derived for online learning with graph-structured feedback against adaptive adversaries.
problem Online learning with graph-structured feedback against adaptive adversaries.
method Analysis of Exp3 algorithm variants and lower bounds for specific adversary models.
result Upper bounds of O ~ ( T 2 / 3 ) \widetilde O(T^{2/3}) O ( T 2/3 ) and O ~ ( T 3 / 4 ) \widetilde O(T^{3/4}) O ( T 3/4 ) for strongly-observable and weakly-observable graphs, respectively. FAWMF adapts weights for implicit feedback recommendation efficiently.
problem Challenges in treating unobserved data as negative in implicit feedback recommendation.
method FAWMF uses a variational auto-encoder with a parameterized neural network to adaptively assign personalized data confidence weights, and fBGD for efficient learning.
result FAWMF and fBGD outperform existing methods in real-world datasets.
Quantized Adam reduces communication cost in deep learning training.
problem Reducing communication cost in distributed deep learning training.
method Gradient and weight quantization with error feedback in Adam.
result Proposed methods converge to first-order stationary points.
Adaptive MAB algorithms handle composite, anonymous feedback without reward interval knowledge.
problem Multi-armed bandit with composite and anonymous feedback, especially without reward interval size knowledge.
method Proposed adaptive algorithms for stochastic and adversarial cases, without reward interval knowledge.
result First algorithm for adversarial case handling non-oblivious adversary and unknown reward interval size.
Develops hedging algorithm for online expert weight allocation with delayed feedback.
problem Adaptive hedging strategies for online expert weight allocation with delayed feedback.
method General Hedging algorithm G \mathcal{G} G based on exponential reweighing of experts' losses. result Proves adversarial loss bounds for the General Hedging algorithm G \mathcal{G} G in the delayed feedback setting. ELF improves FM forecasts by efficiently using online feedback.
problem Fixed FMs fail to adapt to current data characteristics.
method ELF-Forecaster learns current data distribution, ELF-Weighter combines forecasts.
result ELF improves FM forecasts across various datasets.
Unified framework for analyzing online convex optimization across various settings.
problem Analyzing online convex optimization in different settings and feedback types.
method Unified framework allowing systematic proposal and analysis of meta-algorithms.
result Comparable regret bounds for various feedback types and adversary types.
Paper fine-tunes LLMs using user edits, unifying preference, supervision, and reward feedback.
problem Adapting LLMs to user preferences and feedback types.
method Derives bounds for learning algorithms from user edits, proposes an ensembling procedure.
result Ensembling procedure outperforms individual feedback methods and robustly adapts to different user-edit distributions.
Study the tradeoffs of bandit feedback in multiclass classification.
problem The price of using bandit feedback in multiclass classification.
method Mistake bound model, analysis of variants, and comparison of learners and adversaries.
result The optimal mistake bound under bandit feedback is at most O ( k ) O(k) O ( k ) times higher than in full information, with a tight bound of O ( k ) O(k) O ( k ) . Algorithm improves query recommendations with immediate user feedback.
problem Lack of adaptability to immediate user feedback in query recommendation algorithms.
method Augmented transformer-based causal language models with multi-armed bandit framework.
result Substantial improvement in per-round regret compared to state-of-the-art models.
Bayesian model identifies three types of travelers adapting to feedback.
problem Capturing adaptive, feedback-driven travel behavior in heterogeneous individuals.
method Latent Class Reinforcement Learning (LCRL) model with Variational Bayes estimation.
result Three distinct traveler classes identified: context-dependent, persistent exploitative, and exploratory.
ATLAS uses LLMs to adaptively trade by optimizing prompts and coordinating agents.
problem Adapting LLMs for real-time financial decision-making in noisy markets.
method ATLAS integrates structured market data, uses Adaptive-OPRO for prompt optimization, and employs multi-agent coordination.
result Adaptive-OPRO consistently outperforms fixed prompts in financial trading.
This work achieves finite-time stabilization of uncertain LQ systems using random feedbacks.
problem Stabilizing linear systems with unknown dynamics in finite time.
method Random linear feedbacks to achieve finite-time stabilization.
result High probability guarantees for finite time stabilization of LQ systems.
Agents learn user preferences with less explicit feedback via spatial interface valuing.
problem Learning user preferences with high cognitive load feedback.
method Spatial Interface Valuing for reduced explicit feedback.
result Agents learn faster with spatial interface valuing compared to explicit feedback.
Paper measures cognitive bias in positive feedback trading using diffusion process estimates.
problem Measuring cognitive bias in positive feedback trading behavior.
method Conditional estimates of diffusion processes to quantify bias, proving asymptotic properties.
result Bias in positive feedback trading converges to zero over time, leading to adaptive expectations.
New algorithm improves cache management with delayed feedback and decaying costs.
problem Improving cache replacement policies with delayed and decaying costs feedback.
method Proposed EXP4-DFDC adaptive reinforcement learning algorithm.
result Expected regret is a vanishing quantity as a function of time.
Adaptive reward models capture individual preferences from human feedback.
problem Learning a reward model that can be specialised to a user.
method Empirical risk minimisation and PAC bound analysis.
result Adaptive reward models benefit from the heterogeneity of user preferences.
Gaussian Process improves tracking control for unknown systems.
problem Challenges in perfect tracking control for real-world Euler-Lagrange systems.
method Employing Gaussian Process regression for data-driven model of unknown dynamics and adaptive feedback gains.
result Guaranteed globally bounded tracking error with specific probability.
Estimates mode from partial feedback, improving AI learning pipelines.
problem Estimating the mode of a distribution with partial feedback.
method Entropy coding, coarse sufficient statistics, bandit algorithms.
result Statistically and computationally efficient solution to mode estimation.
Optimizes clustering from noisy binary feedback in crowdsourcing.
problem Clustering items from binary user feedback with noisy answers.
method Develops algorithms for clustering items using adaptive selection of questions and items.
result Adaptive algorithm achieves performance close to information-theoretical limits.
New algorithm for recommending best arms with aggregated feedback.
problem Finding the best arm under aggregated feedback when precise rewards are unavailable.
method Gaussian Process Optimistic Optimisation (GPOO) algorithm with adaptive tree construction.
result The proposed algorithm achieves new simple regret bounds with aggregated feedback.
Study on collaborative vs. non-collaborative online and bandit convex optimization.
problem Minimizing average regret in distributed online and bandit convex optimization.
method Analyzes the impact of collaboration in adaptive and zeroth-order feedback settings.
result Collaboration is beneficial in high-dimensional federated online optimization with limited feedback.
Delaytron learns multi-class classifiers with delayed feedbacks, achieving efficient regret bounds.
problem Learning multi-class classifiers with delayed bandit feedbacks where delays are unknown.
method Online algorithm Delaytron with adaptive learning for unknown delays.
result Achieves efficient regret bounds for various loss scenarios.
Study selective classification with limited feedback in online learning.
problem Resource-limited and safety-critical domains where feedback is only received on abstentions.
method Versioning-based schemes for minimizing mistakes and abstentions.
result Constructed schemes that make few mistakes and minimal excess abstentions.
Paper tackles domain adaptation for contextual bandits with sub-linear regret.
problem Adapting contextual bandit algorithms across domains with distribution shift.
method Learn a bandit model for the target domain using feedback from the source domain.
result Sub-linear regret bound maintained across domains.
Few-shot learning improved with semi-supervised and active methods.
problem Few-shot classification with limited labeled data.
method Prototypical Networks features combined with K K K -means clustering guided by few labeled examples and user feedback. result Active adaptation through user feedback significantly improves performance.
New oracle uses uncertainty for active classification with noisy feedback.
problem Improving query complexity in interactive binary classifier learning.
method Proposes a new pairwise comparison oracle that considers uncertainty and an adaptive labeling algorithm.
result Demonstrates improved performance and efficiency compared to existing methods.
Online boosting for multilabel ranking with limited feedback.
problem Multilabel ranking with top-k feedback.
method Surrogate loss function and unbiased estimator for weak learners.
result Adapted full information multilabel ranking algorithms to top-k feedback setting with theoretical and experimental support.
Paper proposes E/PD-Control for better neural network training.
problem Training efficiency and robustness of CNNs in online data flows.
method E/PD-Control combines feedback PD controller with exponential signal.
result Better learning efficiency and robustness demonstrated experimentally.
Adaptive lateral connections improve visual action recognition.
problem Feedforward neural models lack feedback and lateral connections like the primate visual cortex.
method Dynamic weights in recurrent lateral connections, iteratively reintroduced input.
result Significant performance gains in visual action recognition without pretraining.
New algorithm reduces dynamic regret in time-varying movement costs.
problem Dynamic regret in online convex optimization with time-varying movement costs.
method Introduced a novel algorithm for time-varying movement costs, achieving comparator-adaptive dynamic regret bound.
result Established first comparator-adaptive dynamic regret bound of O ~ ( ( M 2 + M P T ) ( T + ∑ t λ t ) ) \widetilde{\mathcal{O}}(\sqrt{(M^2+MP_T)(T+\sum_t λ_t)}) O ( ( M 2 + M P T ) ( T + ∑ t λ t ) ) . Seeker allows real-time feedback to refine search results.
problem Users struggle to accurately describe desired items in words.
method Interactive refinement of search results through user feedback.
result Seeker improves search quality through user feedback.
New algorithm reduces regret in delayed feedback generalised linear bandits.
problem Regret in delayed feedback generalised linear bandits.
method Adaptation of optimistic algorithm to delayed feedback.
result Achieves a regret bound independent of the horizon's delay penalty.
The paper tackles efficient change point detection with limited samples.
problem Identifying multiple change points with minimal queries in noisy environments.
method Adaptive algorithm that first detects likely change points and refines their locations.
result The sample complexity is jointly governed by jump magnitudes and change point positions.
New algorithm handles delayed feedback robustly, reducing regret without knowing delay bounds.
problem Bandits with variably delayed feedback, especially excessive delays.
method Implicit exploration scheme, adaptive skipping, drifted regret control.
result Can tolerate arbitrary excessive delays up to order T, reducing regret.
Quantum-enhanced metrology aims to estimate an unknown parameter such that the precision scales better than the shot-noise bound. Single-shot adaptive quantum-enhanced metrology (AQEM) is a promising approach that uses feedback to tweak the quantum process according to previous measurement outcomes. Techniques and form…
New algorithm learns Gaussian policies from corrective human feedback, outperforming current methods.
problem Learning from corrective human feedback for complex systems.
method Gaussian Process Coach (GPC) that uses Gaussian Processes and policy uncertainty for optimal feedback selection and learning rate adaptation.
result Demonstrated superior performance in OpenAI Gym benchmarks compared to COACH.
Proposes RPG-RT for red-teaming T2I models without internal access.
problem Evaluating T2I models' security through red-teaming is challenging due to their closed-source nature and unknown defense mechanisms.
method Integrates LLM and rule-based preference modeling to dynamically adapt to unknown defense mechanisms.
result Demonstrates superior and practical approach for red-teaming T2I models.
A new method for online prediction uncertainty quantification in non-exchangeable panel data.
problem Challenges in quantifying predictive uncertainty for non-exchangeable panel data.
method Online conformal prediction framework for non-exchangeable panel data, using similarity weights and adaptive miscoverage levels.
result Improves coverage on worst-covered target units through adaptive interval-width allocation.
A new neural machine translation method learns from human feedback and reduces human effort.
problem Efficiently reducing human effort in interactive-predictive neural machine translation.
method Learning from human reinforcements, using entropy for feedback triggers, and online model updates.
result Significant improvement in translation quality with reduced human feedback requests.
Semi-supervised method enhances recommendation from sparse data.
problem Data sparsity in implicit feedbacks and lack of negative samples.
method Domain adaptation using textual features to align latent spaces.
result Our models significantly outperform existing models on real-world datasets.
Survey of MAB strategies for non-stationary reward distributions with delayed feedback.
problem Optimizing product availability in an online grocery pick-up platform with non-stationary and delayed reward feedback.
method Evaluation of ε ε ε -greedy, UCB1, Thompson Sampling, and a new adaptive technique (AG1) in MAB simulations. result AG1 outperforms traditional MAB strategies in minimizing regret for non-stationary and delayed feedback.
Bandit structured prediction describes a stochastic optimization framework where learning is performed from partial feedback. This feedback is received in the form of a task loss evaluation to a predicted output structure, without having access to gold standard structures. We advance this framework by lifting linear ba…
DART optimizes subset selection in non-linear bandit problems.
problem Optimizing subset selection in non-linear bandit problems with correlated rewards.
method DART algorithm for combinatorial bandits without individual arm feedback or linearity assumption.
result DART achieves a regret bound of i l d e O ( K K N T ) ilde{\mathcal{O}}(K\sqrt{KNT}) i l d e O ( K K N T ) . New method clusters items with bandit feedback without parametric assumptions.
problem Clustering with noisy observations from unknown distributions.
method Kernel-based approach to nonparametric clustering with bandit feedback.
result Adaptive algorithm with theoretical guarantees for unknown signal-to-noise ratio.
Modeling ToM in multi-agent games using adaptive feedback control.
problem Understanding how agents predict and model other agents' mental states in complex interactions.
method Embodied and situated agent models based on distributed adaptive control theory.
result Probabilistic learning agents outperform pure reinforcement-based strategies in game-theoretic tasks.
Adapts Exp3 to adversarial bandits with delays and data.
problem Adversarial multi-armed bandits with delayed feedback.
method Tuned Exp3 variants with step-size adaptation and implicit exploration.
result Optimal regret bounds of log ( K ) ( T K + D ) \sqrt{\log(K)(TK + D)} log ( K ) ( T K + D ) with high probability. Adaptive sampler improves recommendation for implicit feedback data.
problem Challenges in predicting user preferences from implicit feedback data.
method Noisy-label robust learning for adaptive sampler design.
result Significant improvement in recommendation quality on real-world datasets.