ATPboost uses ATP feedback for binary premise selection in large-theory problem solving.
problem Learning relevant premises for ATP-based theorem proving in binary classification.
method Binary classification using XGBoost, with negative examples generated from alternative proofs.
result ATPboost outperforms k-nearest neighbors in binary premise selection.
Deep RL for ATP in intuitionistic logic, outperforming existing methods.
problem Automated theorem proving in intuitionistic propositional logic.
method Deep reinforcement learning with novel data augmentation and graph neural networks.
result Our prover outperforms Coq's tauto tactic, solving 84% of the theorems in a benchmark library.
Alternative dynamic paired comparison model using Gaussian Processes.
problem Sports prediction and ranking players or teams.
method Dynamic paired comparison model with Gaussian Process priors, incorporating covariates, and efficient Bayesian inference.
result The GP model outperforms Elo and Glicko on log loss, especially with surface covariates.
Two approaches use TDA and graph theory for tennis match prediction.
problem Predicting tennis match outcomes using network features.
method Lower-star filtration on player competitive networks, Random Forest model, modified Katz similarity index.
result TDA features alone can achieve above-chance prediction in tennis match outcomes.
Improved UCB and Thompson Sampling policies for CMAB with probabilistically triggered arms achieve bounded regret.
problem Combinatorial multi-armed bandit problem with probabilistically triggered arms.
method Upper Confidence Bound (UCB) policies and Combinatorial Thompson Sampling (CTS).
result CUCB- κ κ κ and CTS achieve O ( T ) O(\sqrt{T}) O ( T ) gap-independent regret. A new method combines EMD and diffusion maps for protein shape analysis.
problem Learning shape spaces of flexible macromolecules.
method Combines Earthmover's distance with diffusion maps for dimensionality reduction.
result EMD-based diffusion maps require fewer samples to recover intrinsic geometry.
A new ranking model uses nonnegative matrix factorization for tennis players.
problem Modeling latent variables influencing tennis player performance.
method Combines Bradley-Terry-Luce model with nonnegative matrix factorization.
result Model identifies surface type as key determinant of male player performance.
New insights into cascade feedback linearization of control systems.
problem Obtaining a cascade feedback linearization for invariant control systems.
method Introducing truncated versions of operators from the calculus of variations to prove new theorems.
result Established new geometry and foundational theorems for future work.
Paper proposes a combined model for better recommendation by integrating explicit and implicit feedbacks.
problem Improve recommendation accuracy by considering both explicit and implicit feedbacks.
method Developed three models (RHC-PMF, RV-PMF, RHCV-PMF) that incorporate users' explicit and implicit feedbacks for better rating prediction.
result RHCV-PMF model outperforms other models in cold start scenarios for both users and items.
New method learns from either positive or negative feedback alone.
problem Limited applicability of existing preference optimization methods in scenarios with only unpaired feedback.
method Decouples learning from positive and negative feedback, using expectation-maximization (EM) to optimize probability of positive outcomes and explicitly incorporate negative examples.
result Stable learning from negative feedback alone demonstrated.
Study on RL from human bandit feedback for sequence-to-sequence learning, showing reliability and learnability.
problem Reliability and learnability of human bandit feedback for RL from sequence-to-sequence learning.
method Investigated reliability of human bandit feedback, analyzed influence on reward estimator learnability, and tested improvements with regression-based reward estimator.
result Improvements of over 1 BLEU can be achieved by integrating a regression-based reward estimator trained on cardinal feedback into RL for NMT.
User preferences for items can be inferred from either explicit feedback, such as item ratings, or implicit feedback, such as rental histories. Research in collaborative filtering has concentrated on explicit feedback, resulting in the development of accurate and scalable models. However, since explicit feedback is oft…
New algorithms for best arm identification in delayed feedback MABs.
problem Best arm identification in multi-armed bandits with delayed feedback.
method Generalized framework for modeling partial and delayed feedback, efficient algorithms for biased and unbiased estimators, and parallel MAB extensions.
result Exploiting partial feedback can lead to significant improvements over baselines in sequential and parallel MAB settings.
This paper improves image retrieval accuracy through novel relevance feedback methods.
problem Improving image retrieval accuracy in Content-Based Image Retrieval (CBIR).
method Novel addition to feature re-weighting and classification techniques, focusing on 0-th iteration improvement.
result Significantly improved retrieval accuracy from relevance feedback.
Study evaluates new models using human feedback from another model.
problem Evaluate a new model using human feedback collected for another model.
method Formalize problem, propose model-based and model-free estimators, analyze unbiasedness, and empirically evaluate.
result Proposed estimators can predict absolute values, rank, and optimize evaluated policies.
Develops a new model for RLHF accounting for partially observed states and intermediate feedback.
problem Lack of models for partially observed states and intermediate feedback in RLHF.
method PORRL model with cardinal and dueling feedback methods.
result Demonstrates improved learning and alignment with new model-based and model-free methods.
Classifier learns to ignore unreliable feedback from end users.
problem Improving classifier performance by filtering unreliable feedback.
method Modeling end users as autonomous agents, periodically retraining classifier with filtered feedback.
result Classifier can identify and filter out unreliable feedback, improving performance.
Optimizes heating setpoints with uncertain loads using various feedback types.
problem Optimizing heating setpoints with uncertain, flexible loads.
method Online convex optimization (OCO) with different types of feedback.
result Sublinear regret bounds achieved in all feedback types.
Paper characterizes minimax regret rates for online ranking with top-k feedback.
problem Analyzing online ranking with partial feedback.
method Developed techniques from partial monitoring to characterize minimax regret rates.
result Full characterization of minimax regret rates for Precision@n.
Study on sample complexity for pure exploration in feedback graph settings.
problem Sample complexity of pure exploration in online learning with feedback graphs.
method Derive instance-specific lower bounds and present asymptotically optimal algorithm TaS-FG.
result TaS-FG is asymptotically optimal and efficient across different graph configurations.
Study of online learning with noisy feedback in adversarial settings.
problem Adversarial online learning with noisy feedback.
method Models of adversarial online learning with binary losses xored by noise, considering both constant and variable noise rates.
result Tight regret bounds for learning with noise in adversarial online learning.
CNN predicts stock fluctuations using company news headlines.
problem Predicting next-day stock fluctuations based on company-specific news.
method Convolutional Neural Network (CNN) with reduced filter dimensions and multiple hidden layers. Fine-tuned word embeddings and various filter widths.
result 61.7% classification accuracy achieved using pre-learned embeddings.
One-bit feedback suffices for a bandit problem's optimal strategy.
problem Optimal strategy for multi-armed bandit problem with limited feedback.
method Coding and decoding schemes for one-bit feedback to mimic full-reward feedback.
result Regret ratio approaches 1 with one-bit feedback.
Advocates a local feedback approach for RL in unknown systems.
problem Finding optimal feedback laws in unknown nonlinear dynamical systems.
method Searches over a local feedback representation consisting of an open-loop sequence and an optimal linear feedback law.
result Results in highly efficient training and superior performance compared to global methods.
A method corrects feedback shift in predicting conversion rates with delayed feedback.
problem Delayed feedback leads to mislabeling of positive instances in training data.
method Uses importance weight approach to correct feedback shift.
result Proposed method outperforms existing methods in offline and online experiments.
Study how communication and feedback graphs affect learning outcomes.
problem Understanding the impact of feedback graphs on cooperative online learning.
method Analyzed network regret in terms of the independence number of the strong product of communication and feedback graphs.
result Proved bounds for network regret and demonstrated the non-improvable nature of positive results in pathological cases.
New algorithms minimize regret in combinatorial online learning with relative feedback.
problem Minimizing regret in online learning with subset-wise relative preference feedback.
method Instance-dependent and order-optimal regret algorithms for two settings: bounded size subsets and fixed size subsets.
result Regret bounds of O ( n m ln T ) O(\frac{n}{m} \ln T) O ( m n ln T ) and O ( n k ln T ) O(\frac{n}{k} \ln T) O ( k n ln T ) for respective settings. New method uses correlated auxiliary feedback to reduce regret in parameterized bandits.
problem Reducing regret in parameterized bandits with correlated auxiliary feedback.
method Develops a reward estimator using auxiliary feedback with tight confidence bounds.
result Shows significant reduction in regret compared to standard methods.
Test for linearizing 2-input systems with 2D feedback.
problem Linearizability of two-input systems by feedback.
method Algorithmic test for 2D endogenous feedback.
result Systematic derivation of flat outputs.
Reduces user feedback needed for accurate recommender systems.
problem Limited user feedback in recommender systems.
method Partial Bandit and Semi-Bandit approach for efficient user feedback retrieval.
result Similar global accuracy and learning efficiency with reduced feedback.
DeepJSCC-f uses feedback to improve image transmission quality.
problem Improve image transmission quality in feedback channels.
method Autoencoder-based joint source-channel coding (DeepJSCC-f) exploiting feedback.
result Improves reconstruction quality for fixed-length or variable-length transmission.
Study of reinforcement learning with additional feedback observations.
problem Episodic reinforcement learning in Markov decision processes with feedback observations.
method Formalization of feedback graph, model-based algorithms leveraging feedback, regret bound analysis.
result Regret bound depends only on the size of the maximum acyclic subgraph of the feedback graph.
New algorithm for recommending best arms with aggregated feedback.
problem Finding the best arm under aggregated feedback when precise rewards are unavailable.
method Gaussian Process Optimistic Optimisation (GPOO) algorithm with adaptive tree construction.
result The proposed algorithm achieves new simple regret bounds with aggregated feedback.
The problem of feedback equivalence for control systems is considered. An algebra of differential invariants and criteria for the feedback equivalence for regular control systems are found.
CausalRM models rewards from user feedback, overcoming noise and bias.
problem Aligning language models with user preferences from noisy, biased feedback.
method Causal-theoretic reward modeling framework addressing noise and bias in observational feedback.
result CausalRM learns accurate reward signals from noisy and biased observational feedback.
Paper tackles noisy bandit feedback for multiclass classification.
problem Learning multiclass classifier with corrupted feedback.
method Proposes an unbiased estimator technique to estimate noise rates and an end-to-end framework.
result Algorithm achieves mistake bounds of O ( T ) O(\sqrt{T}) O ( T ) in high noise and O ( T i c e f r a c 23 ) O(T^{
icefrac{2}{3}}) O ( T i ce f r a c 2 3 ) in worst case. Improves neural semantic parsers using human feedback.
problem Improving neural semantic parsers through human feedback.
method Counterfactual learning from human bandit feedback, reweighting estimator, stochastic gradient optimization.
result Significant improvement in semantic parsers achieved.
Active learning framework for optimizing human preferences in reinforcement learning.
problem Selecting most informative feedback for training models of human preferences.
method Proposes an active learning framework to collect preferential feedback online or offline.
result Errors in DPO logit estimates diminish with more feedback.
Deep RL system learns from user feedback to improve recommendations.
problem Challenges in incorporating negative feedback into recommender systems.
method Modeling interactions as MDP, using RL to learn optimal strategies, incorporating both positive and negative feedback.
result Deep recommender system (DEERS) effectively learns from user feedback.
Easy conditions found for simplifying complex systems.
problem Linearizing complex two-input systems.
method Endogenous dynamic feedback with a dimension of at most two.
result Necessary and sufficient conditions for linearizability.
Paper studies CLO with partial feedback, improving decision-making in uncertain contexts.
problem Improving decision-making in contexts with uncertain cost coefficients using partial feedback.
method Unified class of offline learning algorithms for CLO with different types of feedback, using IERM framework.
result Fast-rate regret bound for IERM with partial feedback and misspecified model classes.
CAFL breaks feedback loops in recommender systems using causal inference.
problem Feedback loops in recommender systems compromise recommendation quality and homogenize user behavior.
method Causal Adjustment for Feedback Loops (CAFL) algorithm that breaks feedback loops using causal inference.
result CAFL improves recommendation quality compared to prior correction methods.
Unified framework for expert selection with bandit and lower-bound feedback.
problem Selecting the best expert in scenarios with bandit feedback and lower-bound information.
method Introduces a new feedback model combining bandit and lower-bound information, proving optimal regret bounds for modified Exp3 algorithms.
result Optimal regret bounds for modified Exp3 algorithms, generalizing both bandit and full-information settings.
New algorithms handle online prediction with bandit and delayed feedback, improving regret bounds.
problem Achieving finite bounds on surrogate regret with limited feedback.
method Proposed algorithms for bandit and delayed feedback, including inverse-weighted gradient and pseudo-inverse matrix estimators.
result Achieved improved surrogate regret bounds of O ( K T ) O(\sqrt{KT}) O ( K T ) and O ( T 2 / 3 ) O(T^{2/3}) O ( T 2/3 ) . GAIF enhances online multiple testing with feedback, improving statistical power.
problem Sequential online multiple testing with delayed feedback.
method GAIF framework using dynamic threshold adjustment and feedback-driven model selection.
result Improves statistical power through feedback-driven model selection.
New method provides fine-grained feedback on interactive student programs.
problem Time-consuming manual grading of interactive student programs.
method Meta-exploration approach using reinforcement learning.
result 94.3% accuracy in providing fine-grained feedback.
Improves labeling quality in machine learning with pairwise feedback.
problem Scalability and quality of labeled datasets in machine learning.
method Incorporates pairwise feedback into the programmatic creation of labeled datasets.
result Even a small number of pairwise feedback sources can substantially improve label quality.
The paper proposes a new method for learning reward models from ordinal feedback, improving upon binary feedback.
problem Learning reward models from human preferences using binary feedback discards useful samples and loses fine-grained information.
method The paper introduces a framework for learning reward models under ordinal feedback, generalizing the Bradley-Terry model.
result Ordinal feedback reduces the Rademacher complexity compared to binary feedback, leading to better reward learning.