The paper analyzes online learning with probabilistic graph feedback, matching regret bounds with high probability.
problem Online learning with probabilistic graph feedback, covering both one-step and cascade cases.
method Analyzed asymptotic lower bounds and designed algorithms for both cases, matching regret bounds with high probability.
result Regret upper bounds match asymptotic lower bounds with high probability.
FCMs model feedback in complex systems, combining expert knowledge and statistical learning.
problem Modeling feedback in complex, interconnected systems.
method Fuzzy cognitive maps (FCMs) as fuzzy signed directed graphs, allowing for feedback loops and nonlinear dynamics.
result FCMs can better represent domain knowledge and simulate policy scenarios compared to DAGs.
Study on sample complexity for pure exploration in feedback graph settings.
problem Sample complexity of pure exploration in online learning with feedback graphs.
method Derive instance-specific lower bounds and present asymptotically optimal algorithm TaS-FG.
result TaS-FG is asymptotically optimal and efficient across different graph configurations.
User preferences for items can be inferred from either explicit feedback, such as item ratings, or implicit feedback, such as rental histories. Research in collaborative filtering has concentrated on explicit feedback, resulting in the development of accurate and scalable models. However, since explicit feedback is oft…
Study how communication and feedback graphs affect learning outcomes.
problem Understanding the impact of feedback graphs on cooperative online learning.
method Analyzed network regret in terms of the independence number of the strong product of communication and feedback graphs.
result Proved bounds for network regret and demonstrated the non-improvable nature of positive results in pathological cases.
Graph-based feedback improves bandit algorithms' performance.
problem Stochastic multi-armed bandit problem with graph feedback.
method Analysis of Thompson Sampling and UCB algorithms in graph-based feedback setting.
result Regret bounds that combine graph structure and arm means gaps.
We study an online learning framework introduced by Mannor and Shamir (2011) in which the feedback is specified by a graph, in a setting where the graph may vary from round to round and is \emph{never fully revealed} to the learner. We show a large gap between the adversarial and the stochastic cases. In the adversaria…
Study of reinforcement learning with additional feedback observations.
problem Episodic reinforcement learning in Markov decision processes with feedback observations.
method Formalization of feedback graph, model-based algorithms leveraging feedback, regret bound analysis.
result Regret bound depends only on the size of the maximum acyclic subgraph of the feedback graph.
New algorithm improves bandit with graph feedback by decomposing regret.
problem Improving performance in bandit problems with graph feedback.
method Partition-based algorithm framework using regret decomposition.
result Improved and optimal regret bounds on various graph families.
DFNets uses feedback-looped filters for better graph CNN performance.
problem Improving CNN performance on graph structured data.
method DFNets incorporates feedback-looped spectral graph filters.
result DFNets outperforms state-of-the-art methods in document and entity classification tasks.
New method uses feedback to improve deep reinforcement learning efficiency.
problem Vast amounts of data needed for reasonable performance in deep reinforcement learning.
method Binary corrective feedback combined with probabilistic conditional exploration.
result Achieves drastic improvements in sample efficiency and robustness.
Neural ODEs control graph dynamics with low energy feedback.
problem Controlling complex dynamical systems on graphs.
method Neural Ordinary Differential Equation Control (NODEC) framework.
result NODEC learns low-energy control signals for graph dynamical systems.
New algorithm reduces bandit regret by graph domination number.
problem Adversarial multi-armed bandit with partial observations and switching costs.
method New algorithm with improved policy regret bounds.
result Regret depends only on the domination number of the feedback graph.
Novel algorithms for online learning with uncertain feedback graphs reduce regret.
problem Uncertainty in feedback graphs hinders traditional online learning approaches.
method Developed novel online learning algorithms to handle uncertain feedback graphs.
result Proved sublinear regret under mild conditions for the proposed algorithms.
Graph-based approach repairs programs from diagnostic feedback.
problem Learning to repair programs from limited labeled data and compiler error messages.
method Introduces program-feedback graph and graph neural network for reasoning, and self-supervised learning with unlabeled programs.
result DrRepair significantly outperforms prior work, achieving high repair rates.
We consider stochastic multi-armed bandit problems with graph feedback, where the decision maker is allowed to observe the neighboring actions of the chosen action. We allow the graph structure to vary with time and consider both deterministic and Erdős-Rényi random graph models. For such a graph feedback model, we fir…
This paper extends combinatorial semi-bandits to graph feedback, improving regret bounds.
problem Adversarial combinatorial semi-bandits with graph feedback.
method Introduced graph feedback in combinatorial semi-bandits, using convexified actions and online stochastic mirror descent.
result Optimal regret scales as S T + α S T S\sqrt{T}+\sqrt{αST} S T + α S T , interpolating between full and semi-bandit feedback. Generative grading improves automated feedback for structured problems.
problem Difficulty in providing high-quality feedback on structured assignments.
method Generative descriptions of student cognition, probabilistic programs, and learning to infer feedback.
result Achieved near-human accuracy in grading and feedback across diverse domains.
New algorithm reduces high-probability regret for time-varying feedback graphs.
problem High-probability regret bounds for adversarial bandits with time-varying feedback graphs.
method Online mirror descent framework with innovative techniques for pessimistic loss estimators.
result Achieves optimal high-probability regret bound for general and weakly observable graphs.
We derive upper and lower bounds for the policy regret of T T T -round online learning problems with graph-structured feedback, where the adversary is nonoblivious but assumed to have a bounded memory. We obtain upper bounds of O ~ ( T 2 / 3 ) \widetilde O(T^{2/3}) O ( T 2/3 ) and O ~ ( T 3 / 4 ) \widetilde O(T^{3/4}) O ( T 3/4 ) for strongly-observable and weakly-observab…
Develops hedging algorithm for online expert weight allocation with delayed feedback.
problem Adaptive hedging strategies for online expert weight allocation with delayed feedback.
method General Hedging algorithm G \mathcal{G} G based on exponential reweighing of experts' losses. result Proves adversarial loss bounds for the General Hedging algorithm G \mathcal{G} G in the delayed feedback setting. Improved Boltzmann exploration reduces regret in stochastic MAB problems.
problem Improving regret in stochastic multi-armed bandit problems.
method A modified Boltzmann exploration with a doubling trick.
result Achieves O ( K log 1 + α T ) O(K\log^{1+α} T) O ( K log 1 + α T ) regret, improving on previous results. Paper tackles dense subgraph discovery with noisy feedback.
problem Discover dense subgraphs in edge-weighted graphs with noisy feedback.
method Proposes polynomial-time and scalable algorithms for dense subgraph discovery.
result Polynomial-time algorithm obtains nearly-optimal solution with high probability.
New graph feedback model for bandits with improved regret bounds.
problem Understanding how graph structure affects regret in bandit problems.
method Introduced fractional weak domination number and k k k -packing independence number to capture upper and lower bounds on regret. Used strong duality theorem to derive upper and lower bounds. result Proved general upper and lower bounds on regret for various graph structures, showing tightness up to a logarithmic factor.
We present a simple uniqueness argument for a collection of McKean-Vlasov problems that have seen recent interest. Our first result shows that, in the weak feedback regime, there is global uniqueness for a very general class of random drivers. By weak feedback we mean the case where the contagion parameters are small e…
New method learns from either positive or negative feedback alone.
problem Limited applicability of existing preference optimization methods in scenarios with only unpaired feedback.
method Decouples learning from positive and negative feedback, using expectation-maximization (EM) to optimize probability of positive outcomes and explicitly incorporate negative examples.
result Stable learning from negative feedback alone demonstrated.
We study multi-armed bandit problems with graph feedback, in which the decision maker is allowed to observe the neighboring actions of the chosen action, in a setting where the graph may vary over time and is never fully revealed to the decision maker. We show that when the feedback graphs are undirected, the original …
SBO uses dual voting to build consensus in noisy feedback settings.
problem Collective decision-making under social influence.
method Dual voting system with noisy public votes and private interviews.
result Efficient consensus-building through noisy public votes, debiased by estimated social graph.
New bounds for bandits with graph feedback, improving previous results.
problem Adversarial multi-armed bandits with graph feedback, focusing on small-loss bounds.
method Developed algorithms with regret bounds i l d e O ( κ L ∗ ) \mathcal{ ilde{O}}(\sqrt{κL_*}) i l d e O ( κ L ∗ ) and i l d e O ( min { α T , κ L ∗ } ) \mathcal{ ilde{O}}(\min\{\sqrt{αT}, \sqrt{κL_*}\}) i l d e O ( min { α T , κ L ∗ }) . result Significant improvement and extension of previous results by Lykouris et al. (2018).
Unified framework for differentiable graph partitioning with probabilistic cuts.
problem Lack of general guarantees and principled gradients in prior probabilistic relaxations of graph cuts.
method Unified probabilistic framework covering a wide class of cuts, including Normalized Cut, with tight analytic upper bounds.
result Rigorous, numerically stable foundation for scalable, differentiable graph partitioning.
Enhances AI models with human feedback for noisy data.
problem Improving AI model alignment with human feedback in noisy environments.
method Two-stage SL+LHF framework connecting machine learning with human feedback.
result The LNCA ratio identifies conditions for SL+LHF superiority over pure SL.
The paper tracks patient recovery using graphs of joint movement data.
problem Tracking individual patient recovery trajectories in physical therapy.
method Bayesian learning of Random Geometric Graphs from joint movement data.
result Optimal exercise routines can be recommended based on patient recovery data.
Method converts sparse systems to dense ones for statistical mechanics problems.
problem Statistical mechanics on sparse graphs
method Extracts a Feedback Vertex Set, learns variational distribution, estimates free energy.
result More accurate and faster than existing methods for sparse systems.
Graph-EFM models weather uncertainty with graph-based ensembles.
problem Accurately capturing forecast uncertainty in chaotic weather.
method Flexible latent-variable formulation with hierarchical graph construction.
result Graph-EFM ensembles achieve equivalent or lower errors than deterministic models.
New graph types help identify complex relationships.
problem Understanding complex relationships in data.
method Introducing separable and essentially separable graphs to characterize and identify graphical models.
result Developed algorithms to identify equivalence classes of essentially separable graphs.
Paper analyzes GCNN sensitivity to probabilistic graph perturbations.
problem Investigating how GCNNs handle probabilistic graph errors.
method Establishes error bounds and linear relationships between GSO perturbations and GCNN outputs.
result GCNNs maintain stability under graph edge perturbations if GSO errors are bounded.
Improved community detection in graphs with probabilistic models.
problem Lack of probabilistic formulation and fixed number of communities in GNN-based methods.
method Combines GNNs with amortized clustering for variable numbers of clusters.
result Improved performance on synthetic and real datasets compared to previous methods.
New algorithm improves graph inference tasks.
problem Complex graph reasoning and prediction tasks.
method Policy Message Passing algorithm reformulates graph inference as stochastic sequential processes.
result Consistently outperforms state-of-the-art models.
New method calibrates probabilistic linear solver for online coverage guarantees.
problem Uncertainty in probabilistic linear solver solutions without coverage guarantees.
method Online conformal prediction-PLS (OCP-PLS) method to calibrate uncertainty thresholds.
result Validates online calibration of uncertainty thresholds via online conformal prediction.
Transformers interpreted as probabilistic Laplacian Eigenmaps steps.
problem Improving transformer performance through probabilistic interpretation.
method Probabilistic Laplacian Eigenmaps model derivation and graph diffusion step.
result Subtracting identity from attention matrix improves transformer performance.
We study online learning when partial feedback information is provided following every action of the learning process, and the learner incurs switching costs for changing his actions. In this setting, the feedback information system can be represented by a graph, and previous works studied the expected regret of the le…
New algorithm for online learning with noisy side observations.
problem Online learning with noisy side feedback and graph-structured dependencies.
method Proposes an algorithm using a weighted directed graph to model dependencies and guarantees a regret bound of O(√α* T).
result Guarantees a regret of O(√α* T) after T rounds, where α* is the effective independence number.
This paper examines probabilistic sampling weighted by uncertainty in active learning.
problem Improving efficiency and effectiveness in active learning.
method Probabilistic sampling weighted by uncertainty, implemented in a single-pass streaming fashion.
result Using probabilistic weighting often benefits active learning, especially with biased initial labeled points.
AGFN improves causal discovery by integrating expert feedback and handling latent confounding.
problem Inaccurate causal discovery due to unreliable expert knowledge and latent confounding.
method Ancestral GFlowNet (AGFN) is a reinforcement learning algorithm that iteratively refines a policy based on noisy expert feedback to infer ancestral graphs.
result AGFN converges to the true ancestral graph given accurate expert responses and outperforms baselines in structural Hamming distance and Bayesian Information Criterion.
NGRs merge sparse graph recovery with PGMs for efficient probabilistic inference.
problem Efficiently recover sparse graphs and learn distributions over variables.
method Integrates sparse graph recovery methods with PGMs using Graph-constrained path norm.
result NGRs can handle multimodal data and perform sparse graph recovery and probabilistic inference.
Graph neural networks improve logic reasoning for large datasets.
problem Combining logic reasoning and probabilistic inference for large datasets.
method Exploring Graph Neural Networks (GNNs) for Markov Logic Networks (MLN) to improve probabilistic logic inference.
result ExpressGNN, a more expressive variant of GNN, can perform effective probabilistic logic inference and scale to large datasets.
A novel 3D shape registration method using spectral graph embedding and probabilistic matching.
problem Challenges in 3D shape analysis and registration, especially with large variability.
method Combining spectral graph matching with Laplacian embedding for large graphs, using commute-time embedding and PCA.
result A method to register shapes with different samplings and isometric deformations.
Unified framework for expert selection with bandit and lower-bound feedback.
problem Selecting the best expert in scenarios with bandit feedback and lower-bound information.
method Introduces a new feedback model combining bandit and lower-bound information, proving optimal regret bounds for modified Exp3 algorithms.
result Optimal regret bounds for modified Exp3 algorithms, generalizing both bandit and full-information settings.