Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

3570104139 · Jun 202019922001200920172026
48 results for Follow Your Leader

Characterizes preferences for decision-making under uncertainty using a leader-follower game model.

problem Decision-making under uncertainty and ambiguity aversion.
method Characterizes niveloidal preferences through a leader-follower game model, satisfying specific axioms.
result The leader's strategy space can serve as an ambiguity aversion index.

We introduce CSE for MLSF games and devise online learning algorithms for achieving no-external Stackelberg-regret.

problem Learning equilibrium in leader-follower games with noisy bandit feedback.
method Proposed Correlated Stackelberg Equilibrium (CSE) and online learning algorithms balancing exploration and exploitation.
result Achieves no-external Stackelberg-regret, converging to approximate CSE.

New RL algorithms learn QSE from strategic feedbacks with sample efficiency.

problem Learning QSE in Markov games with strategic feedbacks.
method Proposes sample-efficient algorithms for online and offline settings, combining quantal response model learning and RL.
result Achieves sublinear regret bounds and quantifies model uncertainty.

Investors with asymmetric information play a game to optimize their portfolios.

problem Two investors with different information levels compete in portfolio selection.
method Modelled as a Stackelberg game with entropy-regularized mean-variance objectives.
result Equilibria exist where follower's strategy depends on leader's actions.

Study of 2imes22 imes 2 zero-sum games with noisy observations and commitments.

problem Analyzing 2imes22 imes 2 zero-sum games with noisy observations and commitments.
method Modeling a 2imes22 imes 2 zero-sum game with a leader committing to a strategy and a follower observing a noisy version of the leader's action.
result Observing the leader's action is either beneficial or immaterial for the follower, and the equilibrium payoff is bounded.

Game theory approach to predicting and responding to interventions based on causal relationships.

problem Optimizing predictions and interventions in response to observational data.
method Prediction-intervention game framework, focusing on invariant subsets of covariates.
result Stable-blanket predictors are optimal for certain follower objectives and under specific conditions.

CB-RL solves complex decision-making problems with contextual information and exogenous events.

problem Optimal policy in strategic decision-making problems that depend on environmental configuration and exogenous events.
method Contextual Bilevel Reinforcement Learning (CB-RL) with a stochastic Hyper Policy Gradient Descent (HPGD) algorithm.
result Demonstrated convergence and performance of the HPGD algorithm for reward shaping and tax design.

FTPL with Fréchet perturbation achieves near optimal regret bounds for m-set semi-bandit problems.

problem Optimizing regret bounds for m-set semi-bandit problems in adversarial and stochastic settings.
method Follow-the-Perturbed-Leader (FTPL) with Fréchet perturbation.
result Achieves near optimal regret bounds of O(nm(dlog(d)+m5/6))\mathcal{O}(\sqrt{nm}(\sqrt{d\log(d)}+m^{5/6})) in adversarial setting and logarithmic regret in stochastic setting.

We study the problem of online learning with non-convex losses, where the learner has access to an offline optimization oracle. We show that the classical Follow the Perturbed Leader (FTPL) algorithm achieves optimal regret rate of O(T1/2)O(T^{-1/2}) in this setting. This improves upon the previous best-known regret rate of…

2019-03-19abs ↗pdf ↗

Adaptive learning rates improve FTPL's BOBW guarantees in bandit problems.

problem Improving Follow-the-Perturbed-Leader's BOBW guarantees in bandit problems.
method Introducing surrogate probability functions to compute adaptive learning rates without exact probabilities.
result BOBW guarantees for FTPL with Pareto perturbations for any α>1α>1.

Paper optimizes FTPL for adversarial and stochastic bandits with specific tail distributions.

problem Optimizing Follow-the-Perturbed-Leader (FTPL) policy for bandit problems.
method Analyzes FTPL with Fréchet-type tail distributions in adversarial and stochastic settings.
result FTPL with certain Fréchet-type tail distributions achieves O(KT)\mathcal{O}(\sqrt{KT}) regrets in adversarial bandits.

SLHF uses sequential game theory to optimize preferences from human feedback.

problem Optimizing preferences from human feedback in sequential settings.
method SLHF frames the problem as a sequential-move game between Leader and Follower, decomposing the optimization into refinement and adversarial optimization.
result SLHF achieves strong alignment across diverse preference datasets and scales to large models.

Paper studies zero-sum games with noisy observations and identifies equilibrium conditions.

problem Zero-sum games with noisy observations of the leader's actions.
method Analyzes the equilibrium of games with noisy action observability, identifies necessary conditions for uniqueness, and investigates the cardinality of best responses.
result The noisy observations significantly impact the cardinality of the follower's set of best responses, and under certain conditions, this set becomes a singleton almost surely.

We analyze linear McKean-Vlasov forward-backward SDEs arising in leader-follower games with mean-field type control and terminal state constraints on the state process. We establish an existence and uniqueness of solutions result for such systems in time-weighted spaces as well as a {convergence} result of the solution…

2018-09-12abs ↗pdf ↗

Advances FTPL results for bandit problems with unbounded perturbations.

problem Improving analytical foundations of FTPL in bandit problems.
method Revisiting classical FTRL-FTPL duality for unbounded perturbations.
result Establishes Best-of-Both-Worlds (BOBW) results for FTPL under a broad family of asymmetric unbounded perturbations.

FTPL policy achieves best-of-both-worlds regret in decoupled bandits with reduced computational cost.

problem Decoupled multi-armed bandit problem with observed and unobserved losses.
method Follow-the-Perturbed-Leader (FTPL) policy that avoids convex optimization and resampling.
result Achieves constant regret in stochastic regime and optimal O(KT)O(\sqrt{KT}) regret in adversarial regime.

Paper analyzes FTPL's effectiveness in combinatorial semi-bandit problems.

problem Optimizing FTPL policy in combinatorial semi-bandit problems.
method Geometric resampling (GR) and conditional geometric resampling (CGR) for FTPL in semi-bandit setting.
result FTPL achieves optimal regret bounds in both Fréchet and Pareto distributions.

Proposes a new training algorithm for zero-sum games to avoid convergence issues.

problem Gradient-based training leads to weak convergence and cyclic dynamics in zero-sum architectures.
method Follow the perturbed leader algorithm with neural mediating agent.
result Guarantees convergence to mixed Nash equilibrium without cyclic behaviors.

This paper improves FTPL algorithm for semi-bandit problems with best-of-both-worlds guarantees.

problem Optimizing regret in adversarial and stochastic mm-set semi-bandit problems.
method Extending FTPL with geometric resampling (GR) to mm-set semi-bandits and analyzing its performance.
result FTPL with Fréchet and Pareto distributions achieves O(mdT)O(\sqrt{mdT}) regret in adversarial setting and logarithmic regret in stochastic setting.

The paper explores how regularization can lead to convergence in imperfect information games.

problem Finding equilibrium in imperfect information games with imperfect information.
method Investigates Follow the Regularized Leader dynamics and how adding a regularization term can lead to strong convergence guarantees.
result The approach leads to algorithms that converge exactly to the Nash equilibrium in imperfect information games.

New RL algorithms find SNE in Markov games with myopic followers.

problem Finding SNE in Markov games with myopic followers.
method Optimistic and pessimistic variants of least-squares value iteration, incorporating function approximation.
result First provably efficient RL algorithms for SNEs in general-sum Markov games with myopic followers.

Communities in social networks or graphs are sets of well-connected, overlapping vertices. The effectiveness of a community detection algorithm is determined by accuracy in finding the ground-truth communities and ability to scale with the size of the data. In this work, we provide three contributions. First, we show t…

2010-11-02abs ↗pdf ↗

FTPL method shows near-optimal regret bounds for AMDPs with bandit feedback.

problem Minimizing regret in AMDPs with adversarial losses and bandit feedback.
method Follow-the-Perturbed-Leader (FTPL) method for AMDPs.
result FTPL achieves near-optimal regret bounds for AMDPs with bandit feedback.

Optimal bounds on regret and constraint violation in adversarial COCO.

problem Minimizing regret and cumulative constraint violation in adversarial COCO.
method New surrogate loss function and Follow-the-Regularized-Leader/Online Gradient Descent.
result Achieved optimal O(T)O(\sqrt{T}) bounds on both regret and cumulative constraint violation.

Improved FTPL algorithm reduces regret in predictable minimax games.

problem Online learning and minimax games with predictable loss sequences.
method Optimistic modification of FTPL with dual regularization view.
result Tighter regret bounds for predictable sequences, O(T1/2)O(T^{-1/2}) accuracy.

New algorithm reduces individual regret and communication costs in cooperative bandits.

problem Optimal individual and group regret in cooperative multi-agent bandits.
method Integrates a new communication policy into a learning algorithm.
result Achieves optimal individual regret and constant communication costs.

Algorithm optimizes functions without parameters, converging to global minima.

problem Optimizing functions without parameters.
method Follow The Regularized Leader with rescaled gradients and time-varying regularizers.
result Converges to global minimizer for variationally coherent functions.

New algorithm reduces regret in online learning for piecewise continuous functions.

problem Exponential loss in efficiency when moving from classical to adversarial learning.
method Introduces generalized bracketing numbers and Follow-the-Perturbed-Leader algorithm.
result Optimal scaling of optimization oracle calls with average regret.

We show a principled way of deriving online learning algorithms from a minimax analysis. Various upper bounds on the minimax value, previously thought to be non-constructive, are shown to yield algorithms. This allows us to seamlessly recover known methods and to derive new ones. Our framework also captures such "unort…

2012-04-04abs ↗pdf ↗

Follow-the-Leader (FTL) is an intuitive sequential prediction strategy that guarantees constant regret in the stochastic setting, but has terrible performance for worst-case data. Other hedging strategies have better worst-case guarantees but may perform much worse than FTL if the data are not maximally adversarial. We…

2013-01-03abs ↗pdf ↗

Develops a Best-of-Both-Worlds algorithm for linear contextual bandits with Tsallis entropy.

problem Linear contextual bandits with i.i.d. contexts.
method Follow-The-Regularized-Leader (FTRL) with Tsallis entropy.
result Achieves $O\left(\log(T)^{\frac{1+β}{2+β}}T^{\frac{1}{2+β}} ight)$ regret under margin condition.