Neural operators approximate Stackelberg game solutions.
problem Intractability of follower's best-response operator in dynamic Stackelberg games.
method Used attention-based neural operators to approximate the best-response operator.
result Approximate best-response operator yields close game value.
We introduce CSE for MLSF games and devise online learning algorithms for achieving no-external Stackelberg-regret.
problem Learning equilibrium in leader-follower games with noisy bandit feedback.
method Proposed Correlated Stackelberg Equilibrium (CSE) and online learning algorithms balancing exploration and exploitation.
result Achieves no-external Stackelberg-regret, converging to approximate CSE.
This paper tackles learning Stackelberg equilibrium in asymmetric games efficiently from noisy samples.
problem Learning Stackelberg equilibrium in asymmetric, general-sum games efficiently from noisy samples.
method The paper initiates the theoretical study of sample-efficient learning of the Stackelberg equilibrium in bandit feedback setting.
result Sharp positive results on sample-efficient learning of Stackelberg equilibrium with value optimal up to a fundamental gap identified.
Paper proposes a new method to optimize robot body structure and control policy.
problem Optimizing robot body structure and control policy in a coupled manner.
method Revisits co-design problem as a Stackelberg game, incorporating control adaptation dynamics.
result Stackelberg PPO outperforms standard PPO in stability and performance.
RL models improve target control in SSGs for security applications.
problem Improving RL algorithms for target control in SSGs.
method Investigates improvements to target representations in RL algorithms.
result Enhanced RL models control targets better in SSGs.
Study on reinsurance decisions using mean-variance criterion with irreversible contracts.
problem Optimizing reinsurance premiums and contracts in a Stackelberg game with irreversible contracts.
method Unified singular control framework applied to both discrete and continuous time reinsurance contracts.
result A single once-for-all reinsurance contract is preferred over multiple contracts, and the signing time is crucial.
MAXMINLCB optimizes unknown target functions with preference feedback using a Stackelberg game approach.
problem Optimizing unknown target functions with pairwise comparisons and human feedback.
method MAXMINLCB, a zero-sum Stackelberg game, balances exploration and exploitation.
result MAXMINLCB consistently outperforms existing algorithms with a rate-optimal regret guarantee.
Study optimal investment-reinsurance strategies in equity-linked insurance products using Stackelberg game theory.
problem Optimizing investment and reinsurance strategies in equity-linked insurance products with capital guarantees.
method Modelled as a Stackelberg game where reinsurer acts as leader and insurer as follower, with general utility functions and power utility functions analyzed.
result Derive Stackelberg equilibrium for general utility functions and calculate it explicitly for power utility functions, finding reinsurer optimizes premium to incentivize maximal reinsurance purchase.
Stackelberg Games are gaining importance in the last years due to the raise of Adversarial Machine Learning (AML). Within this context, a new paradigm must be faced: in classical game theory, intervening agents were humans whose decisions are generally discrete and low dimensional. In AML, decisions are made by algorit…
Investors with asymmetric information play a game to optimize their portfolios.
problem Two investors with different information levels compete in portfolio selection.
method Modelled as a Stackelberg game with entropy-regularized mean-variance objectives.
result Equilibria exist where follower's strategy depends on leader's actions.
This paper analyzes a game between insurer and reinsurer under ambiguity and risk aversion, optimizing reinsurance and investment strategies.
problem Optimizing reinsurance and investment strategies in a game between insurer and reinsurer under ambiguity and risk aversion.
method Stackelberg game, α-maxmin mean-variance criterion, Heston's stochastic volatility, Hamilton-Jacobi-Bellman equations, Riccati differential equations. result Excess-of-loss reinsurance is optimal for the insurer, and the equilibrium strategies are determined by specific equations.
Study on local convergence of min-max algorithms to differential equilibria on Riemannian manifolds.
problem Solving zero-sum differential games on Riemannian manifolds.
method Analysis of two simultaneous min-max algorithms, τ-GDA and τ-SGA, to differential Stackelberg and Nash equilibria, with conditions for linear convergence and asymptotic approximation. result Established sufficient conditions for linear convergence of τ-GDA and demonstrated faster convergence of τ-SGA in some cases. Endogenous reinsurance pricing in large insurance markets
problem Endogenous reinsurance pricing in large insurance markets
method Stackelberg leader and insurer equilibrium analysis
result Characterization of insurers' equilibrium retention and Stackelberg equilibria
New RL algorithms find SNE in Markov games with myopic followers.
problem Finding SNE in Markov games with myopic followers.
method Optimistic and pessimistic variants of least-squares value iteration, incorporating function approximation.
result First provably efficient RL algorithms for SNEs in general-sum Markov games with myopic followers.
Study of insurance market equilibria with risk-averse policyholders.
problem Analyzing optimal insurance contracts in a monopoly market with risk-averse policyholders.
method Modeling Stackelberg equilibria with a profit-maximizing insurer and a risk-averse policyholder.
result Equilibrium contracts exhibit a layer-type structure, providing full insurance over pessimistic loss layers and no coverage over optimistic ones.
An informed broker optimizes trading strategies in a market influenced by many traders.
problem Optimizing trading strategies for an informed broker in a market with many traders.
method Developed a mean-field game approach to derive equilibrium strategies for both the broker and traders.
result The broker's optimal strategy involves a Stackelberg equilibrium, leading and traders following.
A game-theoretic approach simplifies MBRL design and improves sample efficiency.
problem Designing stable and efficient MBRL algorithms using rich function approximators.
method Develops a game-theoretic framework where MBRL is modeled as a Stackelberg game between policy and model players.
result Proposed algorithms are highly sample efficient and match asymptotic performance of model-free policy gradient.
Paper proposes a game-theoretic approach to generate unlearnable examples.
problem Generating imperceptible perturbations to degrade deep learning models.
method Formulated as a Stackelberg game, proposing a novel attack method GUE.
result GUE effectively poisons models with minimal training data and generalizes well.
This paper investigates a hybrid stochastic differential reinsurance and investment game between one reinsurer and two insurers, including a stochastic Stackelberg differential subgame and a non-zero-sum stochastic differential subgame. The reinsurer, as the leader of the Stackelberg game, can price reinsurance premium…
Study optimal reinsurance pricing under model uncertainty for multiple insurers.
problem Optimal reinsurance pricing in the presence of multiple sources of model uncertainty.
method Solves a continuous-time Stackelberg game for general reinsurance contracts, considering entropy penalties and ambiguity in insurers' models.
result Reinsurer prices under a distortion of the barycentre of insurers' models, maximizing expected wealth with an entropy penalty.
A new algorithm learns policies from batch data in hierarchical RL.
problem Learning policies from fixed batches of data without full exploration.
method Modeling RL as a two-player game with a leader-follower structure, proposing StackelbergLearner.
result StackelbergLearner achieves competitive performance in batch RL and real-world datasets.
New RL algorithms learn QSE from strategic feedbacks with sample efficiency.
problem Learning QSE in Markov games with strategic feedbacks.
method Proposes sample-efficient algorithms for online and offline settings, combining quantal response model learning and RL.
result Achieves sublinear regret bounds and quantifies model uncertainty.
Two-layer model studies reinsurance contracts and competition between insurer and reinsurers.
problem Modeling and analyzing reinsurance contracts and competition between insurer and reinsurers.
method Two-layer stochastic game model with insurer negotiating with reinsurers, and reinsurers competing for business.
result Existence and uniqueness of equilibrium strategies for the insurer and reinsurers, characterized in semiclosed form.
We study the problem of alleviating the instability issue in the GAN training procedure via new architecture design. The discrepancy between the minimax and maximin objective values could serve as a proxy for the difficulties that the alternating gradient descent encounters in the optimization of GANs. In this work, we…
Paper proposes incentive mechanism to encourage participation in federated learning.
problem Users are reluctant to participate in federated learning due to privacy concerns.
method Formulated as a two-stage Stackelberg game, designed an incentive mechanism to select and compensate users.
result Demonstrated effectiveness of the proposed incentive mechanism through simulations.
Brokers and an informed trader compete for liquidity, affecting trading costs and inventory risk.
problem How brokers and an informed trader manage liquidity and trading costs.
method Sequential Stackelberg game, solving for trading strategies, numerical solutions.
result Equilibrium strategies and liquidity prices determined, not Pareto efficient.
We develop robust Markov Decision Processes with risk measures for uncertain environments.
problem Uncertainty in Markov Decision Processes and its impact on risk measures.
method Formulation as a Stackelberg game, robust cost and value iterations, existence of optimal policies.
result Existence of deterministic optimal policies for robust optimization and risk measures.
Algorithm learns to play against unknown opponents in sequential games.
problem Designing strategies for a learner to interact with an unknown opponent in repeated sequential games.
method Kernel-based regularity assumptions and a novel algorithm combining bilevel optimization and online learning.
result Algorithm achieves sublinear regret guarantees and is effective in specific game settings.
Optimal dynamic allocation of carbon allowances reduces emissions efficiently.
problem Reducing carbon emissions from firms over time with dynamic allocation and trading.
method Variational approach to solve the Stackelberg game between regulator and firms.
result Optimal policies lead to constant abatement effort and allowance price, outperforming static allocations.
EI-MTD defends edge intelligence against adversarial attacks with dynamic scheduling.
problem Adversarial attacks on edge intelligence models.
method EI-MTD uses differential knowledge distillation to create robust member models and a dynamic scheduling policy based on a Bayesian Stackelberg game.
result EI-MTD effectively protects edge intelligence from black-box adversarial attacks.
A novel approach reduces class imbalance in network traffic classification.
problem Severe class imbalance in network traffic leads to poor classification performance.
method Group & Reweight strategy: clusters classes, updates weights, optimizes model.
result Improves comprehensive performance in prediction and reduces class imbalance.
The paper analyzes strategic interactions in a multi-agent reinsurance chain using game theory.
problem Strategic behavior and competition among insurers and reinsurers in a multi-layer reinsurance chain.
method Employed Stackelberg differential games and non-zero-sum game models to characterize strategic interactions. Used dynamic programming and game theory to derive equilibrium strategies for investment and reinsurance.
result Intensified competition leads to reduced safety loadings in reinsurance contracts.
New method prevents RLHF alignment collapse by accounting for policy's influence on reward model updates.
problem Iterative RLHF leads to alignment collapse where policies exploit RM's blind spots.
method Foresighted policy optimization (FPO) restores missing steering term via regularization.
result FPO prevents alignment collapse on LLM alignment pipelines using Llama-3.2-1B.
SLHF uses sequential game theory to optimize preferences from human feedback.
problem Optimizing preferences from human feedback in sequential settings.
method SLHF frames the problem as a sequential-move game between Leader and Follower, decomposing the optimization into refinement and adversarial optimization.
result SLHF achieves strong alignment across diverse preference datasets and scales to large models.
Game theory model for optimal trading with end-of-day constraints.
problem Optimal trading strategy in a game between slow and fast traders.
method Coupled stochastic control problems, Fredholm integral equation solution.
result Explicit solution to the game with profitable strategies for both players.
CB-RL solves complex decision-making problems with contextual information and exogenous events.
problem Optimal policy in strategic decision-making problems that depend on environmental configuration and exogenous events.
method Contextual Bilevel Reinforcement Learning (CB-RL) with a stochastic Hyper Policy Gradient Descent (HPGD) algorithm.
result Demonstrated convergence and performance of the HPGD algorithm for reward shaping and tax design.
Game theory approach to predicting and responding to interventions based on causal relationships.
problem Optimizing predictions and interventions in response to observational data.
method Prediction-intervention game framework, focusing on invariant subsets of covariates.
result Stable-blanket predictors are optimal for certain follower objectives and under specific conditions.
Develops a generic two-layer framework for adaptive ABMs.
problem Bi-level adaptation problem in ABMs: agents adapt to environment, and environment adapts to agents.
method Formalizes bi-level problem as a Stackelberg game with conditional policies, solving coupled non-linear equations.
result Unified framework for adaptive ABMs, addressing traditional ABM limitations.
Paper analyzes convergence of GDA for nonconvex-nonconcave minimax problems.
problem Understanding convergence of GDA for nonconvex-nonconcave minimax problems.
method Local convergence analysis of GDA with stepsize ratio Θ(κ).
result Stepsize ratio of Θ(κ) is necessary and sufficient for local convergence of GDA to a Stackelberg Equilibrium.
We analyze linear McKean-Vlasov forward-backward SDEs arising in leader-follower games with mean-field type control and terminal state constraints on the state process. We establish an existence and uniqueness of solutions result for such systems in time-weighted spaces as well as a {convergence} result of the solution…
We deal with the problem of outsourcing the debt for a big investment, according two situations: either the firm outsources both the investment (and the associated debt) and the exploitation to a private consortium, or the firm supports the debt and the investment but outsources the exploitation. We prove the existence…
Optimal penalties for RECs balance environmental and revenue impacts.
problem Optimizing penalties for RECs to balance environmental and revenue impacts.
method Mean field games and extended McKean-Vlasov control problems.
result Optimal penalty function is linear in agents' state.
For an investor with constant absolute risk aversion and a long horizon, who trades in a market with constant investment opportunities and small proportional transaction costs, we obtain explicitly the optimal investment policy, its implied welfare, liquidity premium, and trading volume. We identify these quantities as…
We investigate a randomization procedure undertaken in real option games which can serve as a basic model of regulation in a duopoly model of preemptive investment. We recall the rigorous framework of [M. Grasselli, V. Leclère and M. Ludkovsky, Priority Option: the value of being a leader, International Journal of Theo…
We consider a stochastic game between a trader and a central bank in a target zone market with a lower currency peg. This currency peg is maintained by the central bank through the generation of permanent price impact, thereby aggregating an ever increasing risky position in foreign reserves. We describe this situation…
New framework solves dynamic bilevel optimization problems in reinforcement learning.
problem Dynamic objective functions in reinforcement learning and human feedback.
method Principled penalty-based methods for bilevel reinforcement learning.
result Demonstrated effectiveness of penalty-based algorithms in simulations.
Modeling DEX liquidity with heterogeneous LPs and MEV bots.
problem Understanding and predicting the dynamics of decentralized cryptocurrency exchanges.
method Mean-field game approach to model liquidity providers' optimal strategies and interactions.
result Calibrated model produces consistent pool exchange rate dynamics and liquidity evolution.
Designing AI market for content creation
problem Balancing technological progress and individual incentives for content creation
method Dynamic Stackelberg game model
result Inducing greater reliance on AI-assisted creation