Study online and offline social interactions using game theory.
problem Effects of online social networking on offline interactions and collective well-being.
method Evolutionary game theory approach to model socialization strategies.
result Self-protective behaviors can lead to non-socially optimal outcomes.
Study reveals linguistic signs of betrayal in online strategy games.
problem Predicting the dissolution of friendships in online games.
method Characterized dyadic interactions, analyzed temporal patterns, and examined conversational attributes.
result Subtle linguistic cues indicate impending betrayal in online strategy games.
Educational game on crypto investment helps students grasp macroeconomics.
problem Weak connections between microeconomic decision-making and macroeconomic concepts in classroom games.
method Design and study of an educational game on cryptocurrency investment.
result Engages students in understanding macroeconomics through incentivized individual investment decisions.
No-regret learning fails to converge to Nash equilibria in mixed strategies.
problem Limiting behavior of mixed strategies in repeated games.
method Study of optimal no-regret learning algorithms for 2x2 competitive games.
result Limiting mixed strategies cannot converge to Nash equilibria under mean-based and monotonic updates.
Improved online learning algorithms using ADP for adversarial environments.
problem Minimizing regret in adversarial online learning with vector-valued losses.
method Approximate dynamic programming to characterize lower Pareto frontier of expected losses.
result Improved performance bounds compared to existing online learning algorithms.
Adaptive OMD reduces variance in learning optimal strategies for imperfect information games.
problem High variance in learning optimal strategies for imperfect information games.
method Fixed sampling approach with locally applied Online Mirror Descent (OMD) algorithm.
result Convergence rate of i l d e O ( T − 1 / 2 ) ilde{\mathcal{O}}(T^{-1/2}) i l d e O ( T − 1/2 ) with high probability. Two new RL methods enable deep learning of MFG equilibria.
problem Efficiently learning equilibria in Mean Field Games using RL.
method Two novel RL methods: distillation and online mixing.
result Deep RL algorithms can now solve various MFGs.
Paper finds algorithms with both low regret and high exploitation.
problem Finding algorithms with both low regret and high exploitation.
method Investigates online learning algorithms with bandit feedback.
result First affirmative answer to guaranteeing both O ( 1 ) O(1) O ( 1 ) regret and i l d e O ( T ) ilde{O}(\sqrt{T}) i l d e O ( T ) regret. Neural MMO simulates MMOs to study multiagent intelligence.
problem Limited research environments for multiagent intelligence.
method Developed a new game environment inspired by MMOs.
result Standard methods can learn interesting behaviors in MMOs.
It is now well known that decentralised optimisation can be formulated as a potential game, and game-theoretical learning algorithms can be used to find an optimum. One of the most common learning techniques in game theory is fictitious play. However fictitious play is founded on an implicit assumption that opponents' …
Optimal online learning algorithms for label-efficient prediction and bandits.
problem Efficient prediction in online learning with limited information.
method Optimistic online mirror descent with second order corrections and hybrid regularizers.
result Improved regret bounds for label-efficient prediction and bandits.
Algorithm learns to play against unknown opponents in sequential games.
problem Designing strategies for a learner to interact with an unknown opponent in repeated sequential games.
method Kernel-based regularity assumptions and a novel algorithm combining bilevel optimization and online learning.
result Algorithm achieves sublinear regret guarantees and is effective in specific game settings.
The paper develops a new algorithm for constructing minimax estimators using online learning techniques.
problem Designing minimax estimators for probability distribution parameters.
method Viewing the problem as a zero-sum game and using online learning with non-convex losses to find a Nash equilibrium.
result The algorithm constructs both a minimax estimator and a least favorable prior.
Algorithm finds near-optimal strategy in changing zero-sum games.
problem Finding near-optimal strategy in changing zero-sum games.
method Designing an algorithm with small NE regret for online matrix games.
result Achieves near-optimal dependence on the number of rounds and number of actions.
A novel online learning approach improves stability and performance of GANs.
problem Training GANs is difficult due to instabilities in a minimax optimization problem.
method Viewing GAN training as a zero-sum game, proposing Chekhov GAN, and using online learning strategies.
result Our method provably converges to an equilibrium for semi-shallow GAN architectures and improves stability and performance in practical applications.
Improved bounds for online prediction with expert advice.
problem Online prediction with expert advice in finite-horizon games.
method Verification arguments from optimal control theory applied to PDEs to find sub- and supersolutions.
result Explicit bounds for any number of experts and horizon, improving upon previous results.
Study online learning in unknown Markov games with sublinear regret.
problem Online learning in unknown Markov games with unobservable opponents.
method Introduced an algorithm achieving sublinear regret against the minimax value.
result First sublinear regret bound for unknown Markov games, independent of action spaces size.
Algorithm solves online binary classification and infinite games using ERM oracle.
problem Online learning and solving infinite games with computationally inefficient oracles.
method Proposes an algorithm relying solely on ERM oracle calls for online binary classification and nonparametric games.
result Achieves finite and sublinearly growing regret in various settings.
We introduce CSE for MLSF games and devise online learning algorithms for achieving no-external Stackelberg-regret.
problem Learning equilibrium in leader-follower games with noisy bandit feedback.
method Proposed Correlated Stackelberg Equilibrium (CSE) and online learning algorithms balancing exploration and exploitation.
result Achieves no-external Stackelberg-regret, converging to approximate CSE.
Proves existence of a strategy to minimize shortfall for game options.
problem Minimizing shortfall for game options in discrete time.
method Proves existence of a self-financing strategy.
result Existence of a self-financing strategy to minimize shortfall for game options in discrete time.
New algorithms minimize regret with global costs in online learning.
problem Minimizing regret in online learning with global costs.
method Extended FTRL algorithms for Blackwell's approachability.
result First bounds on regret minimization with explicit dependence in p p p and d d d . New algorithms achieve near-optimal cumulative loss in nonparametric online learning and games.
problem Fast rates of convergence in nonparametric online regression and classification.
method Randomized proper learning algorithms, hierarchical aggregation, multi-scale extension, stability proof.
result Achieved near-optimal cumulative loss bounds for real-valued and binary games.
Paper models game theory for defending against data poisoning attacks.
problem Defending against data poisoning attacks using game theory.
method Modeling attacker-defender game, proving non-existence of pure Nash Equilibrium, proposing mixed strategy approach, and developing an algorithm to approximate Nash Equilibrium.
result Demonstrated effectiveness of mixed strategy defense in experiments.
Study Nash equilibrium in non-zero-sum game with Bermudan strategies.
problem Optimizing pay-offs in non-linear non-zero-sum games.
method Recursive construction to find Nash equilibrium.
result Existence of Nash equilibrium in non-zero-sum game.
Paper analyzes minimax regret in constrained online convex optimization with limited switching opportunities.
problem Minimizing regret in online convex optimization with limited switching opportunities.
method Introduced fugal game relaxation and mini-batching algorithm to establish minimax regret bounds.
result Minimax regret of switching-constrained OCO is Θ(T / √K).
In the standard setting of approachability there are two players and a target set. The players play repeatedly a known vector-valued game where the first player wants to have the average vector-valued payoff converge to the target set which the other player tries to exclude it from this set. We revisit this setting in …
We study the regret of optimal strategies for online convex optimization games. Using von Neumann's minimax theorem, we show that the optimal regret in this adversarial setting is closely related to the behavior of the empirical minimization algorithm in a stochastic process setting: it is equal to the maximum, over jo…
New framework connects online learning to statistical learning for better generalization bounds.
problem Deriving generalization bounds for statistical learning algorithms.
method Constructing an online learning game and showing a connection to statistical learning.
result Established a connection between online and statistical learning, leading to new generalization bounds.
New model shows online and statistical learning are computationally equivalent with optimization oracle.
problem Online learning in non-convex games with adversarial settings.
method Strengthening the oracle model to make online and statistical learning computationally equivalent.
result Efficient computation of non-convex game equilibria, including GANs, with optimization oracle.
A game theory study on optimal hiding and searching strategies in discrete locations.
problem Optimal hiding and searching strategies in a two-person zero-sum game between a hider and a searcher.
method Proved the existence of optimal strategies, developed an algorithm to compute them, and compared with a simple strategy.
result Optimal hiding strategy involves hiding in each location with nonzero probability, and optimal searching strategy can be constructed with up to n simple sequences.
Decentralized algorithm reduces regret and converges to Nash equilibrium in online congestion games.
problem Online congestion games with exponential action sets and strict Nash equilibria.
method CongestEXP algorithm using exponential weights method.
result CongestEXP achieves O ( k F T ) O(kF\sqrt{T}) O ( k F T ) regret bound and almost exponential convergence to strict Nash equilibrium. Study on optimal strategies for minimizing shortfall risk in game options.
problem Existence of optimal hedging strategies for shortfall risk in game options.
method Continuous time Black--Scholes model, finite and infinite exercise times.
result Optimal strategies exist for finite exercise times but not for all time intervals.
Discrete-time games reveal payoffs after both players stop, leading to new equilibrium strategies.
problem Non-zero-sum stopping games with delayed payoff revelation.
method Analyzes simultaneous and sequential stopping strategies, proving Nash equilibria in both cases.
result Existence of Nash equilibria in mixed and pure stopping strategies.
Paper analyzes convergence rates for multi-agent learning in games.
problem Convergence rates for multi-agent learning in games.
method Characterizes finite-time convergence rates for joint OGD learning on λ λ λ -cocoercive games and develops adaptive algorithms. result Adaptive algorithms achieve same convergence rates as non-adaptive counterparts.
Tiny neural networks learn Atari games with just 6 neurons.
problem Understanding and simplifying complex vision-based decision-making tasks.
method Separate learning of state representations and policies, using novel encoding algorithms.
result 6-neuron neural networks achieve comparable results to state-of-the-art methods.
New games model strategic interactions in incomplete information settings.
problem Modeling strategic interactions in incomplete information settings.
method Introduced new games that map input to private player types, aggregate strategies, and converge to near-Nash equilibria.
result Games can recover meaningful strategic interactions from real data.
The thesis explores prediction games with different opponents and moves, revealing intrinsic barriers and efficient algorithms.
problem Understanding and designing efficient algorithms for prediction games with various opponents and move orders.
method Geometric insights into three types of prediction games: general learning task, prediction with expert advice, and online convex optimization.
result Revealed intrinsic barriers and developed computationally efficient learning algorithms with strong theoretical guarantees.
Survey of algorithms to correct past mistakes in prediction.
problem Improving prediction accuracy by correcting past errors.
method Defensive Forecasting as a sequential game theory approach to minimize prediction metrics.
result Simple, near-optimal algorithms for various prediction tasks.
New findings show pure strategy equilibria are more robust in a war of attrition game.
problem Analyzing a game of war of attrition under complete information.
method Examined the stability of equilibria in pure and mixed strategies under varying payoffs.
result Pure strategy equilibria are more robust to perturbations of the canonical model.
Algorithm improves RL model selection for repeated games with utility maximization.
problem Optimal policy learning in repeated games with unknown opponent strategy.
method Proposes MRBEAR for average reward RL, applying to utility maximization in repeated games.
result Regret bound shows linear dependence on number of model classes in average reward RL.
Optimal strategies are found for a repeated betting game using diffusion approximation.
problem Finding optimal strategies for a repeated betting game with i.i.d. outcomes.
method Constructing a diffusion approximation of the repeated game and analyzing the wealth share process.
result Necessary and sufficient conditions for the wealth share process to be transient or recurrent are derived.
A game theory study examines gradual concessions in variable contribution games under uncertainty.
problem Gradualism in contribution games due to free rider effect.
method Stochastic game analysis of variable contribution games, extending Nerlove-Arrow model.
result Equilibrium characterized by regular control strategies leading to gradual concession.
We study multistep Bayesian betting strategies in coin-tossing games in the framework of game-theoretic probability of Shafer and Vovk (2001). We show that by a countable mixture of these strategies, a gambler or an investor can exploit arbitrary patterns of deviations of nature's moves from independent Bernoulli trial…
New method detects heuristics in complex game strategies.
problem Understanding decision-making in games with infinite strategy spaces.
method Introducing decoupled strategies to detect convergence towards Nash equilibria.
result Predictive measure ΔD reveals participants' actions with high success rate.
Study learns optimal strategies in imperfect information games with self-play.
problem Learning optimal strategies in imperfect information games.
method Proposes Follow the Regularized Leader (FTRL) algorithms for imperfect information games.
result Proposes two FTRL algorithms: Balanced FTRL and Adaptive FTRL.
In this expository paper we illustrate the generality of game theoretic probability protocols of Shafer and Vovk (2001) in finite-horizon discrete games. By restricting ourselves to finite-horizon discrete games, we can explicitly describe how discrete distributions with finite support and the discrete pricing formulas…
Algorithm learns NE in imperfect information games with imperfect feedback.
problem Learning Nash equilibrium in imperfect information games with bandit feedback.
method IXOMD algorithm for model-free learning with 1 / T 1/\sqrt{T} 1/ T convergence rate. result IXOMD achieves 1 / T 1/\sqrt{T} 1/ T convergence rate to NE. New algorithm reduces risk in online games with limited feedback.
problem Risk-averse learning in repeated unknown games with bandit feedback.
method Proposes a momentum-based algorithm to estimate CVaR using historical cost values.
result Achieves sub-linear regret and outperforms existing methods in numerical experiments.