Proposes CoPO, a new policy optimization method for competitive games.
problem Designing efficient optimization methods for competitive Markov decision processes.
method Competitive policy optimization (CoPO) approach that exploits game-theoretic nature of competitive games.
result Stable optimization, convergence to sophisticated strategies, and higher scores compared to baseline methods.
Two-layer model studies reinsurance contracts and competition between insurer and reinsurers.
problem Modeling and analyzing reinsurance contracts and competition between insurer and reinsurers.
method Two-layer stochastic game model with insurer negotiating with reinsurers, and reinsurers competing for business.
result Existence and uniqueness of equilibrium strategies for the insurer and reinsurers, characterized in semiclosed form.
Paper studies competitive networks where teams aim to minimize their own objectives, adapting to each other's strategies.
problem Competitive networks where teams have conflicting objectives.
method Proposes diffusion learning algorithms for two classes of network games: zero-sum and non-zero-sum.
result Stability performance of proposed algorithms analyzed and demonstrated through experiments.
The study analyzes games and social hierarchies, incorporating luck and depth of competition.
problem Analyzing patterns of wins and losses in games and social hierarchies.
method Generalized probabilistic models incorporating luck and depth of competition.
result Social competition tends to be deeper with many distinct levels, but there is often a chance of upset victories.
The paper analyzes competition among fund managers using excess logarithmic returns and constructs games to find optimal allocations.
problem Optimal allocation strategies among fund managers considering excess logarithmic returns.
method Constructs both n-player and mean field games to address the competition problem. result The MFE of the MFG represents the limit of n-player game's equilibrium as n approaches infinity. Study N-player and mean-field games in Itô-diffusion markets with competitive or homophilous interactions.
problem Optimal portfolio choice in a common market with N interacting players. method Analyzes N-player and mean-field games in incomplete and complete markets with CARA utilities and random risk tolerances. result Derives explicit or closed-form solutions for equilibrium processes and game values.
Study shows Elo models fail to accurately measure transitive strength in competitive games.
problem Elo models fail to correctly identify the transitive component in real-world competitive games.
method Investigated the challenge of identifying the transitive component in games, proposed an extension of the Elo score.
result Disc ranking system assigns two scores: skill and consistency.
Study competitive energy markets using stochastic impulse games.
problem Maximizing profits in competitive retail energy markets.
method Connection between Nash equilibrium and quasi-variational inequalities (QVIs).
result Value functions are constrained viscosity solutions of QVIs.
Modeling pollution from competing firms using mean-field games.
problem Pollution regulation of competitive firms producing similar goods.
method Developed a mean-field game model with cap-and-trade regulation.
result Explicit solutions found through Riccati differential equations.
Study of insurer games with model uncertainty in reinsurance and investment strategies.
problem Model uncertainty and competitive insurers' performance under worst-case scenarios.
method Formulated robust mean-field game for non-linear system, derived closed-form solutions.
result Relative concerns lead to new hedging terms in investment and reinsurance strategies.
We present a new general board game (GBG) playing and learning framework. GBG defines the common interfaces for board games, game states and their AI agents. It allows one to run competitions of different agents on different games. It standardizes those parts of board game playing and learning that otherwise would be t…
Unified framework for estimating reward functions in competitive games.
problem Estimating unknown reward functions in competitive games.
method Unified framework with entropy regularization for reward function recovery.
result Strong theoretical guarantees and practical effectiveness demonstrated.
Replication confirms CGD's effectiveness in competitive games.
problem Reproducibility of a novel Nash equilibrium algorithm.
method Replicated experiments and provided Python implementation.
result CGD avoids oscillatory and divergent behaviours.
Study optimal investment and consumption strategies for competitive agents with habit formation.
problem Optimal investment and consumption strategies for competitive agents with habit formation.
method Formulated n-agent game problems and mean field game problems, derived mean field equilibrium, constructed approximate Nash equilibrium.
result Explicit convergence order of approximate Nash equilibrium can be obtained.
We study a portfolio optimization problem for competitive agents with CRRA utilities and a common finite time horizon. The utility of an agent depends not only on her absolute wealth and consumption but also on her relative wealth and consumption when compared to the averages among the other agents. We derive a closed …
We study optimal behavior of energy producers under a CO_2 emission abatement program. We focus on a two-player discrete-time model where each producer is sequentially optimizing her emission and production schedules. The game-theoretic aspect is captured through a reduced-form price-impact model for the CO_2 allowance…
Agents learn to outperform in trading by using past and current prices.
problem Optimal trading performance beyond theoretical limits.
method Two-agent Almgren-Chriss liquidation game, schedule-learning, DDQN architectures.
result Agents with access to past and current prices achieve supra-competitive outcomes.
This paper presents the first two editions of Visual Doom AI Competition, held in 2016 and 2017. The challenge was to create bots that compete in a multi-player deathmatch in a first-person shooter (FPS) game, Doom. The bots had to make their decisions based solely on visual information, i.e., a raw screen buffer. To p…
The paper analyzes reinsurance strategies in a competitive multi-agent system.
problem Strategic interactions and competitive behavior in multi-layer reinsurance chains.
method Stochastic differential games and non-zero-sum game models to characterize strategic interactions. Dynamic programming and game theory to derive equilibrium strategies.
result Intensified competition reduces safety loadings in reinsurance contracts.
We discuss a natural game of competition and solve the corresponding mean field game with \emph{common noise} when agents' rewards are \emph{rank dependent}. We use this solution to provide an approximate Nash equilibrium for the finite player game and obtain the rate of convergence.
New algorithm improves self-play reinforcement learning for competitive games.
problem Inefficient opponent selection in self-play reinforcement learning.
method Intelligently selects opponents based on adversarial rules derived from saddle point optimization.
result Algorithm converges to approximate equilibrium with high probability in convex-concave games.
Competition has been introduced in the electricity markets with the goal of reducing prices and improving efficiency. The basic idea which stays behind this choice is that, in competitive markets, a greater quantity of the good is exchanged at a lower and a lower price, leading to higher market efficiency. Electricity …
Study optimal reinsurance strategies in a game between insurer and two reinsurers.
problem Optimal reinsurance strategies in a competitive market.
method Stochastic game theory, Stackelberg model, Nash game, time-inconsistent control problem, extended Hamilton-Jacobi-Bellman equation.
result Equilibrium reinsurance strategies and premiums found for exponential claim size.
Study time-inconsistent portfolio optimization for competitive agents with relative performance criteria.
problem Time-inconsistent mean field and n-agent games under relative performance criteria.
method Construct open-loop equilibrium strategies for n-agent games and mean field games.
result Explicit solutions for n-agent games and mean field games, unique in a special class of equilibria.
Study optimal investment strategies for competitive agents using Mean Field Games.
problem Optimizing portfolios with relative performance criteria.
method Mean Field Game framework applied to CRRA and CARA utility cases.
result Derivation of optimal investment and consumption strategies.
A game-theoretic analysis of DEX competition through dynamic trading fees.
problem Competition between decentralized exchanges (DEXs) and their impact on trading fees and slippage.
method Characterization of an approximate Nash equilibrium via coupled system of partial differential equations and closed-form expressions for equilibrium fees.
result The equilibrium trading fees shift from the oracle price to a weighted average of the oracle and competitors' exchange rates under competition.
Machine learning competitions such as those organized by Kaggle or KDD represent a useful benchmark for data science research. In this work, we present our winning solution to the Game Data Mining competition hosted at the 2017 IEEE Conference on Computational Intelligence and Games (CIG 2017). The contest consisted of…
Bayesian rating system for large competitions improves prediction and efficiency.
problem Rating systems for large, competitive events like online programming contests.
method Developed a Bayesian rating system for many participants, proving robustness and runtime.
result The system outperforms existing systems in accuracy and computation speed.
Study examines strategic exit timing in uncertain competition.
problem Timing of strategic exit decisions in competitive markets with uncertainty.
method Constructs a stochastic game equilibrium for exit strategies involving state variable and posterior belief process.
result Unique equilibrium found for symmetric Bayesian players.
We study a wide class of non-convex non-concave min-max games that generalizes over standard bilinear zero-sum games. In this class, players control the inputs of a smooth function whose output is being applied to a bilinear zero-sum game. This class of games is motivated by the indirect nature of the competition in Ge…
The General Video Game AI (GVGAI) competition and its associated software framework provides a way of benchmarking AI algorithms on a large number of games written in a domain-specific description language. While the competition has seen plenty of interest, it has so far focused on online planning, providing a forward …
We analyze a family of portfolio management problems under relative performance criteria, for fund managers having CARA or CRRA utilities and trading in a common investment horizon in log-normal markets. We construct explicit constant equilibrium strategies for both the finite population games and the corresponding mea…
The paper analyzes optimal investment strategies in a game with jump risk, deriving mean field equilibria.
problem Optimal investment strategies in a game with jump risk and peer competition.
method Formulated mean field game and n-player game models, characterized equilibrium states, and derived approximation errors.
result Explicit mean field equilibrium and approximate Nash equilibrium for large n-player games.
Study many-player investment-consumption games with power FPPs, finding market-risk preference affects consumption.
problem Investment and consumption optimization in a mean field competition setting.
method Solve many-player and mean field games using power FPPs, providing closed-form solutions.
result Market-risk relative consumption preference affects agent's consumption decisions.
The paper analyzes optimal stock position-building strategies in competitive markets.
problem Optimal stock position-building in competitive markets with market impact.
method Developed a game-theoretic framework to find best-response strategies.
result Closed-form solutions for equilibrium trading strategies were derived.
Study strategic competition in commodity markets using impulse-switching controls.
problem Strategic competition between upstream and downstream firms in commodity markets.
method Non-zero-sum stochastic differential game with mixed impulse/switching controls.
result Multiple Nash equilibria found, depending on the number of switches by the downstream firm.
We formulate a general framework for competitive gradient-based learning that encompasses a wide breadth of multi-agent learning algorithms, and analyze the limiting behavior of competitive gradient-based learning algorithms using dynamical systems theory. For both general-sum and potential games, we characterize a non…
New framework recovers reward and rationality parameters from game behavior.
problem Statistical ambiguity in identifying reward and rationality parameters in competitive games.
method Blind Inverse Game Theory (Blind-IGT) using entropy-regularized Quantal Response Equilibrium and Normalized Least Squares (NLS) estimator.
result Optimal convergence rate of O(N−1/2) for joint parameter recovery. The paper analyzes strategic interactions in a multi-agent reinsurance chain using game theory.
problem Strategic behavior and competition among insurers and reinsurers in a multi-layer reinsurance chain.
method Employed Stackelberg differential games and non-zero-sum game models to characterize strategic interactions. Used dynamic programming and game theory to derive equilibrium strategies for investment and reinsurance.
result Intensified competition leads to reduced safety loadings in reinsurance contracts.
The paper analyzes trading strategies in a competitive market with incomplete information.
problem Strategic trading under uncertainty when firms lack full knowledge of competitors' strategies.
method Bayesian games framework to incorporate uncertainty and derive optimal trading strategies.
result Uncertainty significantly impacts trading strategies compared to complete information scenarios.
The paper extends macroscopic market making to stochastic games, revealing properties and solving equations.
problem Price competition among market makers in a stochastic game setting.
method Extension of macroscopic market making framework to stochastic games, introducing multidimensional characteristic equations.
result New well-posedness results for forward-backward stochastic differential equations.
Human behavioural patterns exhibit selfish or competitive, as well as selfless or altruistic tendencies, both of which have demonstrable effects on human social and economic activity. In behavioural economics, such effects have traditionally been illustrated experimentally via simple games like the dictator and ultimat…
Study explores optimal strategies in games with multiple players and mean-field interactions.
problem Optimal strategies in games with multiple players and mean-field interactions.
method Exploration of three different notions of optimality, including mean-field control solution, mean-field coarse correlated equilibria, and mean-field Nash equilibria.
result Approximation of cooperative and competitive equilibria in large N-player games by mean-field control and mean-field equilibria. New algorithm improves game learning with randomised optimism.
problem Learning in matrix games with unknown payoffs and bandit feedback.
method Integrates evolutionary algorithms into bandit framework for randomised optimism.
result Achieves sublinear regret, outperforming classical methods.
Framework for multi-agent RL with human feedback in a Snake game.
problem Improving multi-agent reinforcement learning with human feedback.
method Developed a simulated game environment for offline model training and online competitions. Introduced HILL methods and reward manipulation heuristics.
result Agents with HILL methods outperform those without in online competitions.
The paper develops algorithms for competitive RL in partially observable MGs.
problem Challenges in reinforcement learning with function approximation and partial observability.
method Proposes posterior sampling methods for self-play and adversarial learning in zero-sum MGs.
result Developed algorithms achieve low regret bounds scaling sublinearly with GEC and episode number.
AI beats 95% of humans in Rock-Paper-Scissors.
problem Predicting and modeling human behavior in strategic games.
method Used Markov Models of varying memory lengths to compete against humans, introducing a 'focus length' parameter.
result Multi-AI strategy wins over 95% of human opponents in continuous 300-round games.
The Interactive Minority Game (IMG) is an online version of the traditional Minority Game in which human players can enter into competition with the traditional computer-controlled agents. Through the rich (and, importantly, analytically understood) behaviour of the MG, we can explore humans' behaviour in different kin…