A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Study explores optimal strategies in games with multiple players and mean-field interactions.
problem Optimal strategies in games with multiple players and mean-field interactions.
method Exploration of three different notions of optimality, including mean-field control solution, mean-field coarse correlated equilibria, and mean-field Nash equilibria.
result Approximation of cooperative and competitive equilibria in large N-player games by mean-field control and mean-field equilibria.
The existence of stationary Markov perfect equilibria in stochastic games is shown under a general condition called "(decomposable) coarser transition kernels". This result covers various earlier existence results on correlated equilibria, noisy stochastic games, stochastic games with finite actions and state-independe…
Almost all of the work in graphical models for game theory has mirrored previous work in probabilistic graphical models. Our work considers the opposite direction: Taking advantage of recent advances in equilibrium computation for probabilistic inference. We present formulations of inference problems in Markov random f…
This paper tackles sample-efficient reinforcement learning for partially observable Markov games.
problem Learning in partially observable Markov games with incomplete information.
method A simple algorithm combining optimism and Maximum Likelihood Estimation (MLE) for self-play, and a variant of optimistic MLE for adversarial opponents.
result The proposed algorithms achieve approximate Nash, correlated, and coarse correlated equilibria in polynomial samples for weakly revealing POMGs.
New algorithms for RL in Markov games with independent linear function approximation, breaking the curse of multiagents.
problem Tackles the challenge of learning Markov equilibria in large state space Markov games with multiple agents.
method Proposes independent linear Markov games and designs new algorithms for learning Markov coarse correlated equilibria and Markov correlated equilibria with polynomial sample complexity.
result Breaks the curse of multiagents by achieving sample complexity bounds that scale polynomially with each agent's function class complexity.
We study constrained nonconvex optimization problems in machine learning, signal processing, and stochastic control. It is well-known that these problems can be rewritten to a minimax problem in a Lagrangian form. However, due to the lack of convexity, their landscape is not well understood and how to find the stable e…
We study the convergence of Nash equilibria in a game of optimal stopping. If the associated mean field game has a unique equilibrium, any sequence of n-player equilibria converges to it as n→∞. However, both the finite and infinite player versions of the game often admit multiple equilibria. We show that me…
The study examines different types of equilibria for stopping problems in one-dimensional diffusion processes.
problem Characterizing and comparing different types of equilibria for time-inconsistent stopping problems.
method Analyzes log sub-additive discount functions and one-dimensional diffusion processes to derive necessary and sufficient conditions for weak equilibria and other types of equilibria.
result Conditions for weak equilibria and their implications for other types of equilibria are provided.
We propose local symplectic surgery, a two-timescale procedure for finding local Nash equilibria in two-player zero-sum games. We first show that previous gradient-based algorithms cannot guarantee convergence to local Nash equilibria due to the existence of non-Nash stationary points. By taking advantage of the differ…
For a symmetric Hamiltonian system, lower bounds for the number of relative equilibria surrounding stable and formally unstable relative equilibria on nearby energy levels are given.
A new definition of continuous-time equilibrium controls is introduced. As opposed to the standard definition, which involves a derivative-type operation, the new definition parallels how a discrete-time equilibrium is defined, and allows for unambiguous economic interpretation. The terms "strong equilibria" and "weak …
We prove a criterion for stability of relative equilibria in symmetric Hamiltonian systems at singular points of the momentum map. This generalizes a theorem of G.W. Patrick. The method of the proof is also useful in studying the bifurcation of relative equilibria.
Smooth calibration improves forecast reliability even with leaked information.
problem Improving forecast reliability with leaked information.
method Combining nearby forecasts to ensure smooth calibration, which can be guaranteed by deterministic procedures.
result Smooth calibration can be guaranteed by deterministic procedures even with leaked forecasts, and it yields uncoupled finite-memory dynamics in games.
Under risk, Arrow-Debreu equilibria can be implemented as Radner equilibria by continuous trading of few long-lived securities. We show that this result generically fails if there is Knightian uncertainty in the volatility. Implementation is only possible if all discounted net trades of the equilibrium allocation are m…
In this paper the possibility of computing equilibrium in pure exchange and production economies by a homotopy method is investigated. The performance of the algorithm is tested on examples with known equilibria taken from the literature on general equilibrium models and numerical results are presented. In computing eq…
We study optimal behavior of energy producers under a CO_2 emission abatement program. We focus on a two-player discrete-time model where each producer is sequentially optimizing her emission and production schedules. The game-theoretic aspect is captured through a reduced-form price-impact model for the CO_2 allowance…
We obtain a formula for the number of horizontal equilibria of a planar convex body K with respect to a center of mass O in terms of the winding number of the evolute of ∂K with respect to O. The formula extends to the case where O lies on the evolute of ∂K and a suitably modified version ho…
We present applications of the notion of isomorphic vector fields to the study of nonlinear stability of relative equilibria. Isomorphic vector fields were introduced by Hepworth [Theory Appl. Categ. 22 (2009), 542-587] in his study of vector fields on differentiable stacks. Here we argue in favor of the usefulness of …
We undertake a fundamental study of network equilibria modeled as solutions of fixed point equations for monotone linear functions with saturation nonlinearities. The considered model extends one originally proposed to study systemic risk in networks of financial institutions interconnected by mutual obligations and is…
We prove that in smooth Markovian continuous-time economies with potentially complete asset markets, Radner equilibria with endogenously complete markets exist.
This work finds mixed equilibria in zero-sum games using interacting particle dynamics.
problem Finding mixed equilibrium points in continuous minmax games.
method A method based on entropic regularisation of two-layer zero-sum games with interacting particle dynamics.
result The sequence of empirical measures of the particle system satisfies a large deviation principle as the number of particles grows to infinity, implying convergence of the empirical measure and the Nikaidô-Isoda error.
Given a multifunction from X to the k−fold symmetric product Symk(X), we use the Dold-Thom Theorem to establish a homological selection Theorem. This is used to establish existence of Nash equilibria. Cost functions in problems concerning the existence of Nash Equilibria are traditionally multilinear in the mixe…
Existence of stochastic financial equilibria giving rise to semimartingale asset prices is established under a general class of assumptions. These equilibria are expressed in real terms and span complete markets or markets with withdrawal constraints.We deal with random endowment density streams which admit jumps and g…
In this paper, we study the problem of learning the set of pure strategy Nash equilibria and the exact structure of a continuous-action graphical game with quadratic payoffs by observing a small set of perturbed equilibria. A continuous-action graphical game can possibly have an uncountable set of Nash euqilibria. We p…
New MARL algorithms resolve the curse of multiagency with function approximation.
problem Challenges in Multi-Agent Reinforcement Learning (MARL) due to the curse of multiagency.
method V-Learning with Policy Replay and Decentralized Optimistic Policy Mirror Descent.
result First polynomial sample complexity results for learning approximate Coarse Correlated Equilibria (CCEs) of Markov Games under decentralized linear function approximation.