New method improves convergence for smooth games.
problem Improving convergence for smooth games.
method Stochastic Hamiltonian Gradient Methods (SHGD).
result SHGD converges linearly to the neighbourhood of a stationary point.
New tools understand and control dynamics in n-player differentiable games.
problem Understanding and controlling the behavior of gradient-based methods in games.
method Developed new tools to understand and control the dynamics in n-player differentiable games, decomposing the game Jacobian into symmetric and antisymmetric components.
result Motivated Symplectic Gradient Adjustment (SGA) algorithm for finding stable fixed points in differentiable games.
Formulates mechanics for probability distributions on statistical manifold.
problem Formulating mechanics for probability distributions on statistical manifold.
method Information-geometric formulation of Classical Mechanics on statistical manifold, using dually-flat connection and Hilbert bundle structure.
result Provides coherent formalism for Lagrangian and Hamiltonian mechanics on statistical bundle.
NOHD optimizes multi-agent systems by decomposing dynamics into irrotational and solenoidal components.
problem Non-stationarity and conflicting interests in multi-agent learning problems.
method NOHD (Newton Optimization on Helmholtz Decomposition) decomposes system dynamics into irrotational and solenoidal components.
result NOHD ensures quadratic convergence in purely irrotational and solenoidal systems and attracts to stable fixed points in general multi-agent systems.
This work generalizes Hamiltonian mechanics using closed differential forms.
problem Hidden invariants in classical Hamiltonian mechanics.
method Establishes a novel correspondence between generalized Hamiltonian mechanics and multisymplectic geometry.
result Key theorems linking classical and generalized Hamiltonian systems.
Classifies Hamiltonian and quasi-Hamiltonian manifolds with specific group actions.
problem Classifying specific types of manifolds under group actions.
method General classification of multiplicity free manifolds, focusing on rank one.
result Obtained numerous new concrete examples of quasi-Hamiltonian manifolds.
Study investigates Hamiltonian systems in fibered almost-symplectic manifolds.
problem Existence and properties of non-vertical fully-Hamiltonian vector fields in almost symplectic manifolds with Lagrangian fibrations.
method Investigates vector fields in 2n-dimensional almost symplectic manifolds with Lagrangian fibrations, focusing on partially-Hamiltonian and fully-Hamiltonian vector fields.
result Non-vertical fully-Hamiltonian vector fields exist under certain genericity conditions and can be reduced to families of symplectic-Hamiltonian vector fields.
Paper presents content-based models for game recommendation in cold start scenarios.
problem Cold start problem in game recommendation where new games and players have no historical data.
method Uses survey data to develop content-based interaction models that generalize to new games, players, and both.
result Content models outperform collaborative filtering in predicting new interactions.
Develops Hamiltonian Score Matching and Generative Flows for machine learning.
problem Estimating score functions and designing generative models.
method Introduces Hamiltonian velocity predictors (HVPs) for score matching and generative flows.
result Hamiltonian Generative Flows (HGFs) rival leading generative modeling techniques.
Holographic energy equals Hamiltonian energy.
problem Equating holographic and Hamiltonian energies.
method Relative holographic and Hamiltonian energy comparison.
result Holographic energy is identical to Hamiltonian energy.
Summing Hamiltonian manifolds with a common submanifold.
problem Combining Hamiltonian manifolds with a shared submanifold.
method Establishing symplectic reduction and comparing Chern classes.
result Symplectic reduction of the sum agrees with the sum of reductions.
In this work, we ask the following question: Can visual analogies, learned in an unsupervised way, be used in order to transfer knowledge between pairs of games and even play one game using an agent trained for another game? We attempt to answer this research question by creating visual analogies between a pair of game…
The study examines stability of Hamiltonian Poisson integrators on both integrable and non-integrable systems.
problem Investigating stability properties of Hamiltonian Poisson integrators.
method Examples of Lotka-Volterra dynamics and numerical investigations of a non-integrable system are used.
result The existence of a modified Hamiltonian is crucial for the stability of Hamiltonian Poisson integrators.
The paper studies co-Hamiltonian diffeomorphisms on compact cosymplectic manifolds.
problem Fix-point theory and co-Hamiltonian diffeomorphisms on compact cosymplectic manifolds.
method Fix-point theory, Arnold's conjecture, co-Hofer norms, topologies, approximations lemmas.
result Minimum number of fix points for co-Hamiltonian diffeomorphisms is at least 1.
Potential games, originally introduced in the early 1990's by Lloyd Shapley, the 2012 Nobel Laureate in Economics, and his colleague Dov Monderer, are a very important class of models in game theory. They have special properties such as the existence of Nash equilibria in pure strategies. This note introduces graphical…
A new framework for playing and learning board games.
problem Tackling the tedious and repetitive aspects of coding for board game AI.
method Developed a generic TD(λ)-n-tuple agent for arbitrary board games. result TD(λ)-n-tuple outperforms other generic agents on various games. IGGP learns game rules from varying quality game play, finding no overall trend.
problem Learn game rules from varying quality game play.
method Used Sancho's intelligent game traces and ILP systems (Metagol, Aleph, ILASP) to induce game rules from traces of varying quality and volume.
result No overall trend in accuracy of learned game rules from varying quality and volume of training data.
New algorithms improve MCMC efficiency for complex distributions.
problem High variance and low effective sample size in MCMC samplers.
method Antithetic Riemannian Manifold and Quantum-Inspired Hamiltonian Monte Carlo.
result Improved effective sample size and variance reduction.
The paper explores deformations of quasi-Hamiltonian spaces to Hamiltonian spaces.
problem Deforming quasi-Hamiltonian spaces to Hamiltonian spaces.
method Introducing and proving examples of deformations, including Lie groups and conjugacy classes.
result Moduli space of flat G-connections deforms to T*G^r+g.
A game on diagrams switches crossing directions to achieve connectedness.
problem Achieving connectedness in diagrams through crossing switches.
method Players switch crossing directions on regions of a diagram to achieve connectedness.
result Connectedness can be achieved through strategic crossing switches.
Let (M,w) be a compact symplectic 2n-manifold, and g a Riemannian metric on M compatible with w. For instance, g could be Kahler, with Kahler form w. Consider compact Lagrangian submanifolds L of M. We call L Hamiltonian stationary, or H-minimal, if it is a critical point of the volume functional under Hamiltonian defo…
New integrators preserve geometric structure in Hamiltonian systems.
problem Preserving geometric structure in Hamiltonian systems on Jacobi manifolds.
method Combining Poissonization and symplectic bi-realizations to construct structure-preserving integrators.
result Explicit construction and application of Jacobi Hamiltonian integrators.
Introduces SM-games to analyze machine learning interactions.
problem Lack of understanding and control in n-player games.
method Introduces SM-games with pairwise zero-sum interactions.
result SM-games are amenable to first-order optimization methods.
The paper develops a theory linking Hamiltonian and quasi-Hamiltonian manifolds.
problem Understanding the deformation of Hamiltonian quasi-Poisson manifolds to Hamiltonian Poisson manifolds.
method Introduces a generalized Hamiltonian deformation theory and constructs a topological quantum field theory.
result Shows that the imploded cross section of the double $D(G)_\imp$ deforms to the implosion of the cotangent bundle $T^*G_\imp$.
Just as war is sometimes fallaciously represented as a zero sum game -- when in fact war is a negative sum game - stock market trading, a positive sum game over time, is often erroneously represented as a zero sum game. This is called the "zero sum fallacy" -- the erroneous belief that one trader in a stock market exch…
The existence of stationary Markov perfect equilibria in stochastic games is shown under a general condition called "(decomposable) coarser transition kernels". This result covers various earlier existence results on correlated equilibria, noisy stochastic games, stochastic games with finite actions and state-independe…
Game theory helps analyze ESOs/EBIs in production and service sectors.
problem Economic incentives affect traditional production/service functions and create intangible capital.
method Uses game theory to analyze interactions in ESO/EBI transactions.
result No perfect Nash Equilibria for two-stage games involving many participants.
Gauss diagrams' properties can change with Hamiltonian cycle choice.
problem The impact of Hamiltonian cycle choice on Gauss diagrams.
method Examined realizable and unrealizable Gauss diagrams, and proved preservation of realizability under certain Hamiltonian cycle changes.
result Properties of Gauss diagrams can vary with Hamiltonian cycle choice.
Combinatorial two-player games have recently been applied to knot theory. Examples of this include the Knotting-Unknotting Game and the Region Unknotting Game, both of which are played on knot shadows. These are turn-based games played by two players, where each player has a separate goal to achieve in order to win the…
We start briefly surveying research on optimal stopping games since their introduction by E.B.Dynkin more than 40 years ago. Recent renewed interest to dynkin's games is due, in particular, to the study of Israeli (game) options introduced in 2000. We discuss the work on these options and related derivative securities …
The paper explores how regularization can lead to convergence in imperfect information games.
problem Finding equilibrium in imperfect information games with imperfect information.
method Investigates Follow the Regularized Leader dynamics and how adding a regularization term can lead to strong convergence guarantees.
result The approach leads to algorithms that converge exactly to the Nash equilibrium in imperfect information games.
Educational game on crypto investment helps students grasp macroeconomics.
problem Weak connections between microeconomic decision-making and macroeconomic concepts in classroom games.
method Design and study of an educational game on cryptocurrency investment.
result Engages students in understanding macroeconomics through incentivized individual investment decisions.
Simplified NFT games discussed with methods for extracting value.
problem Issues influencing NFT games' structure and stability.
method Three methods for extracting value from NFT games.
result Various design constraints and mutual beneficial games.
Classifies compact multiplicity free quasi-Hamiltonian manifolds.
problem Classifying compact, multiplicity free, quasi-Hamiltonian manifolds.
method Symplectic reductions and Lie group analysis.
result Recover old and find new examples of these structures.
Hamiltonian dynamics-based algorithms achieve deterministic and accelerated convergence for convex optimization.
problem Accelerating convex optimization
method Hamiltonian dynamics
result Hamiltonian dynamics-based algorithms achieve deterministic and accelerated convergence for convex optimization.
Arnold-Liouville systems cannot be bi-Hamiltonian generically.
problem The bi-Hamiltonian structure of Arnold-Liouville systems.
method Proving that a specific class of smooth functions is a meagre subset for the Fréchet topology, which implies Arnold-Liouville systems cannot be bi-Hamiltonian.
result Generically, Arnold-Liouville systems cannot be bi-Hamiltonian.
New method calculates volume-renormalized mass from Hamiltonian perspective.
problem Calculating volume-renormalized mass for asymptotically hyperbolic manifolds.
method Using Michel's mass invariants and a reduced Hamiltonian perspective, the volume-renormalized mass is deduced.
result The reduced Hamiltonian recovers the volume-renormalized mass and its variations.
The paper proposes a method to learn continuous-action graphical games from perturbed equilibria.
problem Learning the exact structure of continuous-action graphical games from limited data.
method A ℓ12− block regularized method to recover the graphical game structure. result The method recovers the exact structure of the graphical game under certain conditions.
We introduce TextWorld, a sandbox learning environment for the training and evaluation of RL agents on text-based games. TextWorld is a Python library that handles interactive play-through of text games, as well as backend functions like state tracking and reward assignment. It comes with a curated list of games whose …
Survey on strong closing lemmas in Hamiltonian dynamics.
problem Understanding dynamics in Hamiltonian systems.
method Use spectral invariants in symplectic geometry.
result Proofs of strong closing lemmas in various dimensions.
The paper discusses reducing Hamiltonian systems by scaling and standard symmetries, leading to Kirillov Hamiltonian systems.
problem Reduction of symplectic Hamiltonian systems by scaling and standard symmetries.
method Proof of Kirillov Hamiltonian systems and equivalence of reductions.
result Equivalent Kirillov Hamiltonian systems from different reduction orders.
Gradient Descent Ascent converges to von-Neumann solution in hidden zero-sum games.
problem Understanding dynamics of zero-sum games with hidden structure.
method Gradient Descent Ascent applied to hidden zero-sum games with specific convex-concave structure.
result Gradient Descent Ascent converges to von-Neumann solution in strictly convex-concave hidden games.
Paper tackles hidden game problem in AI alignment and language games.
problem Hidden game problem in AI alignment and language games.
method Developed a composition of regret minimization techniques to discover and exploit hidden structures.
result Achieved optimal external and swap regret bounds for rapid convergence to correlated equilibria.
AEC Games model represents software MARL environments better than POSGs.
problem POSGs are conceptually unsuitable for software MARL environments.
method Introduced AEC Games model as an equivalent to POSGs.
result AEC Games model is more representative of software MARL environments.
Hamiltonian Monte Carlo converges to target distributions under mild conditions.
problem Establishing convergence of Hamiltonian Monte Carlo algorithms.
method Analyzing Lq convergence for Hamiltonian Monte Carlo under mild conditions. result Outputs converge to target distributions under specified conditions.
Develops integrators for contact Hamiltonian systems preserving geometric structure.
problem Creating integrators for dissipative systems with geometric structure.
method Structure-preserving splitting framework based on exact-contact subflows.
result Local universality of contact splitting integrators.
The purpose of this short note is to prove the uniqueness of Hamiltonian volume minimizing Lagrangian submanifolds which are Hamiltonian isotopic to RP^n in CP^n modulo isometric group actions.
Differentiable simulations control molecular Hamiltonians for desired outcomes.
problem Control and learning of molecular Hamiltonians for desired outcomes.
method Differentiable simulations to differentiate Hamiltonians with respect to target observables.
result Control and learning of molecular Hamiltonians for desired outcomes.