We study a portfolio optimization problem for competitive agents with CRRA utilities and a common finite time horizon. The utility of an agent depends not only on her absolute wealth and consumption but also on her relative wealth and consumption when compared to the averages among the other agents. We derive a closed …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Competitive Agents”
Agents learn to outperform in trading by using past and current prices.
problem Optimal trading performance beyond theoretical limits.
method Two-agent Almgren-Chriss liquidation game, schedule-learning, DDQN architectures.
result Agents with access to past and current prices achieve supra-competitive outcomes.
Study time-inconsistent portfolio optimization for competitive agents with relative performance criteria.
problem Time-inconsistent mean field and n-agent games under relative performance criteria.
method Construct open-loop equilibrium strategies for n-agent games and mean field games.
result Explicit solutions for n-agent games and mean field games, unique in a special class of equilibria.
Demand outstrips available resources in most situations, which gives rise to competition, interaction and learning. In this article, we review a broad spectrum of multi-agent models of competition (El Farol Bar problem, Minority Game, Kolkata Paise Restaurant problem, Stable marriage problem, Parking space problem and …
Study optimal investment in large populations of competitive, heterogeneous agents.
problem Maximizing utility in a large, interacting agent system with relative performance concerns.
method Analyzes stochastic utility maximization game in finite and infinite agent settings, using graphon models and backward stochastic differential equations.
result Convergence of Nash equilibria and optimal utilities from finite to infinite agent models under specific conditions.
Investigates portfolio selection among competitive agents with mean-variance preferences.
problem Optimizing portfolios with multi-agent competition and relative wealth comparison.
method Reformulated as a constrained, non-homogeneous stochastic linear-quadratic control problem; derived optimal feedback strategies; used decoupling techniques and fixed-point theory to solve nonlinear BSDEs.
result Characterized three scenarios based on market and competition parameters: unique Nash equilibrium, no Nash equilibrium, or infinitely many Nash equilibria.
Study optimal investment and consumption strategies for competitive agents with habit formation.
problem Optimal investment and consumption strategies for competitive agents with habit formation.
method Formulated n-agent game problems and mean field game problems, derived mean field equilibrium, constructed approximate Nash equilibrium.
result Explicit convergence order of approximate Nash equilibrium can be obtained.
Develops a learning model predictive controller for competitive racing.
problem Lack of exploration in state space and complexity in obstacle avoidance.
method Explores state space through multiple initializations and develops a new method for convex terminal set selection.
result Yields a richer terminal safe set and maintains convexity.
A fair reward system boosts participation in federated learning.
problem Fairness in federated learning among competitive agents with siloed data.
method Hierarchically fair federated learning (HFFL) framework with proportional rewards based on contribution levels.
result Efficacy of HFFL in maintaining fairness and facilitating federated learning in competitive settings.
Algorithm for decentralized competition among adaptive agents.
problem Decentralized competition among adaptive networks.
method Developed an algorithm for decentralized competition among teams of adaptive agents.
result Algorithm enables decentralized competition among adaptive agents.
Condensation in an Economic Model with Brand Competitionphysics.soc-ph
We present a linear agent based model on brand competition. Each agent belongs to one of the two brands and interacts with its nearest neighbors. In the process the agent can decide to change to the other brand if the move is beneficial. The numerical simulations show that the systems always condenses into a state when…
Study shows market volatility affects optimal communication design for trading strategies.
problem Investigating how communication impacts trading strategy performance in multi-agent systems.
method 5-agent LLM-based trading systems across 450 experiments spanning 21 months, comparing 5 organizational structures.
result Communication improves performance but depends on market characteristics, with competitive conversation excelling in volatile tech stocks.
Indirect competition emerged from the complex organization of human societies, and knowledge of the existing network topology may aid in developing effective strategies for success. Here, we propose an agent-based model of competition with systems co-existing in a `small-world' social network. We show that within the r…
LLMs can collude in market divisions, maximizing profits.
problem Strategic collusion of LLM agents in multi-commodity markets.
method Examined LLMs in Cournot competition frameworks, analyzing pricing and resource allocation strategies.
result LLMs can monopolize specific commodities without direct human input or explicit collusion commands.
Model analyzes competitive pricing strategies in large markets of perishable products.
problem Maximizing profits in a competitive market of perishable products.
method Mean-field competition model, Hamilton-Jacobi-Bellman equation, iterative numerical algorithm.
result Properties of equilibrium pricing strategies and market dynamics.
Framework for multi-agent RL with human feedback in a Snake game.
problem Improving multi-agent reinforcement learning with human feedback.
method Developed a simulated game environment for offline model training and online competitions. Introduced HILL methods and reward manipulation heuristics.
result Agents with HILL methods outperform those without in online competitions.
Forward utility and market adjustments in relative investment-consumption games of many playersecon.GN
Study many-player investment-consumption games with power FPPs, finding market-risk preference affects consumption.
problem Investment and consumption optimization in a mean field competition setting.
method Solve many-player and mean field games using power FPPs, providing closed-form solutions.
result Market-risk relative consumption preference affects agent's consumption decisions.
Survey examines LLMs in financial trading.
problem Using LLMs to outperform professional traders in finance.
method Comprehensive review of current research on LLMs in financial trading.
result LLMs can potentially outperform professional traders in backtesting.
In this study, we investigate the use of global information to speed up the learning process and increase the cumulative rewards of reinforcement learning (RL) in competition tasks. Within the actor-critic RL, we introduce multiple cooperative critics from two levels of the hierarchy and propose a reinforcement learnin…
We present examples of agent-based and stochastic models of competition and business processes in economics and finance. We start from as simple as possible models, which have microscopic, agent-based, versions and macroscopic treatment in behavior. Microscopic and macroscopic versions of herding model proposed by Kirm…
ContestTrade uses competitive teams to improve LLM trading performance.
problem High sensitivity to market noise in LLM-based trading systems.
method Internal competitive mechanism, data and research teams, real-time evaluation.
result Significantly outperforms other systems across various metrics.
Through multi-agent competition, the simple objective of hide-and-seek, and standard reinforcement learning algorithms at scale, we find that agents create a self-supervised autocurriculum inducing multiple distinct rounds of emergent strategy, many of which require sophisticated tool use and coordination. We find clea…
This paper presents the first two editions of Visual Doom AI Competition, held in 2016 and 2017. The challenge was to create bots that compete in a multi-player deathmatch in a first-person shooter (FPS) game, Doom. The bots had to make their decisions based solely on visual information, i.e., a raw screen buffer. To p…
New algorithm improves self-play reinforcement learning for competitive games.
problem Inefficient opponent selection in self-play reinforcement learning.
method Intelligently selects opponents based on adversarial rules derived from saddle point optimization.
result Algorithm converges to approximate equilibrium with high probability in convex-concave games.
We analyze a family of portfolio management problems under relative performance criteria, for fund managers having CARA or CRRA utilities and trading in a common investment horizon in log-normal markets. We construct explicit constant equilibrium strategies for both the finite population games and the corresponding mea…
Paper studies competitive networks where teams aim to minimize their own objectives, adapting to each other's strategies.
problem Competitive networks where teams have conflicting objectives.
method Proposes diffusion learning algorithms for two classes of network games: zero-sum and non-zero-sum.
result Stability performance of proposed algorithms analyzed and demonstrated through experiments.
In this model study of the commodity market, we present some evidence of competition of commodities for the status of money in the regime of parameters, where emergence of money is possible. The competition reveals itself as a rivalry of a few (typically two) dominant commodities, which take the status of money in turn…
Paper tackles delays in multi-agent reinforcement learning, improving performance.
problem Challenges in reinforcement learning due to delays in real-world systems.
method Proposes a novel framework for multi-agent reinforcement learning with delays, using Delay-Aware Markov Games and centralized-decentralized training.
result Demonstrates significant improvement in performance with delay-aware multi-agent reinforcement learning.
The Pommerman simulation was recently developed to mimic the classic Japanese game Bomberman, and focuses on competitive gameplay in a multi-agent setting. We focus on the 22 team version of Pommerman, developed for a competition at NeurIPS 2018. Our methodology involves training an agent initially through imit…
We present a new general board game (GBG) playing and learning framework. GBG defines the common interfaces for board games, game states and their AI agents. It allows one to run competitions of different agents on different games. It standardizes those parts of board game playing and learning that otherwise would be t…
The paper analyzes reinsurance strategies in a competitive multi-agent system.
problem Strategic interactions and competitive behavior in multi-layer reinsurance chains.
method Stochastic differential games and non-zero-sum game models to characterize strategic interactions. Dynamic programming and game theory to derive equilibrium strategies.
result Intensified competition reduces safety loadings in reinsurance contracts.
Learning to cooperate with friends and compete with foes is a key component of multi-agent reinforcement learning. Typically to do so, one requires access to either a model of or interaction with the other agent(s). Here we show how to learn effective strategies for cooperation and competition in an asymmetric informat…
Learning when to communicate and doing that effectively is essential in multi-agent tasks. Recent works show that continuous communication allows efficient training with back-propagation in multi-agent scenarios, but have been restricted to fully-cooperative tasks. In this paper, we present Individualized Controlled Co…
The Impact of Designated Market Makers on Market Liquidity and Competition: A Simulation Approachq-fin.TR
This study examines how DMMs affect market liquidity and competition.
problem The impact of DMMs on market liquidity and competition.
method Agent-based simulations to explore the effects of varying competition levels and incentive structures among DMMs.
result Optimal competition among DMMs maximizes liquidity benefits without negatively impacting price discovery.
New algorithms prove self-play can be effective in competitive RL.
problem Proving self-play algorithms' effectiveness in competitive reinforcement learning.
method Introduced Value Iteration with Upper/Lower Confidence Bound (VI-ULCB) and explore-then-exploit algorithms.
result Achieved regret bounds of and .
Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to perform better in similar future tasks. This paper investigates the counterfactual th…
Market equilibrium price proven in a large-agent model.
problem Proving market equilibrium in a large-agent setting.
method Proved existence of equilibrium price in a complete, continuous time market with infinite agents.
result The equilibrium price dynamics decouple as the number of agents increases.
Study optimal investment strategies for competitive agents using Mean Field Games.
problem Optimizing portfolios with relative performance criteria.
method Mean Field Game framework applied to CRRA and CARA utility cases.
result Derivation of optimal investment and consumption strategies.
Study shows how competition affects learning in matching markets, proving it's possible to balance stability, fairness, and regret.
problem How competition affects learning in matching markets and the impossibility of simultaneously guaranteeing stability and low optimal regret.
method Modeling a two-sided matching market with bandit learners and adding components of costs and transfers.
result It is possible to simultaneously guarantee stability, low optimal regret, fairness in the distribution of regret, and high social welfare.
In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases, the dimensionality of the input and control spaces increase as well, and these met…
Challenge encourages reproducible deep learning methods.
problem Inconsistent training behavior in deep learning competitions.
method Evaluate methods based on their training procedures, retrain in controlled settings.
result Guaranteed reproducibility and generalization of methods.
Agents trained with reinforcement learning deviate from Nash equilibrium in optimal execution game.
problem Deviation of reinforcement learning strategies from Nash equilibrium in optimal execution game.
method Two-player optimal execution game with reinforcement learning algorithms (Double Deep Q-Learning).
result Strategies learned by agents deviate significantly from Nash equilibrium, exhibiting supra-competitive solutions.
Method models other agents' behaviors without requiring direct observation.
problem Understanding and interacting effectively with other agents in reinforcement learning.
method Extracts representations from local observations of the controlled agent using encoder-decoder architectures.
result The method achieves higher returns than baseline methods in multi-agent environments.
A maximum entropy model of bounded rational decision-making with prior beliefs and market feedbackcs.IT
Model captures decision-making under bounded rationality with prior beliefs and market feedback.
problem Bounded rationality in decision-making with limited processing abilities.
method Maximum entropy principle applied to Quantal Response Statistical Equilibrium framework.
result Prior beliefs influence decision-making, altering the outcome of market feedback.
Many real world tasks require multiple agents to work together. Multi-agent reinforcement learning (RL) methods have been proposed in recent years to solve these tasks, but current methods often fail to efficiently learn policies. We thus investigate the presence of a common weakness in single-agent RL, namely value fu…
When Big Data Fails! Relative success of adaptive agents using coarse-grained information to compete for limited resourcesphysics.soc-ph
The recent trend for acquiring big data assumes that possessing quantitatively more and qualitatively finer data necessarily provides an advantage that may be critical in competitive situations. Using a model complex adaptive system where agents compete for a limited resource using information coarse-grained to differe…
The paper addresses how to complete incomplete risk markets by iteratively enhancing welfare.
problem How to complete incomplete risk markets to enhance welfare.
method Iterative mechanism to complete the market while monotonically enhancing welfare.
result Iterative completion of incomplete risk markets can enhance welfare.
Paper tackles RL for power grid topology optimization.
problem Managing large action spaces in growing power networks.
method Hierarchical multi-agent reinforcement learning (MARL) framework.
result MARL framework outperforms single-agent RL methods.