This work formalizes and extends parameter sharing in multi-agent reinforcement learning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
QTMRL uses RL with multi-indicators to improve trading adaptability.
We study the effect of the social stratification on the wealth distribution on a system of interacting economic agents that are constrained to interact only within their own economic class. The economical mobility of the agents is related to its success in exchange transactions. Different wealth distributions are obtai…
Hierarchical AI multi-agent framework optimizes equity portfolios in China's A-share market.
Different models to study the wealth distribution in an artificial society have considered a transactional dynamics as the driving force. Those models include a risk aversion factor, but also a finite probability of favoring the poorer agent in a transaction. Here we study the case where the partners in the transaction…
We study a networked version of the minority game in which agents can choose to follow the choices made by a neighbouring agent in a social network. We show that for a wide variety of networks a leadership structure always emerges, with most agents following the choice made by a few agents. We find a suitable parameter…
A feature-rich Bitcoin trading assistant using reinforcement learning.
Study shows HFT improves market liquidity indicators.
We introduce a simple model for addressing the controversy in the study of financial systems, sometimes taken as brownian-like processes and other as critical systems with fluctuations of arbitrary magnitude. The model considers a collection of economical agents which establish trade connections among them according to…
This note gives a short, self-contained, proof of a sharp connection between Gittins indices and Bayesian upper confidence bound algorithms. I consider a Gaussian multi-armed bandit problem with discount factor . The Gittins index of an arm is shown to equal the -quantile of the posterior distribution of the arm'…
Agents collaborate to reduce regret in a multi-agent linear bandit problem with side information.
Paper presents a hybrid framework combining sentiment analysis and market indicators for financial portfolio optimization.
We describe a simple model for speculative trading based on adaptive behavior of economic agents.The adaptive behavior is expressed through a feedback mechanism for changing agents' stock-to-bond ratios, depending on the past performance of their portfolios.The stock price is set according to the demand-supply for the …
Paper tackles RL for power grid topology optimization.
Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In this paper, we introduce an approach that integrates human strategies to increa…
Multi-agent systems exhibit complex behaviors that emanate from the interactions of multiple agents in a shared environment. In this work, we are interested in controlling one agent in a multi-agent system and successfully learn to interact with the other agents that have fixed policies. Modeling the behavior of other …
The large majority of risk-sharing transactions involve few agents, each of whom can heavily influence the structure and the prices of securities. This paper proposes a game where agents' strategic sets consist of all possible sharing securities and pricing kernels that are consistent with Arrow-Debreu sharing rules. F…
Multi-agent reinforcement learning (MARL) has recently received considerable attention due to its applicability to a wide range of real-world applications. However, achieving efficient communication among agents has always been an overarching problem in MARL. In this work, we propose Variance Based Control (VBC), a sim…
Q-learning is a simple and powerful tool in solving dynamic problems where environments are unknown. It uses a balance of exploration and exploitation to find an optimal solution to the problem. In this paper, we propose using four basic emotions: joy, sadness, fear, and anger to influence a Qlearning agent. Simulation…
The Neural Testbed evaluates joint predictions of neural agents, revealing their limitations.
FedSight AI predicts federal funds rate using LLMs and multi-agent reasoning.
Regret analysis is challenging in Multi-Agent Reinforcement Learning (MARL) primarily due to the dynamical environments and the decentralized information among agents. We attempt to solve this challenge in the context of decentralized learning in multi-agent linear-quadratic (LQ) dynamical systems. We begin with a simp…
Agents learn to outperform in trading by using past and current prices.
Asynchronous cooperative learning rules ensure all agents converge to correct hypothesis.
Enhances RL for better stock market trading decisions.
This work explores a social learning problem with agents having nonidentical noise variances and mismatched beliefs. We consider an -agent binary hypothesis test in which each agent sequentially makes a decision based not only on a private observation, but also on preceding agents' decisions. In addition, the agents…
New algorithm tackles multi-agent bandits with heavy-tailed data.
On the framework of the Linear Farmer's Model, we approach the indeterminacy of agents' behaviour by associating with each agent an unconditional probability for her to be active at each time step. We show that Pareto tailed returns can appear even if value investors are the only strategies on the market and give a pro…
We propose a new method for assessing agents' influence in financial network structures, which takes into consideration the intensity of interactions. A distinctive feature of this approach is that it considers not only direct interactions of agents of the first level and indirect interactions of the second level, but …
We build a model using Gaussian processes to infer a spatio-temporal vector field from observed agent trajectories. Significant landmarks or influence points in agent surroundings are jointly derived through vector calculus operations that indicate presence of sources and sinks. We evaluate these influence points by us…
We introduce a framework to study the effective objectives at different time scales of financial market microstructure. The financial market can be regarded as a complex adaptive system, where purposeful agents collectively and simultaneously create and perceive their environment as they interact with it. It has been s…
Study proposes a multi-agent system using LLMs for REIT trading, outperforming benchmarks.
This paper augments the reward received by a reinforcement learning agent with potential functions in order to help the agent learn (possibly stochastic) optimal policies. We show that a potential-based reward shaping scheme is able to preserve optimality of stochastic policies, and demonstrate that the ability of an a…
We propose an analytically tractable variation of the minority game in which rational agents use probabilistic strategies. In our model, agents choose between two alternatives repeatedly, and those who are in the minority get a pay-off 1, others zero. The agents optimize the expectation value of their discounted fu…
A multi-agent system improves crypto portfolio management by processing diverse data types.
Paper tackles Byzantine resilience in distributed multi-task learning.
The paper shows why AI safety doesn't generalize across tasks.
New AI governance framework tackles risks in finance.
How do we know if communication is emerging in a multi-agent system? The vast majority of recent papers on emergent communication show that adding a communication channel leads to an increase in reward or task success. This is a useful indicator, but provides only a coarse measure of the agent's learned communication a…
We introduce an agent-based model, in which agents set their prices to maximize profit. At steady state the market self-organizes into three groups: excess producers, consumers and balanced agents, with prices determined by their own resource level and a couple of macroscopic parameters that emerge naturally from the a…
This study examines how DMMs affect market liquidity and competition.
Robust algorithm for distributed optimization resistant to Byzantine failures.
XGB-Chiarella model generates realistic intra-day financial price data using agent-based models.
We have studied the statistical mechanics of money circulation in a closed economic system. An explicit statistical formulation of the circulation velocity of money is presented for the first time by introducing the concept of holding time of money. The result indicates that the velocity is governed by behavior pattern…
We are increasingly surrounded by artificially intelligent technology that takes decisions and executes actions on our behalf. This creates a pressing need for general means to communicate with, instruct and guide artificial agents, with human language the most compelling means for such communication. To achieve this i…
We have studied here the self-organising features of the dynamics of a model market, where the agents `trade' for a single commodity with their money. The model market consists of fixed numbers of economic agents, money supply and commodity. We demonstrate that the model, apart from showing a self-organising behaviour,…
FinVision uses LLM agents to predict stock markets by processing various financial data types.
A novel framework combines LLMs and RL for financial portfolio optimization.