Method models other agents' behaviors without requiring direct observation.
problem Understanding and interacting effectively with other agents in reinforcement learning.
method Extracts representations from local observations of the controlled agent using encoder-decoder architectures.
result The method achieves higher returns than baseline methods in multi-agent environments.
Modeling and learning turn-taking behaviors in multi-agent systems.
problem Modeling and predicting turn-taking behaviors in dynamic multi-agent systems.
method Individual behavior models (WFSTs) and multi-agent fusion model (logistic regression classifier).
result Accurately models and predicts turn-taking behaviors with high precision.
Interactive agent modeling by learning to probe improves understanding of other agents' behaviors.
problem Understanding and predicting the behaviors of other agents in interactive scenarios.
method An interactive agent modeling scheme enabled by encouraging the agent to learn to probe, combining imitation learning and curiosity-driven reinforcement learning.
result The agent model learned by the proposed approach generalizes better and enhances performance in multiple applications.
Agents need world models to generalize multi-step tasks.
problem The necessity of world models for flexible, goal-directed behavior.
method Formal analysis and demonstration of the necessity of world models for agents to generalize multi-step tasks.
result World models are necessary for agents to generalize to multi-step goal-directed tasks.
RFM models predict multi-agent behavior, offering insights and faster learning.
problem Understanding and improving multi-agent systems learning.
method Relational Forward Models (RFM) that learn to predict future agent behavior.
result RFM modules inside agents lead to faster learning compared to baseline methods.
This paper proposes using variational autoencoders to model opponents in multi-agent systems.
problem Understanding and interacting with opponents in multi-agent systems.
method Variational autoencoders for opponent modeling, with a modification to use local information.
result Our opponent modeling methods achieve equal or greater episodic returns.
A financial market model uses spin variables to represent and predict agent behavior.
problem Predicting and understanding financial market behavior.
method Agent-based model with Potts model interpretation, focusing on spin variables representing opinions and actions.
result Model accurately predicts market behavior and statistical properties of financial returns.
Reduced models derived from agent-based systems using Koopman theory.
problem Time-consuming simulations of large agent-based systems.
method Koopman operator theory applied to simulation data.
result Derived reduced models match known analytical results.
Many learning agents impact a financial market model, showing complex dynamics.
problem Understanding the dynamics of financial markets with multiple learning agents.
method Agent-based model of financial market with multiple reinforcement learning agents interacting.
result Inclusion of learning agents changes market dynamics to match empirical data.
Study improves online learning with adaptable agents in various settings.
problem Learning with improving agents in online settings.
method Extensive analysis of combinatorial dimensions, multiclass setup, bandit feedback, and agent cost.
result Characterization and analysis of online learnability in the model.
A simple learning agent learns to trade in an agent-based market model.
problem Optimal execution of trades in an agent-based financial market model.
method Asynchronous trading through a matching engine, varying initial order sizes and state spaces, calibration of empirical stylized facts and price impact curves.
result Smaller state space agents converge faster in learning and can trade intuitively using spread and volume states.
In mix-game which is an extension of minority game, there are two groups of agents; group1 plays the majority game, but the group2 plays the minority game. This paper studies the change of the average winnings of agents and volatilities vs. the change of mixture of agents in mix-game model. It finds that the correlatio…
A novel framework uses goal-conditioned reinforcement learning to generate diverse samples.
problem Generating high-quality, diverse samples from generative models.
method Two agents: GC-agent learns to reconstruct the training set, S-agent learns to imitate GC-agent without knowing the goals.
result Empirically, the method generates diverse and high-quality samples in image synthesis.
Novel approach models opponent learning dynamics in multi-agent reinforcement learning.
problem Adaptation and learning of other agents in multi-agent settings cause non-stationarity, challenging existing algorithms.
method Develops a novel approach called Learning to Model Opponent Learning (LeMOL) to accurately model opponent learning dynamics.
result Structured opponent model is more accurate and stable than naive baselines.
Modeling ToM in multi-agent games using adaptive feedback control.
problem Understanding how agents predict and model other agents' mental states in complex interactions.
method Embodied and situated agent models based on distributed adaptive control theory.
result Probabilistic learning agents outperform pure reinforcement-based strategies in game-theoretic tasks.
We present an effective technique for training deep learning agents capable of negotiating on a set of clauses in a contract agreement using a simple communication protocol. We use Multi Agent Reinforcement Learning to train both agents simultaneously as they negotiate with each other in the training environment. We al…
Study models crypto markets using multi-agent reinforcement learning.
problem Emulating crypto market dynamics and behaviors.
method Multi-agent reinforcement learning (MARL) with RL techniques.
result Model accurately emulates crypto market microstructure and behaviors.
New model simulates stock market microstructure with learning agents.
problem Lack of realistic agent learning in past financial models.
method Designed a next-generation MAS stock market simulator with model-free reinforcement learning.
result Model can faithfully reproduce market microstructure metrics.
MagNet uses neural networks to predict multi-agent dynamics from observations.
problem Predicting the evolution of complex multi-agent systems.
method Formulated a coupled non-linear network with ODE-based state evolution, trained a neural network to discover dynamics from observations.
result Orders of magnitude improvement in prediction accuracy over traditional models.
Agent-based modeling is a powerful simulation technique to understand the collective behavior and microscopic interaction in complex financial systems. Recently, the concept for determining the key parameters of the agent-based models from empirical data instead of setting them artificially was suggested. We first revi…
Agents learn social skills from each other, improving performance.
problem Independent RL agents fail to use social learning.
method Imposed constraints, model-based auxiliary loss, mixed training.
result Agents trained with social learning outperform solo-trained agents.
Agents learn to cooperate by exchanging messages in a shared graph model.
problem Creating effective multi-agent cooperation in unknown environments.
method Shared agent-entity graph, multi-agent reinforcement learning, invariant to team size and permutation.
result Decentralized multi-agent systems can quickly transfer learned policies to different team sizes.
The study classifies and imitates trading agents in financial markets.
problem Classifying and imitating trading agents in continuous double auctions.
method Developed an agent-based model for trading, applied opponent modeling for classification, and used behavioral cloning for imitation.
result Techniques for classification and imitation were experimentally compared and evaluated.
This paper uses a path integral approach to model complex economic systems with many agents.
problem Modeling economic systems with a large number of interacting agents.
method Develops a path integral formalism to describe the behavior of a large number of agents in an economic system.
result The method provides an analytical treatment of business cycle models with many agents, revealing various phases and interactions.
RL agents outperform baselines in asset allocation.
problem Optimizing asset allocation using reinforcement learning.
method Model-free deep RL agents trained on real-world stock prices.
result RL agents significantly outperformed random and uniform allocation.
Proposes a model for multi-agent reinforcement learning with hierarchical graph attention network.
problem Limited transferability of trained policies to new multi-agent tasks.
method Uses hierarchical graph attention network for representation learning and multi-agent actor-critic for policy learning.
result Demonstrates superior performance in mixed cooperative and competitive tasks compared to existing methods.
RD-Agent(Q) automates quantitative finance research and development.
problem Challenges in asset return prediction due to high dimensionality and volatility.
method Data-centric multi-agent framework for automated research and development of quantitative strategies.
result Up to 2X higher annualized returns with 70% fewer factors.
We are looking for the agent-based treatment of the financial markets considering necessity to build bridges between microscopic, agent based, and macroscopic, phenomenological modeling. The acknowledgment that agent-based modeling framework, which may provide qualitative and quantitative understanding of the financial…
Develops methods to create consistent surrogate models for agent-based simulators.
problem High computational costs and misjudgment of interventions in agent-based models.
method Causal abstractions to learn interventionally consistent surrogate models.
result Surrogates trained for interventional consistency closely mimic the agent-based model's behavior under interventions.
We formulate and analyze a multi-agent model for the evolution of individual and systemic risk in which the local agents interact with each other through a central agent who, in turn, is influenced by the mean field of the local agents. The central agent is stabilized by a bistable potential, the only stabilizing force…
Model shows speculative trading agents create price bubbles with increasing risk of crash.
problem Speculative trading and price bubbles creation.
method Agent-based modeling with adaptive stock-to-bond ratios and risk levels.
result Persistent price bubbles and growing risk of crash.
Study uses AI agents to improve equity portfolio management.
problem Improving stock selection and portfolio management efficiency.
method Role-based multi-agent systems for equity research.
result Multi-agent approach outperforms benchmarks in stock selection.
This paper introduces stylized facts and agent-based modeling in finance.
problem Replicating stylized facts in financial markets.
method Agent-based computational economic market models.
result Introduction of universal building blocks for agent-based models.
A computational theory reduces agent evaluation errors and speeds up processes.
problem Efficient evaluation of mini agents at reduced cost.
method Developed a computational theory and a meta-learner to handle heterogeneous agents.
result Reduced evaluation errors by 24.1% to 99.0% across various scenarios.
Efficiently models agent dependencies in large social networks.
problem Challenges in incorporating inter-agent dependencies in social reinforcement learning models.
method Clusters users based on payoff and contribution, combines cluster-level policies with personalized agent-level policies, and uses dynamic clustering.
result Our approach learns more accurate policy estimates and converges more quickly than existing methods.
Study proposes a multi-agent system using LLMs for REIT trading, outperforming benchmarks.
problem Low-volatility Chinese REIT market, low risk-adjusted returns.
method Multi-agent framework with four types of agents, prediction model pathways, fine-tuning.
result Multi-agent strategies outperform buy-and-hold in terms of return, Sharpe ratio, and drawdown.
Market equilibrium price proven in a large-agent model.
problem Proving market equilibrium in a large-agent setting.
method Proved existence of equilibrium price in a complete, continuous time market with infinite agents.
result The equilibrium price dynamics decouple as the number of agents increases.
New bounds on predicting agent behavior from behavior alone.
problem Predicting agent beliefs and intentions from observed behavior.
method Derivation of bounds on agent behavior in new environments under assumption of world model.
result Theoretical limits on predicting intentional agents from behavioral data.
New snooping attacks exploit deep RL without access to environment.
problem Security vulnerabilities in deep reinforcement learning.
method Proposes snooping threat models and attacks on RL agents.
result Adversaries can launch attacks without interacting with the environment.
Black-box attacks on RL agents using temporal information.
problem Vulnerability of RL agents to adversarial samples.
method Sequence-to-sequence models for predicting future actions.
result Adversarial samples can trigger RL agents to misbehave after a delay.
PRECOG predicts future interactions between AVs and other drivers.
problem Autonomous vehicles need to predict human drivers' intentions for safe road behavior.
method Probabilistic forecasting model trained on real and simulated data.
result Our model predicts future interactions more accurately than existing methods.
This paper considers a statistical signal processing problem involving agent based models of financial markets which at a micro-level are driven by socially aware and risk- averse trading agents. These agents trade (buy or sell) stocks by exploiting information about the decisions of previous agents (social learning) v…
Neural networks improve scalability for agent-based modeling demonstrations.
problem Scalability issues in training models of dynamic systems from demonstrations.
method Use of neural networks to reduce the search space for agent-level parameters.
result More scalable architecture for reproducing emergent behavior from demonstrations.
A multi-agent system improves crypto portfolio management by processing diverse data types.
problem Managing cryptocurrency portfolios requires processing various data types under high volatility.
method A multi-agent system with three specialized agents for market dynamics, news sentiment, and signal fusion.
result The best configuration, Hierarchical (Skill), achieved a 133.52% cumulative return and 1.502 Sharpe ratio.
TradingAgents uses LLM-powered multi-agent framework for financial trading.
problem Lack of collaborative dynamics in multi-agent financial trading systems.
method Inspired by real-world trading firms, TradingAgents features specialized LLM-powered agents and a risk management team.
result Framework outperforms baseline models in trading performance metrics.
AGENTICAITA uses AI agents to autonomously trade markets without human intervention.
problem Inability of traditional trading systems to adapt to market complexity.
method Introduces an agentic AI framework with specialized LLM agents reasoning, negotiating, and acting.
result Demonstrated operational correctness and non-trivial inter-agent negotiation in live market conditions.
PettingZoo library accelerates multi-agent reinforcement learning research.
problem Challenges in multi-agent reinforcement learning, especially conceptual models of games.
method Developed PettingZoo library with AEC games model to address multi-agent reinforcement learning challenges.
result AEC games model addresses conceptual issues in multi-agent reinforcement learning environments.
Complex behaviors are often driven by an internal model, which integrates sensory information over time and facilitates long-term planning. Inferring an agent's internal model is a crucial ingredient in social interactions (theory of mind), for imitation learning, and for interpreting neural activities of behaving agen…