Deep RL controller outperforms market making benchmarks in a Hawkes process model.
problem Optimal market making in financial markets.
method Deep reinforcement learning on a Hawkes process-based simulator.
result Deep RL controller outperforms benchmarks in various risk-reward metrics.
Proposes a deep RL approach for high-frequency market making using tick data and periodic signals.
problem Challenges in high-frequency market making due to tick-level data complexity and high trading volume.
method Integrates tick-level data with periodic signals using deep reinforcement learning.
result The proposed framework outperforms existing methods in profitability and risk management.
Paper introduces robust market making using Wasserstein distance and entropy regularization.
problem Market making robustness under uncertainty.
method Wasserstein distance, entropy regularization, convex optimization, optimal radius selection.
result The robust market making problem can be reformulated as a convex optimization problem.
Study optimizes market making in Chinese stock market with stochastic control and scenario analysis.
problem Limited research on market making in Chinese stock market.
method Optimal market making framework with exponential CARA utility function, accounting for market conditions and risks.
result Impact of volatility and stamp duty on market maker's profit and liquidity.
A Deep Q-Learning framework tackles market-making by incorporating closing auctions.
problem Managing end-of-day risk in market-making models.
method Developed a Deep Q-Learning framework that anticipates closing auctions and continuously refines projected clearing prices.
result The Deep Q-Learning framework outperforms classical market-making models in simulations and real data.
A new macroscopic market making model connects market making and optimal execution.
problem Connecting market making and optimal execution problems.
method Using continuous processes for orders, the model bridges the gap between market making and optimal execution.
result Demonstrates the model's effectiveness through various noise and intensity function scenarios.
Optimized execution model using interbank and internal liquidity.
problem Minimizing market impact in trading.
method Integrates interbank limit and market orders with internal market-making liquidity.
result Reduces market impact and improves execution efficiency.
Automated market-making for CBDCs and stable coins on blockchain.
problem Creating fair exchange rates for digital assets on blockchain.
method Developed an innovative approach for generating fair exchange rates.
result Illustrated the approach's efficacy on G-10 currency exchange rates.
Paper proposes a new reinforcement learning framework for cryptocurrency market making.
problem Improving profit and stability in cryptocurrency market making.
method Event-based reinforcement learning environment, training two policy-based agents with neural networks and various reward functions.
result Improved profit and stability demonstrated over time-based approach.
A new high-frequency market making strategy using Deep Hawkes process.
problem Optimizing high-frequency trading in volatile markets.
method Developed a Deep Hawkes process to model order arrivals and their effects on the limit order book.
result The new strategy outperforms traditional methods in market making.
Optimal market making strategy for electronic markets with persistent order flows.
problem Market making on electronic markets with persistent order flows.
method Formulated as a stochastic control problem, characterized by viscosity solutions, and implemented numerically.
result Characterization of an optimal market making strategy.
This thesis applies RL to market making in China's commodity market.
problem Leverage RL for market making in China's commodity market.
method Developed an automatic trading system using RL.
result RL is feasible for market making in China's commodity market.
Market making is one of the most important aspects of algorithmic trading, and it has been studied quite extensively from a theoretical point of view. The practical implementation of so-called "optimal strategies" however suffers from the failure of most order book models to faithfully reproduce the behaviour of real m…
ARL and Hawkes processes improve market-making strategies with variable volatility.
problem Enhancing market-making strategies to adapt to varying volatility levels and self-exciting behaviors.
method Integrates ARL, Hawkes processes, and variable volatility levels; shifts from Poisson to Hawkes process.
result 4-action MM trained in low-volatility environment adapts to high-volatility conditions, providing stable performance.
Paper uses RL to optimize bid-ask spreads for diverse options.
problem Optimizing bid-ask spreads for options with various maturities and strikes.
method Combines stochastic policy with reinforcement learning.
result Proposes an effective approach for market making of options.
Deep Q-Learning optimizes market making by balancing price risk and spread profits.
problem Optimizing liquidity provision in financial markets.
method Reinforcement Learning applied to a market making problem with a reward function.
result Deep Q-Learning algorithms can recover the optimal market making strategy.
Modeling precious metals market making using nested Ornstein-Uhlenbeck processes.
problem Navigating liquidity provided by futures contracts in spot precious metals.
method Nested Ornstein-Uhlenbeck process for EFP spread modeling, Hamilton-Jacobi-Bellman equation approximation.
result Maximizing expected P&L while minimizing inventory risk in near real-time.
Paper uses RL for market making, improving stability in non-stationary markets.
problem Optimizing market making strategies in non-stationary limit order book dynamics.
method Reinforcement Learning (Proximal-Policy Optimization) applied to a simulator.
result RL agent outperforms closed-form optimal solution in non-stationary markets.
In most OTC markets, a small number of market makers provide liquidity to other market participants. More precisely, for a list of assets, they set prices at which they agree to buy and sell. Market makers face therefore an interesting optimization problem: they need to choose bid and ask prices for making money while …
The paper extends macroscopic market making to stochastic games, revealing properties and solving equations.
problem Price competition among market makers in a stochastic game setting.
method Extension of macroscopic market making framework to stochastic games, introducing multidimensional characteristic equations.
result New well-posedness results for forward-backward stochastic differential equations.
Maker-taker fees can prevent algorithmic cooperation in market making, but not always.
problem Unexpected cooperation among independent algorithms in market making.
method Modeling market making as a repeated game, experimental analysis of transaction costs and rebates.
result Maker-taker fee models can destabilize cooperation, but not always with a specific relationship between costs and rebates.
Paper uses reinforcement learning to optimize bid-ask spreads in OTC markets.
problem Optimizing bid-ask spreads in over-the-counter markets with dynamic order sizes.
method Reinforcement learning to solve high-dimensional stochastic control problem.
result Optimal bid-ask spreads follow a Gaussian distribution under certain conditions.
A learning algorithm achieves logarithmic regret in a market making model.
problem Learning the price sensitivity parameter in a market making model.
method Maximum-likelihood estimator with regularization, based on HJB equation.
result Regret upper bound of order ln^2 T in expectation.
This paper offers a framework for FX dealers to decide between internalizing and externalizing their market making to balance risk control and costs.
problem FX dealers face risk from flow uncertainty and need to decide on internalization vs. externalization strategies.
method Develops an optimal control framework that balances pricing and hedging strategies.
result Provides insights into the trade-off between risk control and transaction costs in market making.
This paper introduces a new market making approach using scaled beta distributions.
problem Inventory management challenges faced by market makers.
method Scaled beta distribution policies for flexible market making actions.
result Flexibility in volume distribution across price intervals improves market making performance.
Paper analyzes constant-product market making protocols.
problem Understanding and optimizing constant-product market making.
method Mathematical analysis of trade splitting and fee recompounding.
result Splitting trades does not affect final exchange rate.
Modeling option market making with hedging-induced price impact.
problem Tackles the challenge of market making in options markets with price impact.
method Models option order flow using Cox processes and studies the dynamics of inventory and price under hedging-induced impact.
result Establishes the well-posedness of the mixed control problem involving quoting and hedging.
Paper uses SAC RL to optimize market-making strategies.
problem Optimizing market-making strategies with risk management.
method Applying SAC reinforcement learning to automate market-making decisions.
result Agent learns to optimize spreads and hedge trades.
In this paper, reinforcement learning is applied to the problem of optimizing market making. A multi-agent reinforcement learning framework is used to optimally place limit orders that lead to successful trades. The framework consists of two agents. The macro-agent optimizes on making the decision to buy, sell, or hold…
Optimal market making strategy with price forecasts reduces inventory costs and spreads.
problem Optimal market making strategy with price forecasts reduces inventory costs and spreads.
method Modeling market making strategy with linear price impact, random slope and intercept, and simultaneous order arrivals.
result Simultaneous order arrivals and price forecasts reduce inventory costs and spreads.
Study bond market making with hit-ratio target using optimal control and HJB equations.
problem Optimizing bond market making with hit-ratio target in OTC markets.
method Stochastic optimal control approach, dualizing hit-ratio target, HJB equation, Riccati equation, linearization.
result Explicit quote decompositions into riskless spread, inventory-risk correction, and hit-ratio correction.
Develops RL for optimal market-making in non-Markov processes.
problem Optimal market-making in non-Markov price processes.
method Deep reinforcement learning with Soft Actor-Critic (SAC) algorithm.
result Optimal strategy for market-making in semi-Markov and Hawkes Jump-Diffusion dynamics.
Market making is a fundamental trading problem in which an agent provides liquidity by continually offering to buy and sell a security. The problem is challenging due to inventory risk, the risk of accumulating an unfavourable position and ultimately losing money. In this paper, we develop a high-fidelity simulation of…
The paper analyzes RL in high-frequency market making with theoretical and practical implications.
problem Applying RL to high-frequency market making with theoretical rigor.
method Theoretical analysis bridging RL and financial economics, focusing on sampling frequency effects.
result An interesting tradeoff between error and complexity in RL algorithms as sampling frequency decreases.
Model analyzes OTC market making with reputation feedback.
problem Optimizing electronic OTC liquidity provision considering reputation.
method Developed a stochastic-control model with feedback loops.
result Policy alternates between reputation-building and franchise monetization phases.
Model analyzes how reputation feedback affects OTC market making.
problem Understanding and optimizing OTC market making strategies.
method Developed a stochastic-control model with feedback loops.
result Policy alternates between reputation building and franchise monetization.
Study shows market makers can cooperate without communication.
problem Concerns of collusion in AI-driven market-making.
method Formulated as a repeated game, studied with Q-learning.
result Market makers can learn cooperative strategies without communication.
This paper uses deep RL to optimize market quotes from LOB data.
problem Optimizing quotes for market making from complex LOB data.
method Attn-LOB neural network with convolutional filters and attention mechanism for feature extraction; hybrid reward function for continuous action space.
result The RL agent outperforms traditional methods in market making tasks.
Market-maker optimizes quotes based on strategic market-takers' behavior.
problem Optimizing market-making strategies in a strategic trading environment.
method Mean-field game approach to model strategic market-takers and derive optimal controls.
result Derivation of optimal controls for market-maker and market-taker.
Modeling market makers' quoting strategies to understand price impact.
problem Understanding how price impact arises from market makers' quoting strategies.
method Modeling market making as a dynamic auction using Stochastic Differential Games and finding Nash Equilibrium.
result The price impact function derived from market makers' strategies matches the Almgren-Chriss model.
Model shows disclosure reduces trading costs in oligopolistic markets.
problem Reducing trading costs in oligopolistic markets with imperfect competition.
method Developed a multi-period Kyle-type model with mandatory disclosure and imperfect competition, proving existence and uniqueness of a linear equilibrium.
result Disclosure lowers trading costs by reducing price impact, and its marginal benefit is larger when competition is weak.
Adaptive market-making strategy improves profit by adjusting to order flow.
problem Optimizing market-making profits in a dynamic market environment.
method Closed-form solutions for optimal bid-ask spreads, modeling demand randomness, and adapting to market order behavior.
result Adaptive strategies outperform fixed and non-adaptive strategies.
Study shows observing order book can significantly improve online market making performance.
problem Online market making with private valuations and limited feedback.
method Introduces action-dependent feedback model and proposes elimination-based and explore-then-perturb algorithms.
result Achieves O ( T ) O(\sqrt{T}) O ( T ) regret bounds with high probability in various settings. This study examines how market makers balance risk and impact in foreign exchange markets.
problem Balancing risk management with market impact in foreign exchange markets.
method An intermediate scenario approach considering both instantaneous and permanent market impact components.
result Transient market impact is more prevalent than previously thought, challenging traditional market impact models.
Paper offers a simpler solution for managing complex financial options.
problem Managing a large number of financial assets with diverse dynamics.
method Developed a simple analytical approximation for market making.
result Shows significant flexibility over existing market making strategies.
Market maker optimizes SPX and VIX spread using quadratic rough Heston model.
problem Maximizing profit from SPX and VIX spread while managing inventory risk.
method Uses quadratic rough Heston model to optimize multi-asset market making problem, approximating high-dimensional optimization.
result Asymptotic closed-form solution for optimization problem.
IMM uses imitation learning and predictive representation learning to improve market making strategies.
problem Challenges in training RL agents for multi-price level market making strategies.
method IMM combines RL and imitation learning, introducing effective state and action representations and a representation learning unit.
result IMM outperforms existing RL-based market making strategies in financial criteria.
We develop a new market-making model, from the ground up, which is tailored towards high-frequency trading under a limit order book (LOB), based on the well-known classification of order types in market microstructure. Our flexible framework allows arbitrary order volume, price jump, and bid-ask spread distributions as…