Paper uses RL to optimize bid-ask spreads for diverse options.
problem Optimizing bid-ask spreads for options with various maturities and strikes.
method Combines stochastic policy with reinforcement learning.
result Proposes an effective approach for market making of options.
Modeling option market making with hedging-induced price impact.
problem Tackles the challenge of market making in options markets with price impact.
method Models option order flow using Cox processes and studies the dynamics of inventory and price under hedging-induced impact.
result Establishes the well-posedness of the mixed control problem involving quoting and hedging.
Paper offers a simpler solution for managing complex financial options.
problem Managing a large number of financial assets with diverse dynamics.
method Developed a simple analytical approximation for market making.
result Shows significant flexibility over existing market making strategies.
Paper analyzes liquidity for everlasting options in DeFi, offering strategies to reduce costs.
problem Challenges of perpetual derivatives in decentralized finance markets.
method Dynamic proactive market maker model, simulations, hedging strategies.
result Liquidity providers can achieve net positive PnL with effective strategies.
Unified market making controls risk, arbitrage, and volatility surfaces.
problem Market making risk, arbitrage, and volatility surface consistency.
method Constrained RL and stochastic control for risk-sensitive execution and hedging.
result Agent achieves positive P&L with zero calendar and butterfly violations.
Market maker optimizes SPX and VIX spread using quadratic rough Heston model.
problem Maximizing profit from SPX and VIX spread while managing inventory risk.
method Uses quadratic rough Heston model to optimize multi-asset market making problem, approximating high-dimensional optimization.
result Asymptotic closed-form solution for optimization problem.
In this article, we tackle the problem of a market maker in charge of a book of options on a single liquid underlying asset. By using an approximation of the portfolio in terms of its vega, we show that the seemingly high-dimensional stochastic optimal control problem of an option market maker is in fact tractable. Mor…
Investigates optimal strategies for market makers using internal liquidity.
problem Optimizing strategies for market makers with internal liquidity.
method Investigates optimal multi-objective strategy for market makers with internal liquidity.
result Draws important qualitative insights for real-world trading.
In this paper, we employ the Heston stochastic volatility model to describe the stock's volatility and apply the model to derive and analyze the optimal trading strategies for dealers in a security market. We also extend our study to option market making for options written on stocks in the presence of stochastic volat…
Paper explores MM strategies that can refuse to quote or provide single-sided quotes.
problem Overcoming risks in market making due to changing market conditions.
method Adversarial reinforcement learning with new MM agent designs.
result Refusal to quote or providing single-sided quotes can improve MM performance.
The paper develops a new framework for pricing and hedging liquidity in crypto markets.
problem Arbitrage and risk management in crypto market making.
method Developed a new mathematical framework using a coordinate system defined by price and intrinsic liquidity.
result Established a linear dependence of asset reserves and value functions on intrinsic liquidity, facilitating arbitrage-free pricing and delta hedging.
Deep RL controller outperforms market making benchmarks in a Hawkes process model.
problem Optimal market making in financial markets.
method Deep reinforcement learning on a Hawkes process-based simulator.
result Deep RL controller outperforms benchmarks in various risk-reward metrics.
Proposes a deep RL approach for high-frequency market making using tick data and periodic signals.
problem Challenges in high-frequency market making due to tick-level data complexity and high trading volume.
method Integrates tick-level data with periodic signals using deep reinforcement learning.
result The proposed framework outperforms existing methods in profitability and risk management.
Paper introduces robust market making using Wasserstein distance and entropy regularization.
problem Market making robustness under uncertainty.
method Wasserstein distance, entropy regularization, convex optimization, optimal radius selection.
result The robust market making problem can be reformulated as a convex optimization problem.
Study optimizes market making in Chinese stock market with stochastic control and scenario analysis.
problem Limited research on market making in Chinese stock market.
method Optimal market making framework with exponential CARA utility function, accounting for market conditions and risks.
result Impact of volatility and stamp duty on market maker's profit and liquidity.
A Deep Q-Learning framework tackles market-making by incorporating closing auctions.
problem Managing end-of-day risk in market-making models.
method Developed a Deep Q-Learning framework that anticipates closing auctions and continuously refines projected clearing prices.
result The Deep Q-Learning framework outperforms classical market-making models in simulations and real data.
A new macroscopic market making model connects market making and optimal execution.
problem Connecting market making and optimal execution problems.
method Using continuous processes for orders, the model bridges the gap between market making and optimal execution.
result Demonstrates the model's effectiveness through various noise and intensity function scenarios.
Optimized execution model using interbank and internal liquidity.
problem Minimizing market impact in trading.
method Integrates interbank limit and market orders with internal market-making liquidity.
result Reduces market impact and improves execution efficiency.
Automated market-making for CBDCs and stable coins on blockchain.
problem Creating fair exchange rates for digital assets on blockchain.
method Developed an innovative approach for generating fair exchange rates.
result Illustrated the approach's efficacy on G-10 currency exchange rates.
Paper proposes a new reinforcement learning framework for cryptocurrency market making.
problem Improving profit and stability in cryptocurrency market making.
method Event-based reinforcement learning environment, training two policy-based agents with neural networks and various reward functions.
result Improved profit and stability demonstrated over time-based approach.
A new high-frequency market making strategy using Deep Hawkes process.
problem Optimizing high-frequency trading in volatile markets.
method Developed a Deep Hawkes process to model order arrivals and their effects on the limit order book.
result The new strategy outperforms traditional methods in market making.
Optimal market making strategy for electronic markets with persistent order flows.
problem Market making on electronic markets with persistent order flows.
method Formulated as a stochastic control problem, characterized by viscosity solutions, and implemented numerically.
result Characterization of an optimal market making strategy.
This thesis applies RL to market making in China's commodity market.
problem Leverage RL for market making in China's commodity market.
method Developed an automatic trading system using RL.
result RL is feasible for market making in China's commodity market.
Market making is one of the most important aspects of algorithmic trading, and it has been studied quite extensively from a theoretical point of view. The practical implementation of so-called "optimal strategies" however suffers from the failure of most order book models to faithfully reproduce the behaviour of real m…
ARL and Hawkes processes improve market-making strategies with variable volatility.
problem Enhancing market-making strategies to adapt to varying volatility levels and self-exciting behaviors.
method Integrates ARL, Hawkes processes, and variable volatility levels; shifts from Poisson to Hawkes process.
result 4-action MM trained in low-volatility environment adapts to high-volatility conditions, providing stable performance.
A dealer manages quotes and rejection rules to control slippage risk in FX markets.
problem Managing inventory risk and latency risk in OTC FX market making.
method Dynamic programming and adiabatic-quadratic approximation to optimize quotes and rejection rules.
result Developed a method to optimize quotes and rejection rules for managing slippage risk.
Deep Q-Learning optimizes market making by balancing price risk and spread profits.
problem Optimizing liquidity provision in financial markets.
method Reinforcement Learning applied to a market making problem with a reward function.
result Deep Q-Learning algorithms can recover the optimal market making strategy.
Modeling precious metals market making using nested Ornstein-Uhlenbeck processes.
problem Navigating liquidity provided by futures contracts in spot precious metals.
method Nested Ornstein-Uhlenbeck process for EFP spread modeling, Hamilton-Jacobi-Bellman equation approximation.
result Maximizing expected P&L while minimizing inventory risk in near real-time.
Paper uses RL for market making, improving stability in non-stationary markets.
problem Optimizing market making strategies in non-stationary limit order book dynamics.
method Reinforcement Learning (Proximal-Policy Optimization) applied to a simulator.
result RL agent outperforms closed-form optimal solution in non-stationary markets.
In most OTC markets, a small number of market makers provide liquidity to other market participants. More precisely, for a list of assets, they set prices at which they agree to buy and sell. Market makers face therefore an interesting optimization problem: they need to choose bid and ask prices for making money while …
The paper extends macroscopic market making to stochastic games, revealing properties and solving equations.
problem Price competition among market makers in a stochastic game setting.
method Extension of macroscopic market making framework to stochastic games, introducing multidimensional characteristic equations.
result New well-posedness results for forward-backward stochastic differential equations.
Maker-taker fees can prevent algorithmic cooperation in market making, but not always.
problem Unexpected cooperation among independent algorithms in market making.
method Modeling market making as a repeated game, experimental analysis of transaction costs and rebates.
result Maker-taker fee models can destabilize cooperation, but not always with a specific relationship between costs and rebates.
Paper uses reinforcement learning to optimize bid-ask spreads in OTC markets.
problem Optimizing bid-ask spreads in over-the-counter markets with dynamic order sizes.
method Reinforcement learning to solve high-dimensional stochastic control problem.
result Optimal bid-ask spreads follow a Gaussian distribution under certain conditions.
A learning algorithm achieves logarithmic regret in a market making model.
problem Learning the price sensitivity parameter in a market making model.
method Maximum-likelihood estimator with regularization, based on HJB equation.
result Regret upper bound of order ln^2 T in expectation.
This paper offers a framework for FX dealers to decide between internalizing and externalizing their market making to balance risk control and costs.
problem FX dealers face risk from flow uncertainty and need to decide on internalization vs. externalization strategies.
method Develops an optimal control framework that balances pricing and hedging strategies.
result Provides insights into the trade-off between risk control and transaction costs in market making.
This paper introduces a new market making approach using scaled beta distributions.
problem Inventory management challenges faced by market makers.
method Scaled beta distribution policies for flexible market making actions.
result Flexibility in volume distribution across price intervals improves market making performance.
Paper analyzes constant-product market making protocols.
problem Understanding and optimizing constant-product market making.
method Mathematical analysis of trade splitting and fee recompounding.
result Splitting trades does not affect final exchange rate.
Paper uses SAC RL to optimize market-making strategies.
problem Optimizing market-making strategies with risk management.
method Applying SAC reinforcement learning to automate market-making decisions.
result Agent learns to optimize spreads and hedge trades.
In this paper, reinforcement learning is applied to the problem of optimizing market making. A multi-agent reinforcement learning framework is used to optimally place limit orders that lead to successful trades. The framework consists of two agents. The macro-agent optimizes on making the decision to buy, sell, or hold…
Optimal market making strategy with price forecasts reduces inventory costs and spreads.
problem Optimal market making strategy with price forecasts reduces inventory costs and spreads.
method Modeling market making strategy with linear price impact, random slope and intercept, and simultaneous order arrivals.
result Simultaneous order arrivals and price forecasts reduce inventory costs and spreads.
Study bond market making with hit-ratio target using optimal control and HJB equations.
problem Optimizing bond market making with hit-ratio target in OTC markets.
method Stochastic optimal control approach, dualizing hit-ratio target, HJB equation, Riccati equation, linearization.
result Explicit quote decompositions into riskless spread, inventory-risk correction, and hit-ratio correction.
Develops RL for optimal market-making in non-Markov processes.
problem Optimal market-making in non-Markov price processes.
method Deep reinforcement learning with Soft Actor-Critic (SAC) algorithm.
result Optimal strategy for market-making in semi-Markov and Hawkes Jump-Diffusion dynamics.
Market making is a fundamental trading problem in which an agent provides liquidity by continually offering to buy and sell a security. The problem is challenging due to inventory risk, the risk of accumulating an unfavourable position and ultimately losing money. In this paper, we develop a high-fidelity simulation of…
The paper analyzes RL in high-frequency market making with theoretical and practical implications.
problem Applying RL to high-frequency market making with theoretical rigor.
method Theoretical analysis bridging RL and financial economics, focusing on sampling frequency effects.
result An interesting tradeoff between error and complexity in RL algorithms as sampling frequency decreases.
Model analyzes OTC market making with reputation feedback.
problem Optimizing electronic OTC liquidity provision considering reputation.
method Developed a stochastic-control model with feedback loops.
result Policy alternates between reputation-building and franchise monetization phases.
Model analyzes how reputation feedback affects OTC market making.
problem Understanding and optimizing OTC market making strategies.
method Developed a stochastic-control model with feedback loops.
result Policy alternates between reputation building and franchise monetization.
Study shows market makers can cooperate without communication.
problem Concerns of collusion in AI-driven market-making.
method Formulated as a repeated game, studied with Q-learning.
result Market makers can learn cooperative strategies without communication.
This paper uses deep RL to optimize market quotes from LOB data.
problem Optimizing quotes for market making from complex LOB data.
method Attn-LOB neural network with convolutional filters and attention mechanism for feature extraction; hybrid reward function for continuous action space.
result The RL agent outperforms traditional methods in market making tasks.