Adversarial attacks can manipulate deep trading policies, compromising their performance.
problem Adversarial attacks can compromise deep reinforcement learning trading policies.
method Developed a threat model and proposed two attack techniques.
result Demonstrated the effectiveness of adversarial attacks against DQN trading agents.
This study shows how trade policy uncertainty affects stock-T bill correlations.
problem The impact of trade policy uncertainty on stock-T bill relationships.
method Extended Dynamic Conditional Correlation (DCC) framework incorporating exogenous variables.
result Trade policy uncertainty significantly alters stock-T bill correlations, especially under specific political conditions.
Paper proposes a novel policy distillation method for better order execution in noisy markets.
problem Effective order execution in noisy and imperfect market conditions.
method Policy distillation method to guide reinforcement learning towards optimal trading strategies.
result Significant improvements over various baselines in order execution.
Paper adds a restart mechanism to a drawdown control policy for better trading performance.
problem Missed profitable opportunities when drawdown limit is close to reality.
method Integrates a data-driven restart mechanism into the drawdown modulation trading system.
result The restart mechanism improves trading performance even with transaction costs.
There are few papers about the international trade of flowers, so it is believed that this paper, with this topic, could be an important contribution to the international scientific community. It is intended to analyze if the international trade flowers tendencies and policies are adapted to the actual world global con…
End-to-end policy learning improves statistical arbitrage trading.
problem Traditional mean reversion trading strategies in statistical arbitrage are limited.
method We use Autoencoder architectures and policy learning to develop trading strategies.
result End-to-end training yields superior gross returns.
Unified pair trading approach using hierarchical reinforcement learning.
problem Decoupling pair selection and trading leads to limited performance.
method Hierarchical reinforcement learning framework for joint pair selection and trading.
result Unified approach outperforms existing methods on real-world stock data.
New trading policies preserve robust gains in presence of transaction costs.
problem Maintaining robust gains in asset trading with transaction costs.
method Proposed double linear trading policies, analyzed with Monte Carlo simulations and historical data.
result Desired robust positive expected gain can be preserved under certain conditions.
Enhances pairs trading with neural networks and Kalman Filters.
problem Inaccurate linear models in pairs trading lead to suboptimal performance.
method Augments Kalman Filter with Neural Networks to improve financial indicator extraction.
result Empirically shows improved trading performance compared to benchmarks.
Unified LLM-agent with RL improves financial trading performance.
problem LLMs struggle with complex, multi-step financial tasks.
method Fusion of LLMs and gradient-based RL for policy optimization.
result Improves LLM performance in trading and other financial tasks.
Bayesian framework improves trading robustness against market shifts.
problem Insufficient robustness and overfitting in trading models.
method Bayesian Robust Framework integrating macro-conditioned GAN and adversarial learning.
result Framework outperforms state-of-the-art models in diverse financial instruments.
A new trading system learns to minimize risk and maximize returns in real markets.
problem Optimizing trading strategies under risk constraints in financial markets.
method Direct Reinforcement Learning with Conditional Value-at-Risk as the risk measure.
result The proposed algorithm outperforms traditional methods in real-world financial markets, demonstrating robustness and profitability.
We study the optimal trading policies for a wind energy producer who aims to sell the future production in the open forward, spot, intraday and adjustment markets, and who has access to imperfect dynamically updated forecasts of the future production. We construct a stochastic model for the forecast evolution and deter…
This work models market regimes using CTMSTOU and simulates trading policies.
problem Defining and understanding market regimes in finance.
method Discrete event time multi-agent market simulation with CTMSTOU model.
result Illustrates the importance of regime-awareness in trading policies.
Paper introduces a trading agent using LLMs for risk assessment and trading recommendations.
problem Developing a trading agent that can handle financial risks effectively.
method Extending CPPO algorithm with LLM-generated risk assessment and trading signals from financial news.
result Backtesting shows improved performance of the trading agent compared to benchmarks.
Optimizes trading policies using future price forecasts.
problem Static reinforcement learning agents lack mechanisms for using price forecasts at inference time.
method FPILOT framework inspired by Model Predictive Control (MPC). Uses a predictive model to construct an allocation-based imagined return objective at each decision step.
result Consistent improvements in total return and risk-adjusted metrics across various policy learning algorithms.
The interdependent nature of the global economy has become stronger with increases in international trade and investment. We propose a new model to reconstruct the international trade network and associated cost network by maximizing entropy based on local information about inward and outward trade. We show that the tr…
Paper uses RL to optimize bid-ask spreads for diverse options.
problem Optimizing bid-ask spreads for options with various maturities and strikes.
method Combines stochastic policy with reinforcement learning.
result Proposes an effective approach for market making of options.
Three approaches learn personalized treatment policies for UTI patients.
problem Learning optimal treatment policies in multiobjective settings with fully observed outcomes.
method Indirect and direct approaches using predictive models and without intermediate models.
result All approaches outperform clinicians in achieving better performance on all outcomes and trade-offs.
AI algorithms outperform traditional trading methods in stock markets.
problem Traditional trading methods struggle with risk management and edge over classical approaches.
method Used Deep Reinforcement Learning (DRL) algorithms (DDQN and PPO) to compare with Buy and Hold benchmark.
result DRL algorithms provide a substantial edge over classical approaches in terms of risk-adjusted returns.
Optimizes trading strategy considering alpha decay and transaction costs.
problem Maximizing reward in a multi-period portfolio with transaction costs and alpha decay.
method Formulated as an infinite horizon Markov Decision Process, solved using a modified value iteration algorithm with convergence proof and asymptotic analysis.
result Characterized optimal trading policy that maximizes average expected reward.
Paper optimizes financial trading strategies under uncertain market conditions.
problem Guaranteeing robust positive expected profits in financial systems.
method Transformed semi-infinite constraints into structured policies and proposed a novel graphical approach.
result Demonstrated superior risk-adjusted returns and downside risk compared to conventional strategies.
Bayesian investor learns unknown asset drift, trades mean-variance optimal portfolio, but policy is robust to observation model distortion.
problem Bayesian portfolio selection with observation model distortion
method Robust Bayesian portfolio selection
result Robust policy and its price are closed form, with price of robustness half the variance of the non-robust investor's loss.
This paper identifies drift Lipschitz budget K as key to diffusion policy expressivity and statistical trade-offs.
problem Understanding and maximizing the expressivity of diffusion policies while managing statistical limitations.
method Identifying drift Lipschitz budget K as central, quantifying expressivity and statistical behavior, proving lower bounds, and providing practical implementation guidelines.
result Balancing expressivity and statistical complexity yields a finite-sample performance gap, with rates depending on sample size and drift type.
Deep reinforcement learning boosts commodities trading performance.
problem Improving algorithmic trading performance in commodities markets.
method Formulated as a stochastic dynamical system, employed actor-based and actor-critic-based policy gradient algorithms with CNN and LSTM function approximators.
result DRL models increase Sharpe ratio by 83% compared to buy-and-hold.
Recent policy optimization approaches (Schulman et al., 2015a; 2017) have achieved substantial empirical successes by constructing new proxy optimization objectives. These proxy objectives allow stable and low variance policy learning, but require small policy updates to ensure that the proxy objective remains an accur…
TT-DAC-PS: A deterministic actor-critic approach for optimal trade execution
problem Optimal execution of large stock sell programs
method Twin-Target Deterministic Actor-Critic with Policy Smoothing
result Reduces mean implementation shortfall percentage
A great variety of off-policy learning algorithms exist in the literature, and new breakthroughs in this area continue to be made, improving theoretical understanding and yielding state-of-the-art reinforcement learning algorithms. In this paper, we take a unifying view of this space of algorithms, and consider their t…
Novel trading strategy for generalized lattice markets ensures positive profits.
problem Trading in markets with serially correlated returns and asset correlation.
method Multi-double linear policies in a generalized lattice market model.
result Proposed policies ensure positive expected profits in a lattice market.
Study evaluates reinforcement learning for trading diverse stocks, finds Q-learning outperforms.
problem Evaluating reinforcement learning for trading diverse stocks.
method Implemented Value Iteration (VI), State-action-reward-state-action (SARSA), and Q-Learning on a diverse stock portfolio dataset.
result Q-learning performs better than VI and SARSA during testing, but performance varies based on market conditions.
Develops a new trading strategy for statistical arbitrage with path-dependent signals.
problem Optimal execution in statistical arbitrage strategies with dynamic predictive signals.
method Signature-based framework modeling alpha and trading speed as linear functionals of truncated signature of market path.
result Fitted policy achieves higher return on turnover compared to a z-score benchmark.
This paper analyzes the dynamic incentives for technology adoption under a transferable permits system, which allows for strategic trading on the permit market. Initially, firms can invest both in low-emitting production technologies and trade permits. In the model, technology adoption and allowance price are generated…
Paper finds optimal selling rule for pairs trading with stock constraints.
problem Identifying the best time to sell in pairs trading of stocks.
method Optimal pairs-trading selling rule with constraints on trading.
result Closed-form solution for optimal policy determined by a threshold curve.
VRER selectively reuses past observations to reduce variance in policy optimization.
problem Lack of effective experience replay for accelerating policy optimization in complex systems.
method Variance Reduction Experience Replay (VRER) framework that selectively reuses informative samples.
result VRER reduces gradient variance and improves policy learning over state-of-the-art algorithms.
AI-driven tax policies improve economic equality and productivity.
problem Lack of appropriate economic data and limited opportunity to experiment.
method Two-level deep reinforcement learning approach to learn dynamic tax policies from observational data.
result AI-driven tax policies improve the trade-off between equality and productivity by 16%.
This article examines arbitrage investment in a mispriced asset when the mispricing follows the Ornstein-Uhlenbeck process and a credit-constrained investor maximizes a generalization of the Kelly criterion. The optimal differentiable and threshold policies are derived. The optimal differentiable policy is linear with …
Study uses xLSTM in DRL for better stock trading performance.
problem Limited performance of LSTM in dynamic stock trading environments.
method Combines xLSTM in actor and critic components with PPO optimization.
result xLSTM-based model outperforms LSTM in trading metrics.
FlowHFT learns adaptive trading strategies from multiple models for diverse market conditions.
problem Traditional HFT models are limited by specific market conditions and cannot adapt to dynamic markets.
method FlowHFT uses flow matching policy to learn from multiple expert models and adapt to various market scenarios.
result FlowHFT consistently outperforms individual expert models in multiple market conditions.
Discriminatory trade liberalization policies are becoming more popular among world economies. Countries are motivated to enter for regional trade agreements to capture faster economic growth for alleviating poverty. In developing economies like most of the member countries of the Association of South East Asian Nations…
Enhances cryptocurrency pair trading with DRL, outperforming classical methods.
problem Rigidity and divergence risks in traditional pair trading strategies in crypto markets.
method Hierarchical pair selection, Fixed Risk, Adaptive Mean execution model, PPO with LSTM.
result DRL outperformed heuristic baseline by a statistically significant margin.
MetaTrader combines diverse expert strategies to optimize portfolio performance.
problem Optimizing portfolio performance in changing financial markets.
method Two-stage RL approach: imitation learning followed by a meta-policy.
result MetaTrader significantly outperforms state-of-the-art baselines in balancing profits and risks.
Proposes a method to learn policies from offline data with reduced bias.
problem Learning policies from offline data with reduced bias and complexity constraints.
method Cross-fitted debiasing device for policy learning from offline data.
result Achieves N \sqrt N N regret for complex policy classes with a product-of-errors nuisance remainder. Study model selection in batch policy optimization with three error sources.
problem Learn a policy competitive with the best model class in batch policy optimization.
method Formalized in contextual bandit setting with linear model classes, addressing approximation error, statistical complexity, and dataset shift.
result No algorithm can optimally trade-off all three error sources, but relaxing any one enables near-oracle inequalities for the others.
JaxMARL-HFT accelerates MARL for HFT with 240x speedup.
problem Heavy computational cost in MARL for HFT.
method GPU-accelerated JAX framework for multi-agent RL.
result Agents learn to outperform benchmarks in HFT.
Deep RL learns optimal trading strategies.
problem Optimizing trading strategies using deep reinforcement learning.
method Deep deterministic policy gradient algorithm applied to simple trading environments.
result Deep RL can recover optimal trading strategies and achieve close-to-optimal rewards.
Study aims to optimize financial investments by balancing risk and reward efficiently.
problem Balancing risk and reward in dynamic financial investments.
method Proposes a reinforcement learning method to maximize expected quadratic utility, focusing on first and second moments of rewards.
result The proposed method yields MV-efficient policies that maximize expected reward without increasing variance.
This paper combines RL with CPPI and TIPP for better trading strategies.
problem Challenges in quantitative trading due to swift dynamics and uncertainties.
method Fusion of CPPI and TIPP with MADDPG framework for multi-agent reinforcement learning.
result CPPI-MADDPG and TIPP-MADDPG outperform traditional strategies in real-market shares.
MAP-Elites generates diverse trading strategies for improved execution performance.
problem Optimizing trading execution schedules in volatile market conditions.
method Quality-diversity algorithm (MAP-Elites) generating a portfolio of specialized strategies.
result Diverse strategies achieve 8-10% performance improvements, validating quality-diversity methods.