Bayesian Parametric Portfolio Policies corrects overestimation of utility and risk in traditional PPP.
problem Traditional Parametric Portfolio Policies ignore policy risk, leading to overestimation of expected utility and understatement of portfolio risk.
method Developed Bayesian Parametric Portfolio Policies (BPPP) by placing a prior on policy coefficients to correct the decision rule.
result BPPP delivers higher Sharpe ratios, lower turnover, larger investor welfare, and lower tail risk compared to traditional PPP.
RL learns to ignore factors in factor investing portfolios.
problem Combining factor investing and reinforcement learning for optimal portfolio allocation.
method RL agent learns through sequential allocations based on firms' characteristics using Dirichlet distributions.
result RL-based portfolios are very close to equally-weighted allocations, indicating agnostic factor learning.
AI models outperform simple rules in cross-asset futures timing, especially with lower transaction costs.
problem Optimizing cross-asset portfolio weights using traditional forecasting and optimization methods.
method End-to-end AI policies that map market states directly to portfolio weights, trained on CME futures using a differentiable Sharpe ratio loss function.
result Transformer-based AI policies outperform simple rules and equal weighting, trading less and matching or exceeding equal weighting through moderate transaction costs.
Develops a Bayesian framework for portfolio choice with a new posterior distribution.
problem Estimation risk in parametric portfolio policies.
method Generalized Bayesian framework with Gibbs posterior, utility maximization, and KNEEDLE algorithm.
result Optimal scaling parameter λ controls the balance between prior and data. Study finds strict collection policies improve portfolio quality of microfinance banks.
problem Improving portfolio quality of microfinance banks through better credit collection policies.
method Multi-stage sampling, regression analysis, descriptive statistics.
result Collection policy has a higher effect on portfolio quality.
Paper introduces a new method for risk-sensitive investment management using RL.
problem Risk-sensitive portfolio management with unknown model parameters.
method Combines RL and risk-sensitive stochastic control with Gaussian perturbations for exploration.
result Endogenous relative-entropy regularization and optimal investment strategy derived.
Investors benefit from long horizons in a market with mean-reverting equity returns.
problem Optimal portfolio choice in a market with mean-reverting risk-free rate and equity risk-premium.
method Mean-variance optimization, Euler-Lagrange equation, Calculus of Variations, spectral problem.
result Optimal policies are characterized by eigenvalues of the lambda-matrix, leading to better risk-return trade-offs for long-term investors.
Study optimizes portfolio allocation policies using off-policy data and constraints.
problem Optimizing portfolio allocation policies under constraints using off-policy data.
method Solves a minimax objective with off-policy estimators and online learning to control constraint violations.
result Constructs near-optimal allocation policies for various regimes of operation and constraints.
Non-parametric bootstrap improves robust portfolio and trading strategy optimization.
problem Mitigating uncertainty in expected returns and covariances in financial decision-making.
method Non-parametric bootstrap framework for robust optimization without distributional assumptions.
result Improved out-of-sample performance with smoother, more stable results.
Unified approach to Merton's portfolio problem using Pontryagin's principles.
problem Optimizing consumption and investment strategies in financial portfolios.
method PG-DPO framework combining neural networks with Pontryagin's maximum principle.
result Locally optimal policies closely tied to classical stochastic control.
We consider an investor, whose portfolio consists of a single risky asset and a risk free asset, who wants to maximize his expected utility of the portfolio subject to the Value at Risk assuming a heavy tail distribution of the stock prices return. We use Markov Decision Process and dynamic programming principle to get…
Investors target specific regions of payoff distributions for portfolio optimization.
problem Optimizing portfolio performance across different return distribution regions.
method Developed a dynamic portfolio-choice framework targeting downside or upside quantiles.
result Policies focused on downside regions provide stronger left-tail protection and higher Sharpe ratios.
This paper uses deep reinforcement learning to optimize stock portfolios considering transaction costs and risks.
problem Optimizing stock portfolios with transaction costs and risks.
method Formulated stock portfolio optimization as a reinforcement learning problem, applied DDPG, GDPG, and PPO algorithms, and used Wavelet Transform.
result DDPG and GDPG algorithms outperformed PPO in continuous action space.
A scalable framework optimizes multi-asset portfolios with constraints.
problem Optimizing multi-asset portfolios with inequality constraints.
method Integrates neural policies with Pontryagin's Maximum Principle, enforcing feasibility via log-barrier regularization.
result Recover KKT-optimal policies in high-dimensional problems without violating constraints.
Researchers quantify risk exposure and sensitivities in financial markets under model uncertainty.
problem Optimizing investment and pricing under model uncertainty in financial markets.
method Distributionally robust optimization, Wasserstein ball, first-order sensitivity analysis.
result Sensitivities of value function, investment policy, and marginal prices to model uncertainty can be non-monotonic.
New approach to portfolio optimization shows entropy regularization is ineffective.
problem Entropy regularization in mean-variance portfolio optimization under drift uncertainty.
method Combining Bayesian filtering and stochastic policy optimization.
result Entropy regularization does not accelerate learning about unknown drift.
Developed an explainable DRL model for financial portfolio management.
problem Inability of DRL agents to provide interpretable financial investment policies.
method Integrating PPO with feature importance techniques (SHAP, LIME) to enhance transparency.
result Ability to interpret DRL agent actions in prediction time.
Paper uses RL to optimize multi-asset portfolios in fluctuating markets.
problem Optimizing multi-asset portfolios in time-varying financial markets.
method Soft Actor-Critic (SAC) algorithm for policy learning, policy iteration process.
result SAC algorithm outperforms in various criteria in simulated and real financial markets.
Bayesian Markowitz portfolio problem shows entropy regularization is ineffective.
problem Entropy regularization in Bayesian Markowitz portfolio optimization.
method Combines continuous-time Bayesian filtering with stochastic policy optimization.
result Entropy regularization does not accelerate learning of unknown drift.
Develops a new framework for joint portfolio risk forecasting.
problem Joint portfolio risk forecasting, especially for Value-at-Risk and Expected Shortfall.
method Semi-parametric multivariate framework with dynamic conditional correlation modeling.
result The proposed model outperforms existing approaches in risk forecasting.
Large deviations theory applied to policy gradient methods.
problem Understanding convergence of policy gradient methods in reinforcement learning.
method Large deviation rate function and contraction principle from large deviations theory.
result Convergence properties of policy gradient methods can be extended to various policy parametrizations.
MetaTrader combines diverse expert strategies to optimize portfolio performance.
problem Optimizing portfolio performance in changing financial markets.
method Two-stage RL approach: imitation learning followed by a meta-policy.
result MetaTrader significantly outperforms state-of-the-art baselines in balancing profits and risks.
Bayesian investor learns unknown asset drift, trades mean-variance optimal portfolio, but policy is robust to observation model distortion.
problem Bayesian portfolio selection with observation model distortion
method Robust Bayesian portfolio selection
result Robust policy and its price are closed form, with price of robustness half the variance of the non-robust investor's loss.
The paper solves multi-period portfolio selection with constraints using a dynamic factor model.
problem Multi-period mean-variance portfolio selection with constraints.
method Dynamic factor model, dynamic programming, piecewise linear feedback policy.
result Optimal portfolio policies determined by two stochastic processes.
Work establishes conditions for bias-free policy optimization.
problem Improving policy optimization methods without introducing bias.
method Established conditions for parametric critic without bias.
result Identified bias in current policy optimization algorithms.
The paper presents a framework for optimizing crypto-currency portfolios using generative models.
problem Optimizing crypto-currency portfolios using generative models.
method The approach involves evaluating diverse pairings of generative model forecasts and objective functions, using simulations and blending strategies.
result Eclectic blended portfolios outperform individual generative model-based portfolios.
Paper uses DRL to optimize portfolios, balancing risk and return.
problem Optimizing portfolios under market uncertainty and risk constraints.
method Integrates Sharpe ratio-based reward with risk control mechanisms, uses PPO for adaptive asset allocation.
result DRL agent stabilizes volatility but sacrifices risk-adjusted returns.
A new method calculates risk loadings in classification ratemaking without subjective parameters.
problem Subjective risk loading parameters in classification ratemaking.
method Bootstrap method to calculate total risk premium, then determine risk loading parameters using quantile regression models.
result Risk premiums calculated by the new method reasonably differentiate different risk classes.
A new model optimizes portfolios by accounting for dynamic market conditions.
problem Static models fail to capture asymmetry, heavy tails, and time-varying dependencies.
method Semiparametric dynamic copula model integrating non-parametric copulas and parametric marginals.
result Dynamic market conditions improve portfolio performance and risk management.
Optimizes stock portfolios with profit, risk, and sustainability.
problem Balancing profit, risk, and sustainability in stock portfolio management.
method Developed a novel utility function combining Sharpe ratio and ESG scores; used genetic algorithm for optimization.
result System outperforms traditional reinforcement learning methods and improves on risk and sustainability metrics.
We consider off-policy evaluation and optimization with continuous action spaces. We focus on observational data where the data collection policy is unknown and needs to be estimated. We take a semi-parametric approach where the value function takes a known parametric form in the treatment, but we are agnostic on how i…
The discrete-time mean-variance portfolio selection formulation, a representative of general dynamic mean-risk portfolio selection problems, does not satisfy time consistency in efficiency (TCIE) in general, i.e., a truncated pre-committed efficient policy may become inefficient when considering the corresponding trunc…
Empirical study shows Randomized Signature Methods improve portfolio optimization in financial markets.
problem Drift estimation in non-linear, non-parametric financial markets is challenging.
method Applied Randomized Signature Methods for non-linear, non-parametric drift estimation in multi-variate financial markets.
result Randomized Signature Methods provide features on the same scale and improve portfolio optimization in real-world settings.
In this paper, we generalize the parametric delta-VaR method from portfolios with normally distributed risk factors to portfolios with elliptically distributed ones. We treat both the expected shortfall and the Value-at-Risk of such portfolios. Special attention is given to the particular case of a multivariate t-distr…
When we implement a portfolio selection methodology under a mean-risk formulation, it is essential to correctly model investors' risk aversion which may be time-dependent, or even state-dependent during the investment procedure. In this paper, we propose a behavior risk aversion model, which is a piecewise linear funct…
Naive investors make riskier choices than optimal strategies in continuous-time finance.
problem Continuous-time Markowitz portfolio selection with naive reoptimization.
method Analytical derivation of naive policies from discretely naive policies.
result Naive policies are always riskier and less efficient than equilibrium policies.
Study evaluates policies in partially observable environments without full model specification.
problem Evaluating policies in partially observable environments without full model specification.
method Developed non-parametric identification and recursive fitted-Q-evaluation algorithm.
result Established finite-sample error bounds for policy value estimation.
In this paper, we generalize the parametric Delta-VaR methods from portfolios with elliptic distributed risk factors to portfolios with mixture of elliptically distributed ones. We treat both the Expected Shortfall and the Value-at-Risk of such portfolios. Special attention is given to the particular case of the mixtur…
Optimistic actor-critic tackles linear MDPs with parametric policies.
problem Theoretical limitations of existing actor-critic methods for linear MDPs.
method Proposes an optimistic actor-critic framework with parametric log-linear policies and approximate Thompson sampling.
result Achieves state-of-the-art sample complexity in both on-policy and off-policy settings.
In this work, we consider the problem of estimating a behaviour policy for use in Off-Policy Policy Evaluation (OPE) when the true behaviour policy is unknown. Via a series of empirical studies, we demonstrate how accurate OPE is strongly dependent on the calibration of estimated behaviour policy models: how precisely …
Paper presents a new framework for optimal asset and signal combination.
problem Optimal asset and signal combination problem.
method Two-stage approach: reformulate dynamic portfolio selection problem, then use Canonical Correlation Analysis.
result Improved performance of proposed method over natural benchmarks.
A deep learning strategy outperforms traditional methods in stocks portfolio management.
problem Optimizing stock portfolio performance using machine learning.
method Deep Deterministic Policy Gradient framework with neural networks.
result Compound annual return rate of 14.12% compared to 7 other strategies.
Paper proposes a policy-search algorithm to learn entropy-maximizing exploration policies in reward-free environments.
problem Reward-free learning in high-dimensional, continuous-control domains.
method Maximum Entropy POLicy optimization (MEPOL) algorithm that maximizes a non-parametric state entropy estimate.
result MEPOL learns a maximum-entropy exploration policy that facilitates learning various reward-based tasks.
Hybrid model combines risk measures for better portfolio allocation.
problem Optimizing portfolios with various risk measures.
method Mean-variance hybrid model combining spectral risk measure and quantile optimization.
result Hybrid model outperforms classical mean-variance model in risk allocation.
Proposes a new framework to optimize portfolios with reduced estimation errors.
problem Estimation errors in multiperiod mean-variance portfolio optimization.
method Reference-regulated multiperiod mean-variance (RRMV) framework.
result Improves portfolio stability and out-of-sample Sharpe ratios.
We consider the problem of seeking an optimal set of model points associated to a fixed portfolio of life insurance policies. Such an optimal set is characterized by minimizing a certain risk functional, which gauges the average discrepancy with the fixed portfolio in terms of the fluctuation of the interest rate term …
Paper uses SAC and DDPG to optimize cryptocurrency portfolios.
problem Adapting to volatile and nonlinear cryptocurrency markets.
method Reinforcement learning with SAC and DDPG algorithms.
result SAC and DDPG outperform traditional strategies in cryptocurrency markets.
New framework optimizes multi-asset portfolio choice for high dimensions.
problem Optimizing high-dimensional continuous-time portfolio choice.
method Combines Pontryagin's Maximum Principle with BPTT for neural network policy learning.
result Achieves near-optimal policies with improved efficiency and precision.