Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

82165247329 · Jun 202019922001200920172026
48 results for Policy Risk

Risk-controlled post-processing optimizes decision policies under risk constraints.

problem Optimizing decision policies with risk constraints for better outcomes.
method Developed a post-processing algorithm that selects a threshold based on fitted fallback policy and score, leveraging tools from algorithmic stability and stochastic processes.
result The post-processed policy achieves precise expected risk control under exchangeability and meets or nearly meets risk budgets while preserving more agreement with the baseline.

Paper develops NPG for risk-averse RL with ECRMs, proving global convergence.

problem Ensuring reliable performance in stochastic RL problems with risk-averse policies.
method Developed natural policy gradient updates for ECRMs-based RL problems, proving global optimality and iteration complexity.
result Global convergence of risk-averse NPG algorithm with ECRMs.

Bayesian Parametric Portfolio Policies corrects overestimation of utility and risk in traditional PPP.

problem Traditional Parametric Portfolio Policies ignore policy risk, leading to overestimation of expected utility and understatement of portfolio risk.
method Developed Bayesian Parametric Portfolio Policies (BPPP) by placing a prior on policy coefficients to correct the decision rule.
result BPPP delivers higher Sharpe ratios, lower turnover, larger investor welfare, and lower tail risk compared to traditional PPP.

Unified framework for risk-aware policy learning in contextual bandits.

problem Optimizing decision rules in high-stakes domains with adverse outcomes.
method Distributional framework for Lipschitz-continuous risk functionals, with novel empirical concentration inequalities.
result Data-dependent suboptimality bounds with an ildeO(1/n) ilde{\mathcal{O}}(1/\sqrt{n}) rate, matching risk-neutral offline policy optimization.

New policy optimizes risk and optimality in stochastic bandits.

problem Optimizing risk in stochastic bandits with heavy-tailed risk.
method Designing policies with worst-case optimality for expected regret and light-tailed risk distribution.
result Achieves worst-case optimality for expected regret and light-tailed risk distribution.

Develops RL for dynamic risk assessment in stochastic optimization.

problem Time-consistent risk assessment in stochastic optimization problems.
method Model-free reinforcement learning with dynamic convex risk measures, time-consistent dynamic programming, policy gradient updates, actor-critic neural network optimization.
result Demonstrates optimal policies for statistical arbitrage, financial hedging, and robot control.

New estimator reduces risk in slate bandits by leveraging Bayes risk criterion.

problem Evaluating slate policies using logged data when policies factorize over slots.
method Developed a new estimator using a control variate approach, showing risk improvement over existing methods.
result The new estimator has lower risk than the pseudoinverse estimator in slate bandit problems.

Improves pre-trial risk assessments by making them safer without changing existing rules.

problem Improving pre-trial risk assessments while maintaining deterministic rules.
method Developed a maximin robust optimization approach to find a safer policy.
result Can safely improve certain components of the risk assessment instrument.

Several authors have recently developed risk-sensitive policy gradient methods that augment the standard expected cost minimization problem with a measure of variability in cost. These studies have focused on specific risk-measures, such as the variance or conditional value at risk (CVaR). In this work, we extend the p…

2015-02-13abs ↗pdf ↗

New algorithm for risk-sensitive reinforcement learning with natural policy gradients.

problem Risk-sensitive reinforcement learning with downside risk constraints.
method Introduce a new Bellman equation to estimate the lower partial moment of returns, use natural policy gradients, and extend Reward Constrained Policy Optimization.
result Sample-efficient estimation of partial moments and effective risk-sensitive control.

Paper proposes a new DRL algorithm optimizing Spectral Risk Measures for better risk management.

problem Inconsistencies and conservatism in existing risk measures in DRL.
method Optimizes a broader class of static Spectral Risk Measures (SRM) in DRL.
result Demonstrates improved performance over existing risk-neutral and risk-sensitive DRL models.

The objective in a traditional reinforcement learning (RL) problem is to find a policy that optimizes the expected value of a performance metric such as the infinite-horizon cumulative discounted or long-run average cost/reward. In practice, optimizing the expected value alone may not be satisfactory, in that it may be…

2018-10-22abs ↗pdf ↗

Study risk-sensitive reinforcement learning with entropic risk measures and generative models.

problem Risk-sensitive reinforcement learning in discounted MDPs with recursive entropic risk measures.
method Introduced Model-Based ERM QQ-Value Iteration (MB-RS-QVI) and derived PAC bounds on sample complexity for value and policy learning.
result PAC bounds show exponential dependence on β/(1γ)|β|/(1-γ), with tight bounds in SS and AA.

Study shows economic policy uncertainty increases stock market crash risk during pandemic.

problem Impact of economic policy uncertainty on stock market crashes during the pandemic.
method Used GARCH-S model to estimate daily skewness as a proxy for crash risk, analyzed data from US stock market.
result Significantly negative correlation between economic policy uncertainty and stock market crash risk, stronger during pandemic.

This work tackles risk-sensitive deep RL by optimizing policies with variance constraints.

problem Risk and aleatoric uncertainty in deep reinforcement learning.
method Lagrangian and Fenchel dualities to transform the problem into an unconstrained saddle-point policy optimization problem, and an actor-critic algorithm to iteratively update policy, Lagrange multiplier, and Fenchel dual variable.
result The proposed actor-critic algorithm finds a globally optimal policy at a sublinear rate.

The paper studies risk-sensitive MDPs with recursive risk measures.

problem Risk-sensitive decision-making in MDPs with unbounded costs.
method Recursive application of static risk measures, Bellman equation derivation, existence of optimal policies.
result Existence of Markovian optimal policies for infinite planning horizons, contractive model for stationary optimal policy.

VaR-CPO optimizes VaR-constrained RL problems with conservative policy updates.

problem Optimizing VaR-constrained reinforcement learning problems.
method Combines Cantelli's inequality and trust-region framework for efficient and conservative optimization.
result Achieves zero constraint violations during training in feasible environments.

A risk-aware RL approach using RDEU and Wasserstein ball for robust performance.

problem Optimizing risk-aware performance criteria in uncertain environments.
method Rank dependent expected utility (RDEU) for risk assessment, Wasserstein ball for robustness, actor/agent framework.
result Explicit policy gradient formulae for robust optimization.

Study optimizes natural resource harvesting under model uncertainty using risk measures.

problem Optimal harvesting policy selection for natural resources under model uncertainty.
method Investigated using neoclassical growth model dynamics and convex risk measures, specifically Fréchet risk measures.
result Robust harvesting strategies quantifying operational and marginal risk under model uncertainty.

This paper extends risk parity to continuous-time, solving risk budgeting problems.

problem Achieving robust risk across different assets in continuous-time.
method Characterizing risk contributions and solving risk budgeting problems using continuous-time terminal variance.
result Risk contributions and risk budgets can be represented as predictable processes in continuous-time.

The paper tackles catastrophic risk in reinforcement learning using extreme value theory.

problem Mitigating catastrophic risk in sequential decision making with limited observations.
method Developed POTPG, a policy gradient algorithm based on extreme value theory.
result POTPG outperforms common benchmarks in numerical experiments.

Develops neural network framework for risk-reward optimization problems.

problem Multi-period risk-reward optimization with constrained policies.
method Neural network framework with two coupled feedforward networks, parametrizing two-step policies.
result Empirical optimum converges to true optimal value as network capacity and training size increase.

Optimizes regret distribution in stochastic bandits for risk balance.

problem Balancing regret expectation and tail risk in stochastic bandits.
method Characterizes optimal regret tail probability for any threshold, proposes new policies.
result Discovers an intrinsic gap in optimal tail rate based on time horizon uncertainty.

ESRL uses uncertainty quantification to learn safe, optimal policies in offline RL.

problem Challenges in interpreting and measuring uncertainty of learned policies in offline RL.
method Expert-Supervised Reinforcement Learning (ESRL) framework that uses hypothesis testing and posterior distributions.
result The framework can learn safe and optimal policies with theoretical guarantees and independent sample efficiency.

Canary optimizes VaR-constrained RL problems with a conservative bound using Cantelli's inequality.

problem Optimizing reinforcement learning policies under VaR constraints in dense cost regimes.
method Employing Cantelli's inequality to create a conservative and smooth bound on VaR constraints based on moments of cost returns. Extending trust-region framework for worst-case bounds on policy improvement and constraint violation.
result Canary reliably satisfies VaR constraints with fewest violations and earliest permanent satisfaction, while maintaining reward competitiveness.

Paper tackles optimal policy learning with observational data in multi-action scenarios.

problem Optimal policy learning in multi-action settings with observational data.
method Review of estimation approaches, analysis of risk preference, discussion of potential failures.
result Average regret of a policy with multi-valued treatment is contingent on the decision-maker's attitude towards risk.

Study risk-sensitive market making with entropy regularization for better quote control.

problem Risk-sensitive market making with exponential utility and penalties.
method Entropy-regularized certainty-equivalent Bellman policies for discrete-time market dynamics.
result Proves convergence and performance bounds for entropy-regularized policies.

Paper uses DRL to optimize portfolios, balancing risk and return.

problem Optimizing portfolios under market uncertainty and risk constraints.
method Integrates Sharpe ratio-based reward with risk control mechanisms, uses PPO for adaptive asset allocation.
result DRL agent stabilizes volatility but sacrifices risk-adjusted returns.

We develop a framework for interacting with uncertain environments in reinforcement learning (RL) by leveraging preferences in the form of utility functions. We claim that there is value in considering different risk measures during learning. In this framework, the preference for risk can be tuned by variation of the p…

2019-06-14abs ↗pdf ↗

Deep RL solves dynamic risk pricing for complex financial models.

problem Dynamic risk measures in financial derivatives pricing.
method Deterministic actor-critic deep reinforcement learning (ACRL) for time-consistent expectile risk.
result High-quality hedging policies and prices for complex financial instruments.

Default risk significantly affects the corporate policies of a firm. We develop a model in which a limited liability entity subject to Poisson default shock jointly sets its dividend policy and capital structure to maximize the expected lifetime utility from consumption of risk averse equity investors. We give a comple…

2018-10-08abs ↗pdf ↗