Develops a risk-sensitive reinforcement learning framework for uncertain environments.
problem Learning in uncertain environments with varying risk preferences.
method Integrates utility functions and risk measures into reinforcement learning, tuning risk preference with parameter β.
result Risk-averse, risk-neutral, and risk-taking behaviors can be achieved and compared.
Study uses spectral risk for learning with heavy-tailed data.
problem Learning with heavy-tailed loss distributions.
method Spectral risk with Lipschitz-continuous density, derivative-free learning.
result Excess risk guarantees and improved performance over traditional methods.
Machine learning creates non-factor covariance matrices for risk models.
problem Creating robust risk models for financial portfolios.
method Developed an explicit algorithm and source code for machine learning risk models.
result Machine learning models outperform traditional risk models in empirical backtests.
Study on risk measures in reinforcement learning using Monte-Carlo simulations.
problem Lack of satisfactory risk measures in reinforcement learning.
method Generalized approximation scheme based on Monte-Carlo simulations, neural architecture for risk estimation.
result Variance of reward-to-go does not adequately capture risk in reinforcement learning.
Study risk-sensitive reinforcement learning with entropic risk measures and generative models.
problem Risk-sensitive reinforcement learning in discounted MDPs with recursive entropic risk measures.
method Introduced Model-Based ERM Q Q Q -Value Iteration (MB-RS-QVI) and derived PAC bounds on sample complexity for value and policy learning. result PAC bounds show exponential dependence on ∣ β ∣ / ( 1 − γ ) |β|/(1-γ) ∣ β ∣/ ( 1 − γ ) , with tight bounds in S S S and A A A . The paper studies risk-sensitive learning schemes and provides learning bounds for empirical OCE minimizers.
problem Risk-sensitive learning aims to minimize risk-averse measures of loss.
method Proposes learning bounds for empirical OCE minimizers based on Rademacher average and variance.
result Provides two learning bounds on the performance of empirical OCE minimizers.
Study risk-sensitive reinforcement learning with Lipschitz dynamic risk measures, establishing regret bounds.
problem Risk-sensitive reinforcement learning in Markov decision processes.
method Two model-based algorithms for Lipschitz dynamic risk measures, focusing on regret bounds.
result Upper bounds demonstrate optimal dependencies on actions and episodes, reflecting risk sensitivity vs. sample complexity trade-off.
GraphShield uses dynamic graph learning to detect and visualize financial risks.
problem Detecting and mitigating risks in financial networks.
method Enhanced Cross-Domain Information Learning, Advanced Risk Recognition, Risk Propagation Visualization.
result GraphShield effectively identifies and visualizes hidden financial risks.
Develops uniform convergence guarantees for a broad class of risk functionals in supervised learning.
problem Bounding generalization gaps for various risk functionals beyond the expectation.
method Establishes uniform convergence for Hölder risk functionals, providing guarantees for empirical risk minimization.
result First uniform convergence results for estimating the CDF of loss distributions, applicable to various risk functionals.
MVPI framework optimizes risk in reinforcement learning, improving performance in robot simulations.
problem Optimizing risk in reinforcement learning control problems.
method Mean-Variance Policy Iteration (MVPI) framework for risk-averse control in MDPs.
result Risk-averse TD3 outperforms previous methods in robot simulation tasks.
Deep learning improves covariance matrix estimation for better portfolio risk management.
problem Improving the accuracy of covariance matrix estimation for portfolio risk management.
method Formulated as a learning problem, used deep learning to automatically discover risk factors.
result 1.9% higher explained variance and reduced portfolio risk.
Paper analyzes transfer risk in transfer learning for finance.
problem Evaluate transferability of transfer learning in finance.
method Proposes transfer risk concept and applies to stock return prediction and portfolio optimization.
result Transfer risk correlates with transfer learning performance and identifies appropriate source tasks.
DeRisk improves credit risk prediction using deep learning.
problem Challenges in training deep neural networks with real-world financial data.
method DeRisk, an effective deep learning framework for credit risk prediction.
result DeRisk outperforms statistical learning methods in credit risk prediction.
Paper proposes risk-averse reinforcement learning algorithms.
problem Managing model uncertainty in reinforcement learning.
method Entropic risk constrained policy gradient and actor-critic algorithms.
result Demonstrates usefulness of risk-averse algorithms on various domains.
A new method for risk-sensitive reinforcement learning using Spectral Risk Measures.
problem Incorporating risk sensitivity into reinforcement learning algorithms.
method Proposes a novel framework for optimizing Spectral Risk Measures in both online and offline RL algorithms.
result Demonstrates consistent outperformance over existing risk-sensitive methods in various domains.
Paper proposes a new DRL algorithm optimizing Spectral Risk Measures for better risk management.
problem Inconsistencies and conservatism in existing risk measures in DRL.
method Optimizes a broader class of static Spectral Risk Measures (SRM) in DRL.
result Demonstrates improved performance over existing risk-neutral and risk-sensitive DRL models.
Paper uses deep learning for systemic risk measures.
problem Computing optimal capital allocations for systemic risk.
method Deep learning algorithms to solve primal and dual problems.
result Deep learning provides fair risk allocations.
We study risk-sensitive imitation learning where the agent's goal is to perform at least as well as the expert in terms of a risk profile. We first formulate our risk-sensitive imitation learning setting. We consider the generative adversarial approach to imitation learning (GAIL) and derive an optimization problem for…
Unified framework for risk-aware policy learning in contextual bandits.
problem Optimizing decision rules in high-stakes domains with adverse outcomes.
method Distributional framework for Lipschitz-continuous risk functionals, with novel empirical concentration inequalities.
result Data-dependent suboptimality bounds with an i l d e O ( 1 / n ) ilde{\mathcal{O}}(1/\sqrt{n}) i l d e O ( 1/ n ) rate, matching risk-neutral offline policy optimization. Paper proposes efficient method for estimating risk measures in complex models.
problem Accurately estimating distortion risk measures in computationally expensive models.
method Integrates importance sampling and machine learning for efficient Monte Carlo estimation.
result Demonstrates significant reduction in computational cost for estimating risk measures.
Machine learning risks in finance pricing and hedging
problem Understanding and managing risks in financial models
method Analyzing machine learning applications in finance, focusing on pricing and hedging of financial options
result Identifies various sources of risk and potential mitigation strategies
New algorithms avoid non-monotonic risk curves in statistical learning.
problem Non-monotonic behavior of risk curves in statistical learning.
method Derive risk-monotonic algorithms under weak assumptions.
result Risk monotonicity does not necessarily lead to worse excess risk rates.
New algorithms optimize risk in reinforcement learning with exponential utility.
problem Optimizing rewards under risk in reinforcement learning with unknown transition kernels.
method Two model-free algorithms: Risk-Sensitive Value Iteration (RSVI) and Risk-Sensitive Q-learning (RSQ).
result Proved near-optimal regret bounds for RSVI and RSQ.
IRL models human risk decisions based on past outcomes.
problem Understanding human risk decisions under risk.
method Inverse Reinforcement Learning (IRL) with features reflecting state history.
result Human reward function explains risk-prone and risk-averse decisions.
Develops a new method for risk diversification using dynamic risk measures.
problem Dynamic risk diversification in investment portfolios.
method Introduces dynamic risk contributions and a recursive optimization approach for coherent dynamic distortion risk measures.
result Dynamic risk budgeting strategies can be solved using deep learning.
The paper addresses human-like decision-making in multi-agent systems using bounded risk-sensitive Markov Games.
problem Modeling human-like decision-making in multi-agent systems with risk-seeking and loss-aversion behaviors.
method Forward policy design and inverse reward learning with iterative reasoning and cumulative prospect theory.
result The proposed algorithms demonstrate both risk-averse and risk-seeking behaviors in multi-agent systems.
NeuCredit model predicts consumer credit risk using e-commerce data.
problem Predicting consumer credit risk in e-commerce environments.
method Deep learning approach capturing serial dependences and nonlinear interactions.
result Deep learning enhances forecasting performance in e-commerce credit risk.
Risk Advisor predicts and mitigates ML deployment failures.
problem Predicting and mitigating test-time failure risks of ML systems.
method Post-hoc meta-learner for estimating failure risks and uncertainties.
result Reliably predicts deployment-time failure risks across various ML models.
Proposes a new framework for risk-sensitive RL using deep nets.
problem Risk-sensitive reinforcement learning problems.
method Conditional elicitability, scoring functions, deep neural networks.
result Dynamic spectral risk measures can be approximated by deep nets.
Deep Hedging learns optimal strategies for various risk levels.
problem Finding optimal hedging policies for diverse risk aversions.
method Continuous Reinforcement Learning with actor-critic algorithm.
result Demonstrated effectiveness in a stochastic volatility model.
Bayesian Robust Optimization for Imitation Learning (BROIL) balances risk and reward.
problem Learning robust policies for new states in imitation learning.
method Bayesian reward function inference and user-specific risk tolerance.
result BROIL outperforms risk-sensitive and risk-neutral algorithms.
Prove non-asymptotic bounds for minimal risk in statistical learning
problem Estimating minimal risk in statistical learning
method Using concentration inequalities
result Non-asymptotic bounds for minimal risk
Active learning improves RS-IRL by querying expert demonstrations to uncover risk boundaries.
problem Efficient learning from expert demonstrations in risk-sensitive IRL.
method Probabilistic disturbance sampling scheme for active learning.
result Our approach accelerates RS-IRL convergence with lower variance and unbiased results.
ECG signal learning predicts cardiovascular death risk.
problem Scarce positive ECG event examples and class imbalance.
method Multiple instance learning framework for raw ECG signals.
result Learned risk score outperforms existing metrics.
New algorithms for risk management in incomplete markets.
problem Risk management in incomplete markets with various sources of incompleteness.
method Machine-learning-based algorithms to solve hedging problems.
result One algorithm is flexible and can use multiple risk criteria.
Deep Evidence Regression improves credit risk prediction uncertainty.
problem Quantifying uncertainty in credit risk predictions.
method Applying Deep Evidence Regression to credit risk settings.
result Demonstrated improved prediction of Loss Given Default.
Study combines quantum and classical deep learning for better credit risk assessment.
problem Enhancing accuracy and efficiency in credit risk evaluation.
method Hybrid Quantum-Classical Deep Neural Network for Row-Type Dependent Predictive Analysis.
result Proposed framework enhances predictive models for different loan categories.
Generative Adversarial Regression (GAR) learns risk scenarios robustly across policies.
problem Learning risk scenarios for conditional risk objectives.
method Generative adversarial framework for risk matching.
result GAR produces more stable and risk-preserving scenarios than baselines.
A new method for risk-averse decision-making in Markov processes with improved regret bounds.
problem Risk-averse decision-making in Markov processes.
method Introduces mini-batch measures and multipattern risk-averse problems in a feature-based Q Q Q -learning method. result Proves a high-probability regret bound of O ( H 2 N H K ) \mathcal{O}\big(H^2 N^H \sqrt{ K}\big) O ( H 2 N H K ) for the Q Q Q -learning method. Method controls treatment risk in learning beneficial allocations.
problem Learning beneficial treatment allocations with risk control in precision medicine.
method Proposes a certifiable learning method that controls treatment risk with finite samples in the partially identified setting.
result Illustrates method using both simulated and real data.
Risk-aware active learning reduces generalization error.
problem Learning policies with minimal performance risk.
method Risk-aware active inverse reinforcement learning algorithm.
result Risk-aware active learning outperforms standard approaches.
The paper tackles catastrophic risk in reinforcement learning using extreme value theory.
problem Mitigating catastrophic risk in sequential decision making with limited observations.
method Developed POTPG, a policy gradient algorithm based on extreme value theory.
result POTPG outperforms common benchmarks in numerical experiments.
Transfer learning improves portfolio optimization by identifying transfer risk.
problem Financial portfolio optimization problem.
method Introduces transfer risk concept within transfer learning framework.
result Transfer risk is a significant indicator of transferability and enhances portfolio management efficiency.
New method for interpreting financial model risks.
problem Fairly allocating risk in financial models.
method Extending Shapley value framework for axiomatic risk attribution.
result Risk can be well allocated in financial models.
Robo-advisors estimate clients' risk aversion using interactive questionnaires.
problem Estimating risk aversion of non-expert clients using adaptive questionnaires.
method Model risk aversion with cost functions and spectral risk measures. Use inverse reinforcement learning to design questions maximizing distinguishing power.
result Designing questions by maximizing distinguishing power achieves satisfactory accuracy in learning risk aversion with fewer than 50 questions.
A novel model combines deep learning and extreme value theory for multivariate cyber risk prediction.
problem High dimensionality and heavy tails in multivariate cyber risk patterns.
method Combines deep learning for point predictions and extreme value theory for quantile predictions.
result The model provides satisfactory high quantile predictions and accurate point predictions.
Paper optimizes a big data and ML risk monitoring system for financial markets.
problem Traditional risk monitoring methods are inadequate for modern financial markets due to data complexity and volume.
method Four-layer architecture integrating big data and advanced ML algorithms (LSTM, RF, GB).
result Significantly enhances efficiency and accuracy in risk management, especially in market crash risk detection.
Develops a framework for robust RL with dynamic risk measures.
problem Optimal RL strategies depend on risk preferences and model dynamics.
method Dynamic robust distortion risk measures, Wasserstein ball, neural networks, strictly consistent scoring functions, policy gradient formulae, actor-critic algorithm.
result Demonstrates improved performance in portfolio allocation example.