Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

2.3%4.5%6.8%9.1% · Jun 201919922001200920172026
48 results for policy vulnerability

New method defends RL agents from poisoning attacks without MDP knowledge.

problem Poisoning attacks on RL systems can cause learning failures.
method Generic poisoning framework for online RL, Vulnerability-Aware Adversarial Critic Poison (VA2C-P).
result Successfully prevents RL agents from learning good policies or converging to target policies.

Minimalistic attacks reveal deep RL policies' vulnerabilities with little perturbation.

problem Tackling the vulnerability of deep reinforcement learning policies to minimal perturbations.
method Three key settings: black-box policy access, fractional-state adversary, and tactically-chanced attack. Formulated adversarial attacks on six Atari games.
result Deep RL policies can be significantly fooled by minimal perturbations, even in 0.01% of the input state.

Machine learning classifiers are known to be vulnerable to inputs maliciously constructed by adversaries to force misclassification. Such adversarial examples have been extensively studied in the context of computer vision applications. In this work, we show adversarial attacks are also effective when targeting neural …

2017-02-08abs ↗pdf ↗

Study on adversarial training's impact on deep neural reinforcement learning policies.

problem Vulnerability of deep neural reinforcement learning policies to imperceptible adversarial perturbations.
method Two parallel approaches: Fourier spectrum analysis and feature sensitivity measurement.
result Adversarially trained policies are more sensitive to low frequency perturbations.

Preschool attendance correlates with lower developmental vulnerabilities in Queensland, Australia.

problem Understanding the relationship between preschool attendance and developmental vulnerabilities in different regions.
method Data Analysis and Machine Learning to identify clusters of socio-demographic variables.
result Identified three clusters with varying socio-demographic variables affecting the relationship between preschool attendance and developmental vulnerabilities.

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep reinforcement learning (DRL) agents and can be exploited by an adversary with access to…

2019-03-01abs ↗pdf ↗

New split rules improve subpopulation targeting in policy-making.

problem Improving binary classification for subpopulation targeting in policy-making.
method MDFS, PFS, wEFS for maximizing distance and penalizing final splits.
result Proposed methods target more vulnerable subpopulations than classic CART/KD-CART.

Analyzes valuation of derivative claims with asymmetric funding costs and WWR.

problem Valuing and hedging derivative claims with bilateral cash flows in asymmetric funding and risk environments.
method Characterizes pre-default claim value as solution to a non-linear Cauchy problem, applies stochastic representation under linear funding policy.
result Derivative claim value can be represented as a portfolio of European options and admits an analytical formula involving elementary functions and Gaussian integrals.

Survival analysis models predict economic convergence across Americas.

problem Analyzing GDP per capita trajectories and convergence across the Americas.
method Survival analysis, machine learning, economic interpretation.
result DeepSurv captures non-linear interactions in GDP per capita trajectories.

Paper proposes MCTSPO for better reinforcement learning policy optimization.

problem Local optima and saddle points in gradient-based methods and poor initialization in gradient-free methods.
method Monte-Carlo tree search combined with gradient-free optimization.
result Improved performance on reinforcement learning tasks with deceptive or sparse reward functions.

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another agent's observations. This might lead one to wonder: is it possible to attack an R…

2019-05-25abs ↗pdf ↗

Deep RL policies are vulnerable to adversarial perturbations, but vanilla training yields more robust policies.

problem Vulnerability of deep reinforcement learning policies to adversarial perturbations.
method Analysis of deep reinforcement learning policy landscape and comparison of vanilla vs. adversarial training.
result Vanilla training yields more robust policies compared to adversarial training.

Face recognition systems are vulnerable to composite face reconstruction attacks.

problem Vulnerability of face recognition systems to composite face reconstruction attacks.
method Assumed attacker uses composite face parts to reconstruct faces faster and more efficiently.
result Current face recognition systems are extremely vulnerable to random search attacks.

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance compared to model-free counterparts. In addition, they are typically based on the…

2019-06-25abs ↗pdf ↗

This paper analyzes how banking risks spread through sentiment and policy shocks.

problem Systemic risk in the U.S. banking system during the 2023 crisis.
method Time-Varying Parameter Vector Autoregression (TVP-VAR) model with 30-day rolling windows.
result Risk spillovers were driven by perceived similarities in bank business models under interest rate pressure.

A new framework for offline RL improves policy flexibility and regularity.

problem Lack of environmental interactions in offline RL leads to poor policy performance.
method Proposes a behavior-regularized implicit policy framework with modified policy-matching methods.
result The framework improves policy effectiveness and robustness beyond static datasets.

The policy objective of safeguarding financial stability has stimulated a wave of research on systemic risk analytics, yet it still faces challenges in measurability. This paper models systemic risk by tapping into expert knowledge of financial supervisors. We decompose systemic risk into a number of interconnected seg…

2014-12-17abs ↗pdf ↗

This paper investigates a class of attacks targeting the confidentiality aspect of security in Deep Reinforcement Learning (DRL) policies. Recent research have established the vulnerability of supervised machine learning models (e.g., classifiers) to model extraction attacks. Such attacks leverage the loosely-restricte…

2019-06-03abs ↗pdf ↗

Model for optimal cybersecurity investment considering clustered cyberattacks.

problem Optimal investment in cybersecurity to reduce system vulnerability under clustered cyberattacks.
method Developed a continuous-time stochastic model using a Hawkes process, extended Gordon-Loeb model, solved as a Markovian stochastic optimal control problem.
result Investment policies that account for attack clustering lead to more effective and responsive strategies, improving upon static and Poisson-based approaches.

Reinforcement learning (RL) has advanced greatly in the past few years with the employment of effective deep neural networks (DNNs) on the policy networks. With the great effectiveness came serious vulnerability issues with DNNs that small adversarial perturbations on the input can change the output of the network. Sev…

2018-05-31abs ↗pdf ↗

This paper proposes non-stationary factor models for financial stress in the UK.

problem Managing financial vulnerabilities in the UK's complex financial system.
method Creation of non-stationary factor models to capture financial stress.
result Non-stationary factor models can better capture financial stress, especially tail events.

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far have been designed using heuristics, and build on existing adversarial example crafting techniques …

2019-07-31abs ↗pdf ↗

The 2008 financial crisis revealed banking consolidation paradoxically increased systemic fragility and global financial contagion with negligible spatial decay.

problem Fundamental vulnerabilities in interconnected banking systems during the 2008 financial crisis were inadequately addressed by existing frameworks.
method Developed a unified spatial-network framework using spectral analysis of network Laplacian operators combined with spatial difference-in-differences identification.
result Banking consolidation paradoxically increased systemic fragility and global financial contagion with negligible spatial decay.

Optimal policies identified for learning systems with a malicious expert.

problem Adversarial attacks on learning systems combining expert advice.
method Analysis of offline and online settings, dynamic programming for online setting.
result Greedy policy is asymptotically optimal with approximation ratio for offline setting.

New method optimizes ambiguity sets for robust MDPs, improving policy robustness.

problem Sensitivity of optimal policies to model misspecification in MDPs.
method Proposes a new approach to optimize the shape of ambiguity sets, departing from norm-bounded uniform and symmetric sets.
result Empirical results show practical promise of weighted near-optimal ambiguity sets.

New method improves DRL robustness against adversarial state observations.

problem Adversarial attacks on deep reinforcement learning agents observing state data.
method State-adversarial Markov decision process (SA-MDP) and policy regularization.
result Significant improvement in robustness of DRL algorithms under adversarial attacks.

Optimizes control interventions in real-world networks using deep-learning and network science.

problem Optimizing control over socioeconomic networks subject to constraints.
method Integrates optimization tools from deep-learning with network science.
result Characterizes vulnerability of corporate networks to takeovers.

Despite the remarkable performance of deep neural networks on various computer vision tasks, they are known to be susceptible to adversarial perturbations, which makes it challenging to deploy them in real-world safety-critical applications. In this paper, we conjecture that the leading cause of adversarial vulnerabili…

2019-08-12abs ↗pdf ↗

A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of disparate vulnerability against MIAs: unequal success rate of MIAs against diff…

2019-06-02abs ↗pdf ↗

Study examines Trump's crypto influence on markets, revealing conflicts and vulnerabilities.

problem Presidential power and cryptocurrency markets during Trump's second term.
method Mixed-methods approach combining quantitative and qualitative data.
result Political-linked digital assets became a distinct class with systemic vulnerabilities.

Study cyber-attacks on RL algorithms, focusing on cost signal manipulation.

problem Adversarial manipulation of cost signals in reinforcement learning.
method Quantitative analysis of TD(λλ) and QQ-learning algorithms under manipulation.
result Bound on approximation error for TD(λλ) and convergence properties for QQ-learning under stealthy attacks.

Single autoregressive model outperforms ensemble methods in offline reinforcement learning.

problem Offline reinforcement learning with limited data and model errors.
method Infer system dynamics from data and optimize policies on model rollouts, using a single autoregressive model.
result Single autoregressive model achieves better performance than ensembles on the D4RL benchmark.

New risk measures assess cryptocurrency market vulnerabilities during financial distress.

problem Capturing systemic risk in cryptocurrency markets during financial distress.
method Introducing Vulnerability Conditional Risk Measures (VCoES) and related measures.
result Validated theoretical insights and demonstrated practical relevance in cryptocurrency market.

Paper introduces a simulator-free approach to reinforcement learning policy distillation.

problem Learning multiplicity of cases corresponding to a given action in reinforcement learning.
method Generative adversarial approach to find multiple exemplars for each output class.
result Improves over state-of-the-art on data-free learning of student networks.

Study on measuring vulnerability of neural network parameters via corruption.

problem Understanding the robustness and generalization of deep neural networks.
method Proposes an indicator to measure parameter robustness via parameter corruption and provides a gradient-based estimation.
result Demonstrates the effectiveness of the proposed indicator and training method in improving parameter robustness and accuracy.

Emerging economies use countercyclical policies to manage crises and dominant currencies.

problem Managing economic crises and fluctuations in dominant currencies like USD and EUR.
method Theoretical analysis, case studies, econometric modeling.
result Emerging economies can stabilize growth with countercyclical monetary policies.