Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

155310465620 · Jun 202019922001200920172026
48 results for deep RL

This paper surveys RL for combinatorial optimization, focusing on TSP.

problem Optimizing solutions for combinatorial optimization problems.
method Reinforcement learning applied to combinatorial optimization problems, specifically the TSP.
result Deep learning mechanisms enhance RL algorithms for near-optimal solutions.

RADIAL-RL improves deep RL agents' robustness against adversarial attacks.

problem Vulnerability of deep reinforcement learning agents to small adversarial perturbations.
method RADIAL-RL, a principled framework for training robust reinforcement learning agents.
result RADIAL-RL-trained agents consistently outperform prior methods in robustness tests.

Survey of deep RL in intelligent transportation systems.

problem Optimizing traffic signals and autonomous driving using deep RL.
method Comprehensive review of deep RL applications in traffic control and autonomous driving.
result Summarizes existing works in deep RL-based transportation applications.

We discuss deep reinforcement learning in an overview style. We draw a big picture, filled with details. We discuss six core elements, six important mechanisms, and twelve applications, focusing on contemporary work, and in historical contexts. We start with background of artificial intelligence, machine learning, deep…

2018-10-15abs ↗pdf ↗

Deep RL agents suffer from transient non-stationarity, which ITER mitigates.

problem Transient non-stationarity in deep RL agents affects generalization.
method Iterated Relearning (ITER) transfers knowledge between networks to reduce non-stationarity.
result ITER improves deep RL agents' performance on generalization benchmarks.

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving increasing attention. However, works in this area use a wide variety of tasks and e…

2018-10-29abs ↗pdf ↗

This paper shows using classification instead of regression improves deep RL scalability.

problem Challenges in training value functions for large networks in deep RL.
method Used categorical cross-entropy loss instead of mean squared error regression.
result Significant improvements in performance and scalability across various domains.

Optimistic RL algorithms are simplified for deep RL with competitive performance.

problem Achieving accurate optimism in model-based RL for large-scale problems.
method Interpreting scalable optimistic model-based algorithms as solving a tractable noise augmented MDP.
result Competitive regret bound of ildeO(SHAT) ilde{\mathcal{O}}( |\mathcal{S}|H\sqrt{|\mathcal{A}| T } ) for Gaussian noise augmentation.

Deep RL controls anesthesia more accurately than traditional methods.

problem Controlling the level of unconsciousness during anesthesia.
method Deep Reinforcement Learning (DRL) to map patient state to propofol dosage.
result Deep RL model outperformed traditional controllers (1.7% vs 3.4% median absolute performance error).

HyperAgent improves RL exploration in large-scale problems.

problem Efficient exploration in large-scale reinforcement learning problems.
method Hypermodel framework for incremental posterior approximation without conjugacy.
result HyperAgent achieves logarithmic per-step computational complexity and sublinear regret.

Deep reinforcement learning is the combination of reinforcement learning (RL) and deep learning. This field of research has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine. Thus, deep RL opens up many new applications in domains such as healthcare, roboti…

2018-11-30abs ↗pdf ↗

Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of interaction with the environments to obtain satisfactory performance. Recently,…

2018-05-19abs ↗pdf ↗

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A critical present objective is thus to develop deep RL methods that can adapt rap…

2016-11-17abs ↗pdf ↗

Increasing input dimensionality improves deep RL performance and sample efficiency.

problem Real-world reinforcement learning applications often lack sufficient training data.
method Proposed an online feature extractor network (OFENet) to improve deep RL performance and sample efficiency.
result RL agents learn more efficiently with high-dimensional input representations than with lower-dimensional state observations.

New method defends RL agents from poisoning attacks without MDP knowledge.

problem Poisoning attacks on RL systems can cause learning failures.
method Generic poisoning framework for online RL, Vulnerability-Aware Adversarial Critic Poison (VA2C-P).
result Successfully prevents RL agents from learning good policies or converging to target policies.

Deep RL algorithms can overfit to early experiences, leading to poor performance.

problem Overfitting to early interactions in deep reinforcement learning.
method Proposed a mechanism to periodically reset part of the agent to mitigate overfitting.
result Periodic resetting improves performance in both discrete and continuous action domains.

SF-DQN improves RL transfer by learning successor features.

problem Transfer RL with shared dynamics but different reward functions.
method Decomposes Q-function into SF and reward mapping; uses GPI for policy improvement.
result SF-DQN with GPI converges faster and generalizes better than traditional RL methods.

Recent years have witnessed significant progresses in deep Reinforcement Learning (RL). Empowered with large scale neural networks, carefully designed architectures, novel training algorithms and massively parallel computing devices, researchers are able to attack many challenging RL problems. However, in machine learn…

2018-04-18abs ↗pdf ↗

Automatically generates a deep RL curriculum for faster and more stable learning.

problem How to automatically generate a curriculum for deep RL agents.
method Interprets curriculum generation as an inference problem, learning task distributions progressively.
result Curricula significantly improve learning performance across various environments and deep RL algorithms.

Improves deep RL agents' generalization to unseen environments.

problem Deep RL agents struggle to adapt to new environments.
method Information Bottleneck regularization and annealing-based optimization.
result Agents can generalize to test parameters more than 10 standard deviations away from training.

Study analyzes sensitivity of RL algorithm for ICU hemodynamic management.

problem Evaluating safety and reliability of RL in clinical settings.
method Sensitivity analysis of Duel-DDQN on ICU sepsis patients.
result RL policies are sensitive to various implementation factors.

Paper analyzes sample complexity for offline RL with deep ReLU networks.

problem Theoretical analysis of sample complexity for offline RL with deep ReLU networks.
method Establishes sample complexity for offline RL with deep ReLU networks, considering Besov dynamic closure and correlated structure.
result First theoretical characterization of sample complexity for offline RL with deep neural network function approximation.

Automates RL with sample-efficient hyperparameter optimization.

problem Challenges in applying deep RL due to hyperparameter sensitivity and inefficiency.
method Population-based AutoRL framework for meta-optimizing RL algorithms and architectures.
result Reduces the number of environment interactions needed for meta-optimization by up to an order of magnitude.

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning locomotion skills with minimal engineering and without an explicit model of the robot…

2018-12-26abs ↗pdf ↗

AdaStop improves statistical testing for Deep RL algorithm comparisons.

problem Statistical reproducibility issues in Deep RL.
method AdaStop, a new statistical test based on multiple group sequential tests.
result AdaStop ensures theoretically sound comparisons of Deep RL algorithms.

New RL algorithm explains why deep learning works in stochastic environments.

problem Why deep RL algorithms perform well in practice despite using random exploration.
method Introducing SQIRL, an iterative RL algorithm that separates exploration and learning.
result Effective horizon explains why deep RL works in stochastic environments.

Paper develops neural network approximation for pessimistic offline RL with theoretical guarantees.

problem Challenges in offline reinforcement learning with deep neural networks and data dependence.
method Establishes estimation error for pessimistic offline RL using neural network approximation with C\mathcal{C}-mixing data.
result Explicit efficiency of deep adversarial offline RL frameworks demonstrated with two converging error components.

The paper identifies overfitting as the main bottleneck in efficient deep reinforcement learning.

problem Improving sample efficiency in deep reinforcement learning.
method Empirical analysis on DMC tasks to identify overfitting as the main issue and developing a hill-climbing method targeting validation TD error.
result Overfitting is the primary bottleneck in sample-efficient deep RL, and regularization techniques can control this.

Improved RL for grasping in cluttered scenes using state representation learning.

problem Poor performance of RL methods in grasping diverse objects from raw images.
method Employed state representation learning (SRL) with disentanglement of raw input images.
result Deep RL can learn grasping skills from varied visual inputs.