Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

152303455606 · Jun 202019922001200920172026
48 results for Deep Recurrent Q-Network

Deep Recurrent Q-Network improves autonomous driving in urban areas with pedestrians.

problem Challenges in urban autonomous driving due to complex road structures and unpredictable pedestrian behavior.
method Combines Deep Q-Network with LSTM for long-term memory, designed a 3-D state representation, and uses a reward function.
result The proposed DRQN-based approach outperforms rule-based methods in dense urban scenarios.

This research tackles balancing exploration and exploitation in deep RL for partially observable systems.

problem Balancing exploration and exploitation in deep RL for partially observable systems.
method Deployed and tested several techniques including adaptive and deterministic exploration strategies, and a modified quadratic loss function.
result Adaptive methods better approximate the trade-off between exploration and exploitation.

Deep Reinforcement Learning (RL) recently emerged as one of the most competitive approaches for learning in sequential decision making problems with fully observable environments, e.g., computer Go. However, very little work has been done in deep RL to handle partially observable environments. We propose a new architec…

2018-04-17abs ↗pdf ↗

We propose a framework that directly tackles the probability distribution of the value function parameters in Deep Q Network (DQN), with powerful variational inference subroutines to approximate the posterior of the parameters. We will establish the equivalence between our proposed surrogate objective and variational i…

2017-11-30abs ↗pdf ↗

Enhanced DQN model boosts trading performance with advanced techniques.

problem Improving automated trading performance in financial markets.
method Incorporation of Prioritized Experience Replay, Regularized Q-Learning, Noisy Networks, Dueling, Double DQN, and CNN architectures.
result Significantly improved returns and Sharpe Ratio compared to the original DQN model.

Auto-CASH uses Deep Q-Network to automatically select machine learning algorithms.

problem Automatic selection of machine learning algorithms and hyperparameters.
method Pre-trained model based on meta-learning using Deep Q-Network.
result Auto-CASH achieves better performance with shorter time compared to classical and state-of-the-art methods.

We study reinforcement learning (RL) in high dimensional episodic Markov decision processes (MDP). We consider value-based RL when the optimal Q-value is a linear function of d-dimensional state-action feature representation. For instance, in deep-Q networks (DQN), the Q-value is a linear function of the feature repres…

2018-02-13abs ↗pdf ↗

DQNs can approximate optimal Q-functions with high accuracy on compact sets.

problem Approximating optimal Q-functions in continuous-time Markov Decision Processes.
method Stochastic control, FBSDEs, residual network approximation theorems, large deviation bounds, viscosity solutions.
result DQNs can approximate optimal Q-functions on compact sets with arbitrary accuracy and high probability.

AI algorithms outperform traditional trading methods in stock markets.

problem Traditional trading methods struggle with risk management and edge over classical approaches.
method Used Deep Reinforcement Learning (DRL) algorithms (DDQN and PPO) to compare with Buy and Hold benchmark.
result DRL algorithms provide a substantial edge over classical approaches in terms of risk-adjusted returns.

An automatic program that generates constant profit from the financial market is lucrative for every market practitioner. Recent advance in deep reinforcement learning provides a framework toward end-to-end training of such trading agent. In this paper, we propose an Markov Decision Process (MDP) model suitable for the…

2018-07-08abs ↗pdf ↗

Paper uses deep Q-network to correct eye movement artifacts in OCT volumes.

problem Unsupervised correction of inter-frame misalignments in OCT volumes due to eye movement artifacts.
method Dueling deep Q-network trained to maximize reward signals based on intensity-based image similarity metrics.
result Average normalized mutual information and correlation coefficient of 0.985 and 0.914, respectively.

This paper uses deep reinforcement learning to automate electric transmission voltage control.

problem Automating voltage control in electric transmission systems.
method Deep reinforcement learning (DRL) applied to voltage control, with a novel DQN modification.
result DRL can automate voltage control at scale, but more research is needed.

Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of interaction with the environments to obtain satisfactory performance. Recently,…

2018-05-19abs ↗pdf ↗

This research introduces an autonomous robot navigation method using reinforcement learning.

problem Improving robot navigation in complex environments.
method Deep Q Network (DQN) and Proximal Policy Optimization (PPO) models for path planning and decision-making.
result The models enhance robot navigation ability and adaptive learning in unknown environments.

The deep reinforcement learning method usually requires a large number of training images and executing actions to obtain sufficient results. When it is extended a real-task in the real environment with an actual robot, the method will be required more training images due to complexities or noises of the input images, …

2018-06-02abs ↗pdf ↗

Deep reinforcement learning improves trading performance in financial markets.

problem Improving trading performance in financial markets.
method Deep Q-network (DQN) for designing long-short trading strategies.
result Trained reinforcement learning agent outperformed an index benchmark in trading E-mini S&P 500 futures contracts.

Uses news sentiment scores for direct reinforcement trading in financial markets.

problem Incorporating news data into quantitative trading remains challenging.
method Directly uses news sentiment scores and raw data as inputs for reinforcement learning, processed by sequence models.
result Achieves superior performance compared to market benchmarks.

A new method prioritizes and recycles experiences for better reinforcement learning.

problem Improving reinforcement learning efficiency by prioritizing and recycling experiences.
method Double-prioritized state-recycled (DPSR) experience replay.
result DPSR achieved state-of-the-art results in Atari games, outperforming original and prioritized methods.

Deep reinforcement learning (DRL) methods such as the Deep Q-Network (DQN) have achieved state-of-the-art results in a variety of challenging, high-dimensional domains. This success is mainly attributed to the power of deep neural networks to learn rich domain representations for approximating the value function or pol…

2017-05-21abs ↗pdf ↗

In deep reinforcement learning (RL), adversarial attacks can trick an agent into unwanted states and disrupt training. We propose a system called Robust Student-DQN (RS-DQN), which permits online robustness training alongside Q networks, while preserving competitive performance. We show that RS-DQN can be combined with…

2019-11-03abs ↗pdf ↗

New hybrid model combines GARCH and reinforcement learning for improved VaR estimation.

problem Inaccurate VaR estimation in volatile financial markets.
method Combines GARCH volatility models with DDQN reinforcement learning for dynamic risk forecasting.
result Significant improvement in VaR accuracy and reduction in breaches.

A new method for learning Gaussian Mixture Models using gradient descent.

problem Learning Gaussian Mixture Models efficiently and with gradient descent.
method Sliced Cramér 2-distance for multivariate GMMs, compatible with gradient descent.
result Closed-form solution for univariate case, easy to implement.

Study analyzes sensitivity of RL algorithm for ICU hemodynamic management.

problem Evaluating safety and reliability of RL in clinical settings.
method Sensitivity analysis of Duel-DDQN on ICU sepsis patients.
result RL policies are sensitive to various implementation factors.

We present a novel algorithm to train a deep Q-learning agent using natural-gradient techniques. We compare the original deep Q-network (DQN) algorithm to its natural-gradient counterpart, which we refer to as NGDQN, on a collection of classic control domains. Without employing target networks, NGDQN significantly outp…

2018-03-20abs ↗pdf ↗