Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

14274154 · Feb 202019922001200920172026
48 results for ATARI Games

Model-free reinforcement learning (RL) can be used to learn effective policies for complex tasks, such as Atari games, even from image observations. However, this typically requires very large amounts of interaction -- substantially more, in fact, than a human would need to learn the same games. How can people learn so…

2019-03-01abs ↗pdf ↗

Despite significant advances in the field of deep Reinforcement Learning (RL), today's algorithms still fail to learn human-level policies consistently over a set of diverse tasks such as Atari 2600 games. We identify three key challenges that any algorithm needs to master in order to perform well on all games: process…

2018-05-29abs ↗pdf ↗

AG-RL uses action grammars to improve reinforcement learning efficiency.

problem Improving sample efficiency in reinforcement learning.
method Integrates action grammars into reinforcement learning algorithms to enhance performance.
result Significant improvement in performance across multiple Atari games.

To solve complex real-world problems with reinforcement learning, we cannot rely on manually specified reward functions. Instead, we can have humans communicate an objective to the agent directly. In this work, we combine two approaches to learning from human feedback: expert demonstrations and trajectory preferences. …

2018-11-15abs ↗pdf ↗

This work compresses reinforcement learning models for Atari games, improving localization.

problem Expensive deep neural networks in reinforcement learning.
method Model compression, global max-pooling, Actor-Mimic, weakly supervised localization.
result Compression reduces model size to 3% of original, enabling object localization.

Paper presents a new method for Bayesian deep learning that scales to Atari games.

problem Training neural networks on complex environments like Atari games is challenging.
method Adapted temporal difference Q-learning to work with Bayesian inference.
result TAGI allows for analytical inference of neural network parameters, achieving performance comparable to gradient-based methods.

The study explores when parametric models enhance reinforcement learning, validating a hypothesis on Atari games.

problem When and how to use parametric models in reinforcement learning.
method Comparison of parametric models and experience replay, validating a hypothesis on Atari games.
result Replay-based algorithms can be competitive or superior to model-based algorithms under suitable conditions.

Paper proposes a new method for better estimating continuous distributions in RL.

problem Challenges in parameterizing estimated distributions for better approximation of true continuous distribution.
method Proposes fully parameterized quantile function with fraction and value networks.
result Significantly outperforms existing distributional RL algorithms on 55 Atari Games.

Bayesian REX learns Atari games from demonstrations efficiently.

problem Bayesian reward learning for complex control problems is computationally intractable.
method Bayesian Reward Extrapolation (Bayesian REX) pre-trains a low-dimensional feature encoding and uses preferences to perform fast Bayesian inference.
result Bayesian REX learns Atari games from demonstrations in 5 minutes, competitive with state-of-the-art methods.

Paper proposes an RL algorithm to ensure policy performance guarantees.

problem Lack of performance guarantees for RL policies compared to baselines.
method Online model-free algorithm that ensures conservative exploration.
result Regret bound of ildeO(T) ilde{\mathcal{O}}(\sqrt{T}) for both discrete and continuous spaces.

Deep reinforcement learning has become popular over recent years, showing superiority on different visual-input tasks such as playing Atari games and robot navigation. Although objects are important image elements, few work considers enhancing deep reinforcement learning with object characteristics. In this paper, we p…

2018-09-17abs ↗pdf ↗

Generative deep learning creates counterfactual states to explain Atari agent decisions.

problem Difficulty in explaining deep reinforcement learning agent decisions to humans.
method Generative deep learning to create counterfactual states.
result Counterfactual states help non-expert participants understand Atari agent decision-making.

In this work, we build on recent advances in distributional reinforcement learning to give a generally applicable, flexible, and state-of-the-art distributional variant of DQN. We achieve this by using quantile regression to approximate the full quantile function for the state-action return distribution. By reparameter…

2018-06-14abs ↗pdf ↗

Adapting momentum from optimization to reinforcement learning.

problem Improving the convergence and stability of reinforcement learning algorithms.
method Introducing Momentum Value Iteration (MoVI) by incorporating an average of consecutive state-action value functions, inspired by the concept of momentum in optimization.
result MoVI improves the convergence and stability of reinforcement learning algorithms, as demonstrated by experiments on Atari games.

Study finds reinforcement learning performance plateaus due to environmental interference.

problem Catastrophic interference hinders sample efficiency in reinforcement learning.
method Empirical study in ALE, controlled experiments, analysis of prediction errors.
result Interference causes performance plateaus and degrades policies used to reach them.

Scaling up model and data size improves imitation learning in single-agent games.

problem Limited recovery of expert behavior in single-agent games using imitation learning.
method Investigate the effect of scaling model and data size on imitation learning performance.
result IL loss and mean return scale with compute budget, resulting in power laws.

Due to the capability of deep learning to perform well in high dimensional problems, deep reinforcement learning agents perform well in challenging tasks such as Atari 2600 games. However, clearly explaining why a certain action is taken by the agent can be as important as the decision itself. Deep reinforcement learni…

2019-02-01abs ↗pdf ↗

Large-scale public datasets have been shown to benefit research in multiple areas of modern artificial intelligence. For decision-making research that requires human data, high-quality datasets serve as important benchmarks to facilitate the development of new methods by providing a common reproducible standard. Many h…

2019-03-15abs ↗pdf ↗

CURL uses contrastive learning to improve reinforcement learning performance.

problem Improving reinforcement learning performance on complex tasks.
method Contrastive learning to extract high-level features from raw pixels, followed by off-policy control.
result CURL outperforms prior methods on DeepMind Control Suite and Atari Games.

DPFRL uses particle filters for decision making with complex visual observations.

problem Decision making with partial complex visual observations.
method Discriminative Particle Filter Reinforcement Learning (DPFRL) with a differentiable particle filter in the neural network policy.
result DPFRL outperforms state-of-the-art POMDP RL models in complex visual observation tasks.

Combines experience replay and exploration for better agent performance.

problem Improving exploration efficiency and robustness in reinforcement learning.
method Integrates Intrinsic Rewards with Prioritized Oversampled Experience Replay (POER).
result Achieves better agent performance and sample efficiency compared to PPO/RND.

Method learns statistics of return distributions via neural networks and maximum mean discrepancy.

problem Learning probability distributions in reinforcement learning.
method Maximum mean discrepancy (MMD) for learning unrestricted statistics of return distributions.
result Method outperforms standard distributional RL baselines on Atari games.

Deep reinforcement learning, applied to vision-based problems like Atari games, maps pixels directly to actions; internally, the deep neural network bears the responsibility of both extracting useful information and making decisions based on it. By separating the image processing from decision-making, one could better …

2018-06-04abs ↗pdf ↗

B-REX efficiently learns Atari game policies from pixel inputs using Bayesian methods.

problem Learning reward functions from visual inputs with uncertainty and safety considerations.
method Bayesian Reward Extrapolation (B-REX) using successor features and preferences.
result B-REX generates posterior samples efficiently, enabling high-confidence performance bounds.

A new method prioritizes and recycles experiences for better reinforcement learning.

problem Improving reinforcement learning efficiency by prioritizing and recycling experiences.
method Double-prioritized state-recycled (DPSR) experience replay.
result DPSR achieved state-of-the-art results in Atari games, outperforming original and prioritized methods.

Paper proposes Terminal Prediction to improve deep RL performance.

problem Sample inefficiency and convergence to locally optimal policies in deep reinforcement learning.
method Introduces a self-supervised auxiliary task, Terminal Prediction, to help representation learning.
result A3C-TP outperforms standard A3C in most domains and provides significant improvement in Pommerman.

A framework disentangles controllable objects from visual signals for improved RL.

problem Improving sample efficiency and game performance in vision-based RL.
method Action-conditioned video prediction to disentangle controllable objects.
result Improved sample efficiency and game performance in Atari games.