arXiv research

The paper improves energy decay estimates for Dir-stationary Q-valued functions and applies them to Liouville-type theorems and continuity.

Q-Distribution Guided Q-Learning corrects overestimation of uncertain OOD actions in offline RL.

Investigates Q value evolution in Stable Baselines for DQL in simple vs complex environments.

Proves continuity and singular set dimension for 2D maps with Q values.

A new DQN algorithm improves portfolio management and risk assessment in digital assets.

The paper studies uncertainty quantification and exploration in RL, providing methods and results.

POWSS simplifies Q-value estimation in POMDPs with continuous observations.

A new method stabilizes deep reinforcement learning by using QGraphs to retain replay memory information.

Proposes Optimistic Pessimistically Initialised Q-Learning (OPIQ) for better exploration in RL.

The paper proves the convergence of Q-value for Gaussian rewards.

We analyze a notion of multiple valued sections of a vector bundle over an abstract smooth Riemannian manifold, which was suggested by W. Allard in the unpublished note "Some useful techniques for dealing with multiple valued functions" and generalizes Almgren's $Q$-valued functions. We study some relevant properties o…

New approach optimizes policies in adversarial MDPs using adversarial learning.

New method finds unseen states for RL, improving performance.

We methodologically address the problem of Q-value overestimation in deep reinforcement learning to handle high-dimensional state spaces efficiently. By adapting concepts from information theory, we introduce an intrinsic penalty signal encouraging reduced Q-value estimates. The resultant algorithm encompasses a wide r…

Paper improves RL algorithms with known optimal Q-value predictions.

Proposes a value-based method for continuous control without an actor.

Improved Q-learning for multi-agent reinforcement learning by weighting joint action values.

KL regularization helps RL algorithms by implicitly averaging q-values.

We give a formula of the Upsilon invariant of any L-space cable knot $K_{p,q}$ using $p,Υ_K$ and $Υ_{T_{p,q}}$. The integral value of the Upsilon invariant gives a ${\mathbb Q}$-valued knot concordance invariant. We compute the integral values for L-space iterated cable knots.

The paper proposes a method to infer Q-values online with Q-Learning.

Study Q-learning with averaging for reinforcement learning, proving efficient inference and error bounds.

Being able to reach any desired location in the environment can be a valuable asset for an agent. Learning a policy to navigate between all pairs of states individually is often not feasible. An all-goals updating algorithm uses each transition to learn Q-values towards all goals simultaneously and off-policy. However …

Policy gradient is an efficient technique for improving a policy in a reinforcement learning setting. However, vanilla online variants are on-policy only and not able to take advantage of off-policy data. In this paper we describe a new technique that combines policy gradient with off-policy Q-learning, drawing experie…

Bayesian approach improves $\varepsilon$-greedy exploration in RL.

New method estimates optimal Q-values with better accuracy for specific problems.

We construct Lipschitz $Q$-valued functions which approximate carefully integral currents when their cylindrical excess is small and they are almost minimizing in a suitable sense. This result is used in two subsequent works to prove the discreteness of the singular set for the following three classes of $2$-dimensiona…

Improves neural networks' ability to learn new tasks without forgetting earlier ones.

DNAF accelerates DQL for efficient resource allocation in network slicing.

We study reinforcement learning (RL) in high dimensional episodic Markov decision processes (MDP). We consider value-based RL when the optimal Q-value is a linear function of d-dimensional state-action feature representation. For instance, in deep-Q networks (DQN), the Q-value is a linear function of the feature repres…

We propose RUDDER, a novel reinforcement learning approach for delayed rewards in finite Markov decision processes (MDPs). In MDPs the Q-values are equal to the expected immediate reward plus the expected future rewards. The latter are related to bias problems in temporal difference (TD) learning and to high variance p…

This work uses variational quantum circuits for deep reinforcement learning.

Bayes-UCBVI tackles reinforcement learning with a new upper confidence bound method.

Proposes SOR Q-learning for faster optimal value function computation in RL.

In this paper we study the singular set of Dirichlet-minimizing $Q$-valued maps from $\mathbb{R}^m$ into a smooth compact manifold $\mathcal{N}$ without boundary. Similarly to what happens in the case of single valued minimizing harmonic maps, we show that this set is always $(m-3)$-rectifiable with uniform Minkowski b…

A RL approach optimizes metal AM process parameters for consistent melt pool depth.

The paper proposes a structure learning model for efficient reinforcement learning.

Instability and variability of Deep Reinforcement Learning (DRL) algorithms tend to adversely affect their performance. Averaged-DQN is a simple extension to the DQN algorithm, based on averaging previously learned Q-values estimates, which leads to a more stable training procedure and improved performance by reducing …

We develop a multivalued theory for the stability operator of (a constant multiple of) a minimally immersed submanifold $Σ$ of a Riemannian manifold $\mathcal{M}$. We define the multiple valued counterpart of the classical Jacobi fields as the minimizers of the second variation functional defined on a Sobolev space of …

Agent learns complex web tasks by breaking them into simpler sub-tasks.

Improves reinforcement learning extrapolation in Gridworlds.

A framework for estimating both epistemic and aleatoric uncertainties in reinforcement learning.

Q-Ensembles are a model-free approach where input images are fed into different Q-networks and exploration is driven by the assumption that uncertainty is proportional to the variance of the output Q-values obtained. They have been shown to perform relatively well compared to other exploration strategies. Further, mode…

Paper provides estimates for varifolds with critical mean curvature.

Study invariants of elliptic curves in LCS manifolds, leading to new phenomena in Riemann-Finsler geometry.

New RL theory predicts deep RL success based on greedy actions under random policies.

Equivariant CNNs improve RL performance in symmetric environments.

Deep Reinforcement Learning (RL) recently emerged as one of the most competitive approaches for learning in sequential decision making problems with fully observable environments, e.g., computer Go. However, very little work has been done in deep RL to handle partially observable environments. We propose a new architec…

We present a method for a certain class of Markov Decision Processes (MDPs) that can relate the optimal policy back to one or more reward sources in the environment. For a given initial state, without fully computing the value function, q-value function, or the optimal policy the algorithm can determine which rewards w…