We present NAVREN-RL, an approach to NAVigate an unmanned aerial vehicle in an indoor Real ENvironment via end-to-end reinforcement learning RL. A suitable reward function is designed keeping in mind the cost and weight constraints for micro drone with minimum number of sensing modalities. Collection of small number of…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “end-to-end RL”
ShrinkML uses RL to compress ASR models efficiently.
problem Large and complex ASR models reduce accuracy.
method Reinforcement Learning for compression of LSTM layers using SVD.
result RL-based compression achieves better accuracy than manual methods.
New meta-RL method avoids exploration-exploitation trade-off.
problem Learning to explore and exploit simultaneously in meta-RL.
method Developed new objectives for exploration and exploitation.
result DREAM outperforms existing methods on complex tasks.
Proposes deep-RL with GANs for ultra-reliable low-latency communication.
problem Resource allocation for URLLC with high reliability and low latency.
method Experienced deep-RL framework using GANs to pre-train and optimize resource allocation.
result Deep-RL framework achieves near-optimal reliability and latency under URLLC constraints.
New framework learns robot tasks quickly from simplified simulations.
problem Long training times and variable-length inputs in RL.
method Combines deep sets encoding with modular RL.
result Effective policies learned in minutes from simplified simulations.
Novel RL method handles urban driving tasks including traffic lights.
problem Difficulties in reinforcement learning for complex urban driving tasks.
method Implicit affordances for model-free RL.
result Successfully handles urban driving tasks including traffic lights.
Horizon is Facebook's open RL platform for large, slow feedback datasets.
problem Training RL models with large, slow feedback datasets.
method End-to-end RL platform with workflows, data preprocessing, distributed training, etc.
result RL models trained with Horizon significantly outperform supervised learning systems.
A new EM framework for goal-conditioned RL improves performance on sparse reward tasks.
problem Handling sparse rewards in goal-conditioned reinforcement learning.
method A graphical model framework with an EM algorithm that includes a learning-in-hindsight E-step and a supervised M-step.
result hEM significantly outperforms model-free baselines on goal-conditioned benchmarks with sparse rewards.
Low precision RL distillation enables real-time game play on neuromorphic hardware.
problem Limited use of low precision networks in reinforcement learning.
method Policy distillation from high precision to low precision networks.
result Low precision distillation enables real-time game play on low-power hardware.
Paper proposes a Hellinger distance regularizer to disentangle options in reinforcement learning.
problem Temporal abstraction in reinforcement learning, specifically the mutual exclusivity of learned options.
method Introduces a Hellinger distance regularizer to disentangle options.
result Demonstrates the effectiveness of the Hellinger distance regularizer in disentangling options.
New RL algorithm tackles online robust MDPs with uncertainty.
problem Developing robust reinforcement learning models for real-world environments.
method Proposes a robust optimistic policy optimization algorithm for online robust MDPs.
result Establishes the first regret bound for online robust MDPs.
New unsupervised learning task improves RL performance.
problem Reward-driven feature learning limitations in RL from images.
method Introduce Augmented Temporal Contrast (ATC) for unsupervised learning of image representations.
result Training encoders using ATC matches or outperforms end-to-end RL in most environments.
AACC improves RL performance in changing environments.
problem Deterioration of RL performance in real-world tasks.
method Formalizes CMDPs, proposes AACC for contextual RL.
result AACC outperforms baselines in various simulated environments.
SRL embeds combinatorial optimization into RL for better decision-making.
problem Challenges of standard RL in complex, structured decision-making problems.
method Structured Reinforcement Learning (SRL) with combinatorial optimization layers in actor neural network.
result SRL outperforms unstructured RL and imitation learning by up to 92% on dynamic problems.
Disentangling Controllable Object through Video Prediction Improves Visual Reinforcement Learningcs.LG
A framework disentangles controllable objects from visual signals for improved RL.
problem Improving sample efficiency and game performance in vision-based RL.
method Action-conditioned video prediction to disentangle controllable objects.
result Improved sample efficiency and game performance in Atari games.
Survey of integrating planning and learning in model-based reinforcement learning.
problem Sequential decision making in AI, formalized as MDP optimization.
method Systematic coverage of dynamics model learning and planning-learning integration.
result Broad conceptual overview of model-based reinforcement learning.
FOCAL tackles offline meta-reinforcement learning with efficient task inference and behavior regularization.
problem Efficiently adapt RL algorithms to unseen tasks without interactions, addressing bootstrapping errors and robust task inference.
method FOCAL combines behavior regularization, a deterministic context encoder, and a negative-power distance metric for efficient task inference.
result FOCAL outperforms prior algorithms on meta-RL benchmarks, demonstrating computational efficiency.
Safe RL for safety-critical tasks using CBFs and model-free RL.
problem Limited safety guarantees in RL for real-world applications.
method Combines model-free RL with CBFs and GP dynamics modeling.
result Demonstrates greater sample efficiency and safety in learning.
RL platform enhances user journeys in healthcare apps.
problem Improving user experience and personalization in healthcare apps.
method Reinforcement learning framework for adaptive interventions.
result Significant increase in basket size through personalized recommendations.
The paper shows how continuous attention can lead to better object representations.
problem Learning good representations from data without labeled examples.
method Integrating unsupervised learning and reinforcement learning with intrinsic motivation.
result The proposed algorithm improves object recognition in few-shot settings.
New RL framework learns task completion without prior knowledge.
problem Learning task completion without linguistic or perceptual knowledge.
method Sequentially imagining visual goals and choosing actions.
result Framework outperforms flat and hierarchical architectures.
Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this challenge, the pixels-to-torques problem, where an RL agent learns a closed-loop con…
JAX-LOB simulates thousands of LOBs for RL training.
problem Efficient simulation of large LOBs for RL training.
method GPU-accelerated JAX implementation of LOB simulator.
result JAX-LOB processes thousands of LOBs in parallel with reduced processing time.
Proposes a deep RL framework for optimizing task allocation in crowdsourcing platforms.
problem Optimizing task allocation in crowdsourcing platforms for both workers and requesters.
method Uses Deep Q-Network (DQN) to estimate long-term rewards, considering immediate and future rewards simultaneously.
result Demonstrates superior performance in synthetic and real datasets.
USFs capture dynamics for faster RL task transfer.
problem Applying knowledge from one task to another.
method Proposed Universal Successor Features (USFs) for RL.
result USFs accelerate training and transfer knowledge.
End-to-end training of neural networks with black-box functions.
problem Training neural networks for tasks that require precise, non-differentiable functions.
method Approximate black-box functions with differentiable neural networks and integrate them into neural network training.
result Neural network trained to compute inputs for black-box functions, generalizing better and learning more efficiently.
Paper tackles overfitting in RL for trade execution.
problem Overfitting in reinforcement learning methods for optimized trade execution.
method Modeling trade execution as offline RL with dynamic context (ORDC), deriving generalization bound, proposing compact context representations.
result Proposed methods effectively alleviate overfitting and improve performance.
New approach decouples skill learning and language grounding for autonomous agents.
problem Autonomous acquisition of skills without external instructions and feedback.
method Language-Goal-Behavior (LGB) architecture with semantic representation.
result Decouples skill learning and language grounding, enabling diversity and strategy switching.
The broad set of deep generative models (DGMs) has achieved remarkable advances. However, it is often difficult to incorporate rich structured domain knowledge with the end-to-end DGMs. Posterior regularization (PR) offers a principled framework to impose structured constraints on probabilistic models, but has limited …
Model-free RL agents can learn effective planning without explicit model.
problem Challenging domains with combinatorial complexity.
method Model-free RL with inductive bias in neural networks.
result Model-free RL can exhibit planning characteristics without explicit model.
BCRL learns a Bellman complete representation for offline RL policy evaluation.
problem Learning a Q-function efficiently from offline data.
method BCRL learns a linear Bellman complete representation directly from data, enabling efficient OPE.
result BCRL achieves competitive OPE error and outperforms FQE in certain scenarios.
CryptoRLPM uses on-chain data to improve crypto portfolio management performance.
problem Lack of effective use of on-chain data in RL-based crypto portfolio management.
method Developed CryptoRLPM, an RL-based system that incorporates on-chain data for crypto PM, consisting of five units.
result CryptoRLPM outperforms baselines in ARR, DRR, and SR, especially for Bitcoin.
EMR learns to read and remember from streaming data for QA.
problem Scalable QA from streaming data without knowing questions.
method End-to-end deep network model (EMR) with RL agent for memory management.
result EMR achieves significant improvements over existing methods on synthetic and real-world datasets.
Neural-Kernel CME tackles scalability and expressiveness challenges in conditional distribution representation.
problem Scalability and expressiveness challenges in kernel conditional mean embeddings.
method Combines deep learning with CMEs using a neural network optimization framework.
result Achieves competitive and often superior performance in conditional density estimation and RL.
DPFRL uses particle filters for decision making with complex visual observations.
problem Decision making with partial complex visual observations.
method Discriminative Particle Filter Reinforcement Learning (DPFRL) with a differentiable particle filter in the neural network policy.
result DPFRL outperforms state-of-the-art POMDP RL models in complex visual observation tasks.
Proves error bounds for state representation in RL using graph spectral features.
problem Addressing the curse of dimensionality in RL with unknown transition graphs.
method Proves upper bounds on approximation error of linear value function approximation using learned spectral features of the state-graph.
result Error bounds scale with algebraic connectivity and eigenvector estimation error.
New insights into state representations in RL help design better learning rules.
problem Lack of automatic feature learning in RL for large or continuous state spaces.
method Bootstrapping methods and theoretical analysis of temporal difference learning.
result State representations differ from other auxiliary-task-based approaches.
Deep RL team defends payloads from obstacles.
problem Protecting high-value payloads from obstacles during navigation.
method Multi-agent deep reinforcement learning for coordinated escort teams.
result Escort teams increase navigation success by up to 75%.
Activities in reinforcement learning (RL) revolve around learning the Markov decision process (MDP) model, in particular, the following parameters: state values, V; state-action values, Q; and policy, pi. These parameters are commonly implemented as an array. Scaling up the problem means scaling up the size of the arra…
Paper proposes CARL for better control in RL from sensory data.
problem Efficient control of complex systems from high-dimensional sensory inputs.
method Control-Aware Representation Learning (CARL) for model-based RL.
result CARL improves control performance in benchmark tasks.
Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized decision making. However, concatenation scales poorly to swarm systems with a large…
Quantum circuits optimize financial portfolios faster than classical methods.
problem Dynamic portfolio optimization in financial markets.
method Variational Quantum Circuits for reinforcement learning.
result Quantum agents outperform classical RL models in risk-adjusted performance.
Robots learn state representation from demonstrations.
problem Robots need a compact state representation for efficient interaction.
method Imitation learning using a multi-head neural network.
result Trained representation improves performance and efficiency in reinforcement learning.
Combining deep model-free reinforcement learning with on-line planning is a promising approach to building on the successes of deep RL. On-line planning with look-ahead trees has proven successful in environments where transition models are known a priori. However, in complex environments where transition models need t…
Improved cooperation between levels boosts reinforcement learning performance.
problem Training multi-level policies in hierarchical reinforcement learning.
method Modeling policy optimization as a multi-agent process and inducing cooperation between sub-policies.
result Inducing cooperation between sub-policies leads to stronger and more sample-efficient policies.
Deep RL learns effective job shop scheduling rules from raw features.
problem Designing effective priority dispatching rules for job shop scheduling is challenging.
method End-to-end deep reinforcement learning using Graph Neural Networks.
result Agent learns high-quality dispatching rules from raw features and generalizes well to unseen instances.
Hybrid RL algorithms improve offline and online RL in linear MDPs.
problem Improving RL performance without single-policy concentrability.
method Developed computationally efficient algorithms for PAC and regret-minimizing RL in linear MDPs.
result Achieved sharper error or regret bounds for linear MDPs.
This work explores representation complexity in RL paradigms, revealing model-based RL as the easiest task.
problem Investigating the representation complexity gap among model-based, policy-based, and value-based RL.
method Demonstrated through analysis of Markov decision processes (MDPs) and introduced new classes of MDPs.
result Representation complexity hierarchy: model-based RL > policy-based RL > value-based RL.