Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

5.8%11.6%17.4%23.2% · Jun 202019922001200920182026
48 results for goal achievement

Max entropy exploration guides reinforcement learning agents to pursue achievable goals.

problem Achieving distant test-time goals in long-horizon tasks.
method Optimize entropy of historical achieved goals by focusing on sparsely explored areas.
result Order of magnitude better sample efficiency on long-horizon multi-goal tasks.

Paper proposes Imitative Models combining IL and planning for flexible goal achievement.

problem Difficult to direct IL to arbitrary goals and specify reward functions for goal-directed planning.
method Imitative Models are probabilistic predictive models that plan interpretable expert-like trajectories.
result Imitative Models outperform IL and planning approaches in a dynamic autonomous driving task.

A novel RL objective and prioritization framework improve performance and sample-efficiency in multi-goal tasks.

problem Learning diverse goals in multi-goal reinforcement learning.
method Maximum entropy regularization for objective and prioritization framework.
result Promising improvements in performance and sample-efficiency on multi-goal robotic tasks.

LEXA learns to discover and achieve goals in unseen environments.

problem Learning to solve diverse tasks in complex visual environments without supervision.
method LEXA learns a world model from image inputs and uses it to train an explorer and an achiever policy from imagined rollouts.
result LEXA solves tasks specified as goal images zero-shot without additional learning.

PlanGAN uses GANs to plan efficient trajectories for multi-goal tasks in sparse reward environments.

problem Learning with sparse rewards in multi-goal environments.
method PlanGAN combines GANs to generate trajectories leading to specified goals, then combines these into a planning algorithm.
result PlanGAN achieves comparable performance to model-free RL but is 4-8 times more sample efficient.

Sparse reward problems are one of the biggest challenges in Reinforcement Learning. Goal-directed tasks are one such sparse reward problems where a reward signal is received only when the goal is reached. One promising way to train an agent to perform goal-directed tasks is to use Hindsight Learning approaches. In thes…

2018-09-16abs ↗pdf ↗

The paper optimizes insurance purchases for financial goals.

problem Maximizing probability of achieving financial goals with insurance.
method Analyzes deferred term insurance in deterministic and stochastic frameworks, considering income, consumption, and risky investment.
result Provides optimal insurance and investment strategies for achieving financial goals.

OptiGAN uses GAN and RL to optimize sequence generation for specific goals.

problem Challenging in sequence generation tasks to generate sequences with specific desired goals.
method Integrates GAN and RL to optimize desired goal scores using policy gradients.
result Achieves higher desired scores in text and real-valued sequence generation.

For an autonomous agent to fulfill a wide range of user-specified goals at test time, it must be able to learn broadly applicable and general-purpose skill repertoires. Furthermore, to provide the requisite level of generality, these skills must handle raw sensory input such as images. In this paper, we propose an algo…

2018-07-12abs ↗pdf ↗

UC-SSP algorithm tackles exploration in stochastic shortest path problems without loop-free assumption.

problem Exploration in goal-oriented reinforcement learning problems under stochastic shortest path formulation.
method UC-SSP algorithm with a novel stopping rule to interrupt and switch policies.
result Regret bound of O~(DSADK)\displaystyle \widetilde{\mathcal{O}}( D S \sqrt{ A D K}) after KK episodes.

This work learns a distance function for goal-conditioned RL without prior knowledge.

problem Learning a distance function for goal-conditioned reinforcement learning without prior knowledge.
method Self-supervised approach to learn distance function in terms of actions needed to reach a goal.
result Solves complex tasks in three scenarios without prior domain knowledge.

Eikonal-Constrained QRL improves goal-reaching in reinforcement learning.

problem Reward design and out-of-distribution generalization in reinforcement learning.
method Eikonal-Constrained Quasimetric Reinforcement Learning (Eik-QRL) using the Eikonal PDE.
result Eik-QRL achieves state-of-the-art performance in offline goal-conditioned navigation and manipulation tasks.

Adapts Floyd-Warshall algorithm for RL to improve multi-goal task learning.

problem Limited transfer of learned information in model-free RL for dynamic goal tasks.
method Adapts Floyd-Warshall algorithm for RL to learn goal-conditioned action-value functions.
result FWRL achieves higher reward strategies in multi-goal tasks with fewer samples.

This work improves imitation learning and goal-conditioned RL by estimating value densities.

problem Effective solutions for imitation and goal-conditioned reinforcement learning require reliably reaching specified states or demonstrations.
method The approach uses recent advances in density estimation to learn value functions efficiently and without hindsight bias.
result The method achieves state-of-the-art demonstration sample-efficiency in imitation learning and is both efficient and bias-free in goal-conditioned reinforcement learning.

The paper tackles online learning with two types of losses and shows it's impossible without certain assumptions.

problem Online learning with primary and secondary losses where the secondary loss is bounded by a linear threshold.
method Analyzes the feasibility of achieving low regret with respect to the primary loss while keeping the secondary loss within a linear threshold.
result Achieving the goal is impossible without bounded variance assumption on the secondary loss.

All-goals updating exploits the off-policy nature of Q-learning to update all possible goals an agent could have from each transition in the world, and was introduced into Reinforcement Learning (RL) by Kaelbling (1993). In prior work this was mostly explored in small-state RL problems that allowed tabular representati…

2018-06-22abs ↗pdf ↗

Robotic arm learns to manipulate a ball by choosing goals from learned experience.

problem Efficient discovery of skills for long-living autonomous agents without supervision.
method Intrinsically motivated goal exploration using learned goal spaces from deep representation learning.
result Recent results show applicability of learned goal spaces on real-world robotic tasks.

Study combines chit-chat and goal-oriented dialogue in fantasy games.

problem Combining naturalistic chit-chat with goal-oriented tasks in fantasy games.
method Trained a goal-oriented model with reinforcement learning against an imitation-learned chit-chat model using two approaches.
result Both models outperform a baseline and can converse naturally to achieve goals.

Gold Seeker uses reinforcement learning to select actions that maximize information gain.

problem Active information selection for goal-oriented vision-and-language reasoning.
method Reinforcement learning with policy distributions to represent and reduce uncertainty.
result The method outperforms competitors in visual dialog and visual query generation challenges.

In this paper, we study a new learning paradigm for Neural Machine Translation (NMT). Instead of maximizing the likelihood of the human translation as in previous works, we minimize the distinction between human translation and the translation given by an NMT model. To achieve this goal, inspired by the recent success …

2017-04-20abs ↗pdf ↗

A key challenge in complex visuomotor control is learning abstract representations that are effective for specifying goals, planning, and generalization. To this end, we introduce universal planning networks (UPN). UPNs embed differentiable planning within a goal-directed policy. This planning computation unrolls a for…

2018-04-02abs ↗pdf ↗

The goals of this article are twofold : 1) to compute the conjugate locus of a geodesic that lies in the center of a simply connected, 2-step nilpotent Lie group with a left invariant metric 2) compare the isometry types of two such nilpotent Lie groups whose conjugate loci for central geodesics are "the same" in a sui…

2015-07-20abs ↗pdf ↗

New methods improve accuracy in predicting complex systems.

problem Improving accuracy in predicting complex physical systems from simulators.
method Proposes two new methods of design approaches that sequentially select input settings.
result Demonstrates effectiveness of the proposed methods through numerical examples.

Goals for reinforcement learning problems are typically defined through hand-specified rewards. To design such problems, developers of learning algorithms must inherently be aware of what the task goals are, yet we often require agents to discover them on their own without any supervision beyond these sparse rewards. W…

2018-03-27abs ↗pdf ↗

Method maps state space using landmarks for universal goal reaching.

problem Learning the Universal Value Function Approximator (UVFA) for long-range goals is challenging.
method Hierarchical modeling with a dynamic landmark-based map and a value network.
result The method enables agents to reach long-range goals at the early training stage.

A new method for robot manipulation tasks using imagined object goals.

problem Learning robot manipulation in sparse reward environments.
method Train objects to reach target positions, then use predictions to create a curriculum of tasks.
result Higher success rates in challenging learning scenarios compared to alternatives.

The paper develops methods to predict the probability of achieving a user goal in a task, ensuring the system alerts when the probability falls below a threshold.

problem Ensuring an autonomous system achieves the user's goal with calibrated probability estimates.
method Invertible conformal prediction using Probability-space Conformalized Quantile Regression (PCQR) to produce well-calibrated conditional prediction intervals.
result The method produces well-calibrated probabilities that the cumulative reward will fall within a user-specified target interval, with finite-sample guarantees.

ADRL improves participant selection in MCS systems.

problem Designing a participant selection algorithm for different MCS systems with multiple goals.
method Auxiliary-task based deep reinforcement learning (ADRL) using transformers and pointer networks.
result ADRL outperforms other baselines in various MCS settings.

Improves reinforcement learning for complex tasks with sparse feedback.

problem Learning optimal policies from sparse feedback is challenging.
method Three algorithms based on Hindsight Experience Replay (HER) to improve performances.
result Vast improvement in final success rate and sample efficiency.

We study the problem of efficient PAC active learning of homogeneous linear classifiers (halfspaces) in Rd\mathbb{R}^d, where the goal is to learn a halfspace with low error using as few label queries as possible. Under the extra assumption that there is a tt-sparse halfspace that performs well on the data (tdt \ll d)…

2018-05-07abs ↗pdf ↗

GoBOED optimizes experiments for specific decision-making objectives, improving downstream outcomes.

problem Reducing parameter uncertainty does not always improve decision-making in critical settings.
method Combines variational posterior surrogate and differentiable convex decision layer for gradient-based design optimization.
result GoBOED identifies designs that better align with specific decision objectives and reveals wider optimal design windows.

The paper proposes a method to transfer skills between tasks using disentangled latent policies.

problem Transfer learning in reinforcement learning struggles with diverse tasks without explicit supervision.
method Learning a small set of policies in a disentangled latent space that can be recombined to solve many tasks.
result Disentangled latent policies enable quick performance on many diverse tasks.