Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2795588371,116 · Jun 202019922001200920172026
48 results for Deep planning networks

Deep network predicts action sequences for complex tasks from a scene image.

problem Scalable task and motion planning from initial scene images.
method Deep convolutional recurrent neural network that predicts action sequences.
result Predicts promising action sequences, reducing motion planning problems.

Certified guidance ensures generative models always meet planning objectives.

problem Lack of guarantees for generated outputs satisfying planning objectives.
method Certified guidance modifies generative models without retraining, ensuring outputs meet STL specifications.
result Certified guidance produces models that are always correct, unlike non-certified methods.

Information planning enables faster learning with fewer training examples. It is particularly applicable when training examples are costly to obtain. This work examines the advantages of information planning for text data by focusing on three supervised models: Naive Bayes, supervised LDA and deep neural networks. We s…

2018-02-09abs ↗pdf ↗

We introduce Dynamic Planning Networks (DPN), a novel architecture for deep reinforcement learning, that combines model-based and model-free aspects for online planning. Our architecture learns to dynamically construct plans using a learned state-transition model by selecting and traversing between simulated states and…

2018-12-28abs ↗pdf ↗

Enhances PlaNet for better planning in uncertain environments.

problem Improving deep planning networks for partially observable environments.
method Incorporates Bayesian inference to handle uncertainty in latent models and action candidates.
result Consistently improves asymptotic performance on continuous control tasks.

Combines MCTS and neural networks for efficient multi-period financial planning.

problem Solving multi-period financial planning models with high transaction costs and regime switching.
method Integrates Monte Carlo Tree Search with deep neural networks, using UTC and lookup search.
result Combined approach outperforms individual methods, solving complex models.

This paper introduces the QMDP-net, a neural network architecture for planning under partial observability. The QMDP-net combines the strengths of model-free learning and model-based planning. It is a recurrent policy network, but it represents a policy for a parameterized set of tasks by connecting a model with a plan…

2017-03-20abs ↗pdf ↗

We introduce Imagination-Augmented Agents (I2As), a novel architecture for deep reinforcement learning combining model-free and model-based aspects. In contrast to most existing model-based reinforcement learning and planning methods, which prescribe how a model should be used to arrive at a policy, I2As learn to inter…

2017-07-19abs ↗pdf ↗

This research introduces an autonomous robot navigation method using reinforcement learning.

problem Improving robot navigation in complex environments.
method Deep Q Network (DQN) and Proximal Policy Optimization (PPO) models for path planning and decision-making.
result The models enhance robot navigation ability and adaptive learning in unknown environments.

New AI model improves grid planning efficiency and reliability.

problem Improving distribution grid planning with AI for energy sustainability.
method Hyperstructures Graph Convolutional Neural Networks (Hyper-GCNNs) with attention mechanism.
result Hyper-GCNNs outperforms existing models in computational efficiency and accuracy.

This paper bridges Markowitz planning and deep reinforcement learning for portfolio optimization.

problem Combining Markowitz planning and deep reinforcement learning for portfolio optimization.
method Mapping market conditions to actions using deep reinforcement learning, casting portfolio allocation as a continuous control problem.
result Deep reinforcement learning techniques can provide new insights for portfolio allocation.

Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models that are accurate enough for planning has been a long-standing challenge, especiall…

2018-11-12abs ↗pdf ↗

The problem of retrosynthetic planning can be framed as one player game, in which the chemist (or a computer program) works backwards from a molecular target to simpler starting materials though a series of choices regarding which reactions to perform. This game is challenging as the combinatorial space of possible cho…

2019-01-19abs ↗pdf ↗

Deep learning improves trip prediction accuracy in transportation planning.

problem Traditional models fail to accurately predict person and vehicle trips due to complexity and dynamics.
method Developed and trained a deep learning model using NHTS data.
result Deep learning model achieved 98% accuracy for person trip prediction and 96% for vehicle trip estimation.

Bayesian deep learning improves maintenance planning uncertainty quantification.

problem Estimating the remaining useful life of physical systems with uncertainty quantification.
method Stein variational gradient descent for training Bayesian neural networks.
result Bayesian deep learning models trained via Stein variational gradient descent outperform other methods in convergence speed and predictive performance.

Bayesian neural networks improve uncertainty estimation in 3D point cloud segmentation for factory planning.

problem Improving uncertainty estimation in 3D point cloud segmentation for factory planning.
method Proposed fully Bayesian and approximate Bayesian neural networks for point cloud segmentation.
result Superior model performance and improved segmentation results with uncertainty incorporation.

Motion planning is an essential component in most of today's robotic applications. In this work, we consider the learning setting, where a set of solved motion planning problems is used to improve the efficiency of motion planning on different, yet similar problems. This setting is important in applications with rapidl…

2019-06-01abs ↗pdf ↗

Deep neural network learns discrete state abstractions for efficient planning.

problem Efficient sequential decision making in large state spaces.
method Information bottleneck method for learning approximate bisimulations using deep neural encoders and action-conditioned HMM.
result Trained method efficiently plans for unseen goals in multi-goal reinforcement learning.

XLVINs improve deep reinforcement learning by combining self-supervised learning and neural algorithmic reasoning.

problem Limitations of Value Iteration Networks (VINs) in deep reinforcement learning.
method Combining contrastive self-supervised learning, graph representation learning, and neural algorithmic reasoning.
result XLVINs match VIN-like models on discrete, fixed MDPs and significantly outperform model-free baselines.

Deep imagination optimizes decision-making in large trees with limited resources.

problem Optimal planning in large decision trees with limited resources and time.
method Analytical solutions and numerical analysis of sampling capacity allocation.
result Optimal policy is to allocate few samples per level for deep exploration, favoring depth over breadth.

CESAR improves wind speed and power forecasting for high-resolution simulations.

problem Accurate high-resolution wind forecasting for efficient power grid management.
method A spatio-temporal neural network model using deep convolutional autoencoder and echo state network.
result CESAR provides up to 17% improvement in wind speed and power forecasting compared to best alternatives.

We introduce the value iteration network (VIN): a fully differentiable neural network with a `planning module' embedded within. VINs can learn to plan, and are suitable for predicting outcomes that involve planning-based reasoning, such as policies for reinforcement learning. Key to our approach is a novel differentiab…

2016-02-09abs ↗pdf ↗

Deep RL drone trained to compete against classical path planning in drone racing.

problem Optimizing long-term drone racing strategies using reinforcement learning.
method Used PPO algorithm on a simulated quadrotor in a racing environment created with AirSim.
result Deep RL agent outperformed classical path planning in drone racing competitions.

Fast and efficient motion planning algorithms are crucial for many state-of-the-art robotics applications such as self-driving cars. Existing motion planning methods become ineffective as their computational complexity increases exponentially with the dimensionality of the motion planning problem. To address this issue…

2018-06-14abs ↗pdf ↗

The paper optimizes UAV path and power for QoS in cellular networks.

problem Optimizing UAV path and power for QoS in cellular networks.
method Apprenticeship learning via deep inverse reinforcement learning (IRL) combined with Q-learning and DRL.
result The proposed method achieves expert-level performance and maintains performance in unseen situations.

End-to-end learnable network for safer self-driving with interpretable intermediate representations.

problem Safe motion planning for self-driving vehicles.
method Differentiable semantic occupancy representation for cost calculation in motion planning.
result Significantly outperforms state-of-the-art planners in imitating human behaviors and producing safer trajectories.

This paper presents a novel two-step approach for the fundamental problem of learning an optimal map from one distribution to another. First, we learn an optimal transport (OT) plan, which can be thought as a one-to-many map between the two distributions. To that end, we propose a stochastic dual approach of regularize…

2017-11-07abs ↗pdf ↗

PDSketch enables flexible robot planning by learning from domain structures.

problem Building general robots with flexible planning.
method Exploiting locality and sparsity in environmental models, PDSketch defines high-level structures for trainable neural networks.
result PDSketch automatically generates planning heuristics without additional training.

One-shot path planning for multiple agents using neural networks.

problem Efficiently generating optimal or near-optimal paths for multiple agents in robotics.
method Utilizes fully convolutional neural networks for one-shot multi-agent path planning.
result Demonstrates successful generation of optimal or near-optimal paths in over 85% of cases for multi-path planning.

A key challenge in complex visuomotor control is learning abstract representations that are effective for specifying goals, planning, and generalization. To this end, we introduce universal planning networks (UPN). UPNs embed differentiable planning within a goal-directed policy. This planning computation unrolls a for…

2018-04-02abs ↗pdf ↗

Study uses deep neural networks for inference in partially linear models with dependent data.

problem Inference in partially linear models with dependent data.
method First stage deep neural network (DNN) estimation followed by n\sqrt{n}-consistent and asymptotically normal estimator.
result The DNN-estimated finite dimensional parameter achieves n\sqrt{n}-consistency and asymptotic normality.