Improves AI agents' 3D navigation by learning from failures and 3D spatial relationships.
problem Challenges in data efficiency, obstacle avoidance, and generalization in 3D visual navigation.
method Incorporates attention on 3D spatial relationships and a target skill extension module into DRL framework.
result Significantly improves navigation performance and generalization across targets and scenes.
Rodent hippocampal population codes represent important spatial information about the environment during navigation. Several computational methods have been developed to uncover the neural representation of spatial topology embedded in rodent hippocampal ensemble spike activity. Here we extend our previous work and pro…
Agents learn to communicate and solve navigation tasks efficiently.
problem Understanding and developing communication in artificial agents.
method Multi-agent navigation tasks in gridworld environments.
result Agents develop an interpretable communication protocol that optimally solves tasks.
Model place cells as spatial embeddings for efficient path planning and cognitive map construction.
problem Encoding spatial navigation in the hippocampus.
method Model place cells using spectral decomposition of multi-step random walk transition kernels, inducing sparsity and adjacency.
result Place cells encode spatial information through non-negativity and inner-product structure, forming a cognitive map.
A framework for navigating environments with spatially correlated obstacles and uncertain blockage status.
problem Navigation in environments with spatially correlated obstacles of uncertain blockage status.
method Modeling spatial correlation with Gaussian Random Field, developing Bayesian belief updates, proposing a two-stage learning framework with offline and online phases.
result Consistent performance gains over baselines in environments with adversarial interruptions or clustered natural hazards.
Decades of research on the neural code underlying spatial navigation have revealed a diverse set of neural response properties. The Entorhinal Cortex (EC) of the mammalian brain contains a rich set of spatial correlates, including grid cells which encode space using tessellating patterns. However, the mechanisms and fu…
New framework for 3D spatial topology enumeration and identification.
problem Efficient navigation through complex engineering system topologies.
method Mathematical spatial graph theory to represent, enumerate, and identify unique topological classes.
result Identification of distinctive 3D topological classes for engineering systems.
Shielded LMC samples from non-convex spaces with repulsive drift.
problem Sampling from non-convex spaces with convex holes.
method Combining adaptive temperature and repulsive drift.
result Advantages over unconstrained sampling in constrained spaces.
H-STGCN predicts traffic using navigation data and improves accuracy.
problem Limited accuracy in traffic forecasting due to lack of contextual information.
method Proposes H-STGCN, a hybrid spatio-temporal graph convolutional network.
result H-STGCN outperforms state-of-the-art methods in various metrics, especially for non-recurring congestion.
Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous exploration are typically adressed with specialised methods, often relying on detailed …
Modeling vessel speed to balance efficiency and environmental risks in Arctic shipping.
problem Balancing vessel speed with environmental and ecological risks in Arctic shipping.
method Inverse control constrained optimization framework with risk parameters estimated from AIS data.
result Distinct decision-making patterns across vessel types and navigational statuses, with varying sensitivity to ice and whale risks.
We present DRLViz, a visual analytics interface to interpret the internal memory of an agent (e.g. a robot) trained using deep reinforcement learning. This memory is composed of large temporal vectors updated when the agent moves in an environment and is not trivial to understand due to the number of dimensions, depend…
Develops a new neural spike train decoding framework using topological data.
problem Decoding neural spike trains from head direction and grid cells.
method Combines simplicial complex discovery with deep learning to capture higher-order connectivity.
result Demonstrates effectiveness on head direction and trajectory prediction datasets.
EDGI improves sample efficiency and generalization in tasks with spatial and temporal symmetries.
problem Sample inefficiency and poor generalization in tasks with geometric symmetries.
method Equivariant Diffuser framework, SE(3)xZxSn-equivariant diffusion model.
result EDGI is more sample efficient and generalizes better than non-equivariant models.
Deep Convolutional Neural Networks (DCNNs) are used extensively in medical image segmentation and hence 3D navigation for robot-assisted Minimally Invasive Surgeries (MISs). However, current DCNNs usually use down sampling layers for increasing the receptive field and gaining abstract semantic information. These down s…
Introduces a natural parallel translation for navigation data.
problem Navigation data geometric representation and parallelism.
method Introduces a natural parallel translation using Riemannian parallelism.
result The natural parallel translation preserves the Randers norm and has a finite-dimensional holonomy group.
Challenge to separate Earth's magnetic field from vehicle's magnetic field for accurate navigation.
problem Separate Earth's magnetic field from vehicle's magnetic field for accurate magnetic navigation.
method Use machine learning (ML) and integrate physics of magnetic navigation (SciML) to remove aircraft magnetic field from total magnetic field.
result A model can be constructed to effectively remove aircraft magnetic field from the dataset.
Most common navigation tasks in human environments require auxiliary arm interactions, e.g. opening doors, pressing buttons and pushing obstacles away. This type of navigation tasks, which we call Interactive Navigation, requires the use of mobile manipulators: mobile bases with manipulation capabilities. Interactive N…
Navigation in Lorentz Finsler geometry induces isoparametric hypersurfaces.
problem Defining and analyzing isoparametric hypersurfaces in Lorentz Finsler geometry.
method Using a navigation process with a Finsler metric and a tangent vector field, isoparametric functions and hypersurfaces are defined and analyzed.
result Local correspondences between isoparametric functions and hypersurfaces are established.
The paper solves navigation problems on conic Kropina manifolds and establishes curvature relationships.
problem Navigation problems on conic Kropina manifolds.
method Analyzes the solution of navigation problems and establishes curvature relationships.
result The solution to navigation problems on conic Kropina manifolds must be either a Randers metric or a Kropina metric.
Robotic navigation improves with RL and ultrasound images.
problem Improving accuracy in robotic navigation for ultrasound-guided procedures.
method Combines deep Q-networks with ultrasound images and binary classifier.
result Significantly improved navigation accuracy compared to pure RL and SL.
Improved robot navigation using multi-head attention for natural language instructions.
problem Improving robot navigation in unfamiliar environments.
method Proposes a multi-head attention mechanism blending layer in a neural network model.
result Significant performance gains in translating instructions for unseen environments.
Modern navigation services often provide multiple paths connecting the same source and destination for users to select. Hence, ranking such paths becomes increasingly important, which directly affects the service quality. We present PathRank, a data-driven framework for ranking paths based on historical trajectories us…
The problem of pursuing a moving target is always one of the main topics in navigation. In the literatures, there are two well-known algorithms called Pure Pursuit and Pure Rendezvous navigation in the 3-dimensional space R3. In this paper, these two methods are combined to introduce a novel family of pursu…
Mobile robot navigation in complex and dynamic environments is a challenging but important problem. Reinforcement learning approaches fail to solve these tasks efficiently due to reward sparsities, temporal complexities and high-dimensionality of sensorimotor spaces which are inherent in such problems. We present a nov…
SLAM-net learns to navigate visually in challenging indoor environments.
problem Challenges in SLAM for visual robot navigation, especially in noisy conditions.
method Differentiable SLAM Network (SLAM-net) that encodes a particle filter SLAM algorithm in a differentiable graph and learns components through backpropagation.
result Significantly outperforms ORB-SLAM in noisy conditions and improves the Habitat Challenge 2020 PointNav task.
Bayesian model for energy consumption helps electric vehicles navigate efficiently.
problem Limited battery capacity in electric vehicles makes energy efficient navigation challenging.
method Developed an online learning framework using Bayesian models and exploration strategies like Thompson Sampling.
result Established rigorous regret bounds for Thompson Sampling in both single-agent and multi-agent settings.
This work analyzes minimum-time navigation on Riemannian manifolds using Finsler geometry.
problem Minimum-time navigation on Riemannian manifolds.
method Finsler geometry, introducing superwind concept, extending (α,β)-metrics. result Time-minimizing geodesics and necessary/sufficient conditions for strong convexity.
Deep learning agent improves pedestrian navigation in urban environments.
problem Autonomous driving among pedestrians in urban areas.
method Multi-objective deep reinforcement learning using a deep Q-learning variant.
result The multi-objective DQN agent outperforms single-objective DQN in various environments.
Bayesian model for energy-efficient EV navigation.
problem Limited battery capacity in electric vehicles.
method Bayesian modeling and online learning framework with exploration strategies.
result Established rigorous regret bounds for Thompson Sampling.
Solves time-minimizing navigation on a mountain slope using Riemann-Finsler geometry.
problem Time-minimizing navigation on a mountain slope under gravity.
method Riemann-Finsler geometry, Zermelo navigation problem, anisotropic deformation of the background Riemannian metric, rescaled gravitational wind.
result A new Finsler metric for optimal navigation on slippery mountain slopes.
Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning architecture capable of navigating an agent, e.g. a mobile robot, to a target giv…
The paper develops a method to learn navigation costs from expert demonstrations in partially observable environments.
problem Learning navigation costs from expert demonstrations in partially observable environments.
method Develops a cost function representation composed of a probabilistic occupancy encoder and a cost encoder, optimized by differentiating the error between demonstrated controls and a control policy computed from the cost encoder.
result The method outperforms baseline IRL algorithms in robot navigation tasks, improving both training and test-time efficiency.
New algorithms solve time-dependent navigation problems, including zig-zag paths.
problem Finding optimal paths in moving water with varying speed profiles.
method Lorentz-Finsler geometry, novel computational algorithms.
result Optimal paths may involve zig-zag trajectories due to tacking behavior.
VALAN is a lightweight and scalable software framework for deep reinforcement learning based on the SEED RL architecture. The framework facilitates the development and evaluation of embodied agents for solving grounded language understanding tasks, such as Vision-and-Language Navigation and Vision-and-Dialog Navigation…
OtoWorld helps agents learn to navigate by listening in interactive environments.
problem Training agents to navigate using auditory information.
method Interactive environment with agents learning to listen and navigate.
result Agents can win at OtoWorld, a navigation game with sound sources.
New text-to-image diffusion models improve scene understanding for AI agents.
problem Fine-grained scene understanding for AI agents from text and images.
method Pre-trained text-to-image diffusion models optimized for generating images from text prompts.
result Policies learned with Stable Control Representations outperform state-of-the-art approaches on various control tasks.
Paper introduces timing-based adversarial attacks on DRL-based navigation systems.
problem Vulnerability of DRL-based navigation systems to adversarial attacks.
method Timing-based adversarial strategies using physical noise patterns.
result Adversarial timing attacks significantly degrade DRL-based navigation performance.
We consider a setting in which the objective is to learn to navigate in a controlled Markov process (CMP) where transition probabilities may abruptly change. For this setting, we propose a performance measure called exploration steps which counts the time steps at which the learner lacks sufficient knowledge to navigat…
Enhanced visibility forecasts using CAMS data improve accuracy.
problem Improving the accuracy of visibility predictions in weather forecasts.
method Statistical post-processing with historical observations and CAMS forecasts.
result Post-processed forecasts with CAMS data are substantially superior to raw and climatological predictions.
UAV uses RL to navigate, map, and detect targets in unknown environments.
problem Optimizing UAV trajectory for accurate mapping and target detection in unknown environments.
method Formulated as an MDP, UAV uses RL to infer navigation policy.
result UAV autonomously explores high target detection areas while reconstructing the environment.
In this paper, we study Zermelo navigation on Riemannian manifolds and use that to solve a long standing problem in Finsler geometry. Namely, the complete classification of strongly convex Randers metrics of constant flag curvature.
This research introduces an autonomous robot navigation method using reinforcement learning.
problem Improving robot navigation in complex environments.
method Deep Q Network (DQN) and Proximal Policy Optimization (PPO) models for path planning and decision-making.
result The models enhance robot navigation ability and adaptive learning in unknown environments.
Paper presents a self-supervised method to infer road lane networks.
problem Difficult and costly to create lane maps for autonomous vehicles.
method Self-supervised learning using neural and search-based model.
result Model can generalize to new road layouts, unlike previous approaches.
Channel charting (CC) has been proposed recently to enable logical positioning of user equipments (UEs) in the neighborhood of a multi-antenna base-station solely from channel-state information (CSI). CC relies on dimensionality reduction of high-dimensional CSI features in order to construct a channel chart that captu…
We present a novel human-aware navigation approach, where the robot learns to mimic humans to navigate safely in crowds. The presented model, referred to as DeepMoTIon, is trained with pedestrian surveillance data to predict human velocity in the environment. The robot processes LiDAR scans via the trained network to n…
Consider an assistive system that guides visually impaired users through speech and haptic feedback to their destination. Existing robotic and ubiquitous navigation technologies (e.g., portable, ground, or wearable systems) often operate in a generic, user-agnostic manner. However, to minimize confusion and navigation …
Study optimal paths in Zermelo's navigation problem using geometric equations.
problem Optimal control paths in Zermelo's navigation problem.
method Geometric and differential equations approach to obtain precise ODE system.
result Obtained precise equations for optimal trajectories.