A hierarchical DNN model for end-to-end driving tasks.
problem End-to-end driving tasks with various challenges.
method Hierarchical multi-task DNN architecture with subservient networks for specific tasks.
result Reduction in training data and tailored model complexity for different tasks.
Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main task of predicting the driving commands. Our framework involves an end-to-end tr…
Novel RL method handles urban driving tasks including traffic lights.
problem Difficulties in reinforcement learning for complex urban driving tasks.
method Implicit affordances for model-free RL.
result Successfully handles urban driving tasks including traffic lights.
Unified model for automated driving tasks improves efficiency and accuracy.
problem Efficiently handle multiple visual perception tasks in automated driving systems.
method Joint multi-task network design sharing convolutional layers, multi-stream learning, auxiliary learning.
result Unified model outperforms single-task models in many cases.
Deep RL mimics human driving for collision avoidance in self-driving cars.
problem Developing human-like driving policies for autonomous vehicles in mixed traffic environments.
method Model-free, deep reinforcement learning approach using a combination of rule-based and expert-driven data.
result Demonstrated human-like driving policies through Gaussian process modeling of track position and speed distributions.
Paper tackles anomaly detection in driving data, improving AI system performance.
problem Detecting rare anomalous driving situations in safety-critical AI systems.
method Semi-supervised multi-task learning using maneuver labels for imbalanced data.
result Improved anomaly detection performance on real-world driving data.
Decision making in automated driving is highly specific to the environment and thus semantic segmentation plays a key role in recognizing the objects in the environment around the car. Pixel level classification once considered a challenging task which is now becoming mature to be productized in a car. However, semanti…
The paper proposes a machine learning method to detect drivers' affective states using physiological signals.
problem Detecting and assessing drivers' affective states to improve driving safety and well-being.
method Multiview multi-task machine learning approach using physiological signals.
result Accounting for drive-specific differences significantly improves model performance.
SoilingNet detects soiling on automotive cameras for better autonomous driving performance.
problem Soiling degrades the performance of automotive surround-view cameras, affecting autonomous driving.
method Created a new dataset and used a Convolutional Neural Network (CNN) architecture for soiling detection, combined with multi-task learning and data augmentation using GANs.
result Demonstrated high accuracy in soiling detection using CNN and multi-task learning.
Reduces car control labels to simplify autonomous driving.
problem Redundant labels in semantic maps hinder efficient autonomous driving.
method Quantifies label importance for car control, simplifies labels.
result Reduced labels improve efficiency and simplify autonomous driving tasks.
A novel framework interprets driving patterns using Action phases clustering.
problem Challenges in comprehending driving heterogeneity from underlying behavior mechanisms.
method Resampling and Downsampling Method (RDM) followed by iterative clustering calibration.
result Six driving patterns identified in real-world datasets, revealing dynamic nature of driving.
WoodScape dataset for fisheye cameras in autonomous driving.
problem Lack of public datasets for evaluating computer vision on fisheye images.
method Release WoodScape dataset with four surround view cameras and nine tasks.
result Encourages adaptation of computer vision models for fisheye cameras.
We demonstrate the first application of deep reinforcement learning to autonomous driving. From randomly initialised parameters, our model is able to learn a policy for lane following in a handful of training episodes using a single monocular image as input. We provide a general and easy to obtain reward: the distance …
Paper proposes a new method for efficient exploration in reinforcement learning.
problem Sparse reward reinforcement learning challenges in exploration.
method Learn separate intrinsic and extrinsic task policies, schedule between them, and use successor feature control (SFC).
result Substantially improved exploration efficiency with SFC and hierarchical usage of intrinsic drives.
UAIL uses uncertainty estimation to improve control systems in safety-critical tasks.
problem Improving control systems in safety-critical domains like autonomous driving.
method UAIL applies Monte Carlo Dropout to estimate uncertainty in control output and selectively acquire new training data.
result UAIL can reliably predict infractions and outperforms existing algorithms.
Neural networks have become the standard model for various computer vision tasks in automated driving including semantic segmentation, moving object detection, depth estimation, visual odometry, etc. The main flavors of neural networks which are used commonly are convolutional (CNN) and recurrent (RNN). In spite of rap…
Deep neural network learns compact representations for driving tasks.
problem Improving autonomous driving through better neural network representations.
method Inspired by human brain's hierarchical structure and predictive nature, the paper proposes a deep learning framework that learns compact representations of driving concepts.
result The paper successfully learns compact representations using as few as 16 neural units for car and lane concepts.
Paper tackles AI driving competition challenges with mixed simulation and real-world data.
problem AI algorithms perform poorly in real-world environments compared to simulated ones and vice versa.
method Employed imitation learning on a mixed dataset to train algorithms equally well in all environments.
result Trained algorithms performed well in both simulated and real-world environments.
Deep RL for multi-agent autonomous driving in dynamic environments.
problem Adapting to dynamic, multi-agent driving environments.
method Formulated Partially Observable Markov Games (POSG) for multi-agent learning.
result Demonstrated successful training of multi-agent control policies.
Waymo Open Dataset provides a large, diverse, and synchronized LiDAR and camera dataset for autonomous driving research.
problem Limited diversity and scale in existing self-driving datasets hinder real-world problem alignment.
method Developed a new large-scale, high-quality, diverse dataset with synchronized LiDAR and camera data.
result The dataset is 15x more diverse than the largest existing dataset based on a proposed diversity metric.
Benchmark for DL inference on embedded HWAs, focusing on autonomous driving.
problem Lack of comprehensive benchmarks for DL hardware.
method Developed a benchmark for inference on embedded HWAs, focusing on autonomous driving. Proposed new granularity, benchmark procedures, and performance indicators.
result Identifies mismatches between HWAs and DL models.
Paper tackles drowsy driving by learning from weakly labeled car acceleration data.
problem Lack of labeled data for estimating driver drowsiness.
method Weakly supervised learning, scalable stochastic optimization.
result Algorithm learns from weakly labeled data, outperforming baseline methods.
Deep Q-learning analyzes EEG for drowsiness during driving tests.
problem Estimating drowsiness during driving to improve safety.
method Adapting Q-learning to EEG data for drowsiness estimation.
result Trained model accurately tracks mind state variations in EEG data.
Semantic segmentation remains a computationally intensive algorithm for embedded deployment even with the rapid growth of computation power. Thus efficient network design is a critical aspect especially for applications like automated driving which requires real-time performance. Recently, there has been a lot of resea…
The paper uses deep reinforcement learning to control autonomous lane changes safely.
problem Safe and efficient autonomous lane changes in vehicles.
method Deep Q-networks and quadratic approximators for decision-making and control.
result Demonstrated effectiveness in simulations for decision-making and control.
A deep reinforcement learning method with rule-based constraints improves safe and efficient lane changes in autonomous driving.
problem Complex and uncertain traffic environment challenges autonomous driving decision-making.
method Deep Q-Network (DQN) combined with rule-based constraints for lane change decision-making.
result The proposed rule-based DQN method outperforms both rule-based and DQN approaches in a real-world simulator.
Improved vehicle motion prediction with uncertainty estimation.
problem Robust motion prediction for autonomous vehicles, especially under distributional shift.
method Presented an approach significantly improving the benchmark and taking 2nd place on the leaderboard.
result Significantly improved motion prediction and uncertainty measurement.
Deep Reinforcement Learning (DRL) has become increasingly powerful in recent years, with notable achievements such as Deepmind's AlphaGo. It has been successfully deployed in commercial vehicles like Mobileye's path planning system. However, a vast majority of work on DRL is focused on toy examples in controlled synthe…
RL agent learns to smoothly change lanes in a dynamic driving environment.
problem Challenging lane change control with safety and comfort.
method Formulated continuous action for lane change in DDPG algorithm, defined reward function for learning.
result Successfully changed lanes with 100% success rate in diverse driving situations.
Autonomous driving is getting a lot of attention in the last decade and will be the hot topic at least until the first successful certification of a car with Level 5 autonomy. There are many public datasets in the academic community. However, they are far away from what a robust industrial production system needs. Ther…
KEMP predicts long-term trajectories for autonomous driving using keyframes.
problem Predicting future trajectories of road agents for autonomous driving.
method Keyframe-based hierarchical end-to-end deep learning framework.
result Ranked 1st on Waymo Open Motion Dataset Leaderboard.
Proposes CTSDG model for better vehicle intention prediction across domains.
problem Domain generalization for vehicle intention prediction in dynamic environments.
method Structural causal model with recurrent latent variable integration.
result Consistent improvement in prediction accuracy compared to state-of-the-art methods.
Decodes neural activity to assess latent states in real-world driving tasks.
problem Understanding latent states during complex tasks in natural settings.
method Domain-generalized models trained on controlled lab paradigms applied to ecologically valid driving tasks.
result Changes in neural activity correlate with changes in behavior and task performance.
Study uses LCRN to detect driver distraction from EEG signals.
problem Improving road safety by detecting driver distraction.
method Used a Long-term Recurrent Convolutional Network (LCRN) for EEG-based driver distraction detection.
result LCRN model outperformed state-of-the-art TSC models in detecting driver distraction.
Deep neural network detects driver intentions from video.
problem Detecting driver intentions for safer self-driving.
method Uses deep learning to analyze turn signals and emergency flashers.
result High per-frame accuracy in challenging scenarios.
Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured urban roadways. Since there are many possible scenarios, manually tackling all po…
Develops methods to improve reliability of deep learning for autonomous driving.
problem Safety concerns in deploying autonomous driving systems.
method Introduces a new criterion (true class probability) for estimating model confidence and learns it from data.
result Proposed method provides better failure prediction than current uncertainty measures.
A method predicts driving intentions of human-driven vehicles for safer autonomous driving.
problem Predicting timely driving intentions of human-driven vehicles for autonomous vehicles in mixed traffic.
method A Hidden Markov Model (HMM) approach using continuous mobility features.
result HMMs trained with continuous mobility features improve prediction accuracy.
Investment decisions can benefit from incorporating an accumulated knowledge of the past to drive future decision making. We introduce Continual Learning Augmentation (CLA) which is based on an explicit memory structure and a feed forward neural network (FFNN) base model and used to drive long term financial investment…
Self-driving technology is advancing rapidly --- albeit with significant challenges and limitations. This progress is largely due to recent developments in deep learning algorithms. To date, however, there has been no systematic comparison of how different deep learning architectures perform at such tasks, or an attemp…
With the development of cloud computing and big data, the reliability of data storage systems becomes increasingly important. Previous researchers have shown that machine learning algorithms based on SMART attributes are effective methods to predict hard drive failures. In this paper, we use SMART attributes to predict…
Improved road segmentation on low-res LIDAR data for autonomous vehicles.
problem Low-resolution LIDAR data affects road segmentation accuracy in autonomous vehicles.
method Subsampled LIDAR data transformation into feature maps, use local normal vector with spherical coordinates.
result Improves road segmentation accuracy on low-resolution LIDAR data.
We address one of the crucial aspects necessary for safe and efficient operations of autonomous vehicles, namely predicting future state of traffic actors in the autonomous vehicle's surroundings. We introduce a deep learning-based approach that takes into account a current world state and produces raster images of eac…
Dynamic functional connectivity (FC) has in recent years become a topic of interest in the neuroimaging community. Several models and methods exist for both functional magnetic resonance imaging (fMRI) and electroencephalography (EEG), and the results point towards the conclusion that FC exhibits dynamic changes. The e…
ProMoD models human race drivers with probabilistic movement primitives and neural networks.
problem Challenging task of modeling human driver behavior due to variability and complexity.
method Modular framework with Probabilistic Movement Primitives, clothoids, and neural networks.
result Significant advantages in imitation accuracy and robustness compared to other algorithms.
Shifts dataset evaluates uncertainty in real-world tasks across modalities.
problem Lack of standard datasets for evaluating uncertainty estimation and robustness to distributional shift.
method Proposes Shifts Dataset for evaluation of uncertainty estimates and robustness to distributional shift across tabular, audio, text, and sensor data.
result Baseline results for tabular weather prediction, machine translation, and SDC vehicle motion prediction.
CoCoRL learns safe constraints from demonstrations with unknown rewards.
problem Learning safe constraints from demonstrations with different unknown rewards.
method Convex Constraint Learning for Reinforcement Learning (CoCoRL) constructs a convex safe set based on demonstrations.
result CoCoRL learns constraints that lead to safe driving behavior and can safely transfer to different tasks and environments.
Generative model improves safety in self-driving simulators and human motion generation.
problem Improving generative models for constrained domains like safety-critical applications.
method Developed Gen-neG, a denoising diffusion model that uses oracle-assisted guidance.
result Empirically validated Gen-neG for collision avoidance and safety-guarded human motion generation.