The paper reviews machine learning safety techniques for autonomous vehicles.
problem Challenges in machine learning safety for autonomous vehicles.
method Organizes practical safety techniques to complement engineering safety.
result Enhances dependability and safety of machine learning algorithms in autonomous vehicles.
An active area of research is to increase the safety of self-driving vehicles. Although safety cannot be guarenteed completely, the capability of a vehicle to predict the future trajectories of its surrounding vehicles could help ensure this notion of safety to a greater deal. We cast the trajectory forecast problem in…
CitySim dataset captures vehicle trajectories for safety research.
problem Lack of fine-grain vehicle trajectories for safety-oriented research.
method Five-step procedure: video stabilization, object filtering, stitching, detection, and error filtering.
result CitySim dataset improves safety evaluations and facilitates digital-twin research.
This work improves safety validation of autonomous vehicles by finding interpretable failures.
problem Finding interpretable failures of autonomous systems in simulation.
method Signal temporal logic expressions optimized for high likelihood and human interpretability.
result Our methodology finds more interpretable failures with higher likelihood compared to baseline approaches.
New approach uses dynamic programming to efficiently discover failures in autonomous vehicle simulations.
problem Efficiently discovering rare failure events in autonomous vehicle simulations.
method Approximate dynamic programming and scene decomposition to estimate failure distribution.
result Increased number of failures discovered compared to baseline approaches.
Model forecasts motor vehicle collision rates with high accuracy.
problem Forecasting motor vehicle collision rates with high accuracy.
method Adopted Heston Stochastic Volatility model and extended it to account for seasonality and accelerated safety periods.
result Short-term forecasts show high accuracy (over 95%) and outperform existing models.
This paper compares uncertainty estimation methods for deep learning in autonomous vehicles.
problem Ensuring safety in autonomous vehicles through accurate uncertainty quantification in deep learning models.
method A comparative survey of uncertainty quantification methods in deep neural networks.
result Different methods for uncertainty quantification in DNNs have advantages and downsides for specific AV tasks and types of uncertainty.
This paper compares machine learning methods for recognizing lane change intentions from vehicle trajectories.
problem Accurately detecting and predicting lane change processes in autonomous vehicles.
method Comparison of different machine learning methods on high-dimensional time series data.
result Ensemble methods reduce Type II and Type III classification errors, while LightGBM outperforms XGBoost in training efficiency.
Safe RL for autonomous vehicles using PCPO with trust regions and parallel learners.
problem Unexplainable behaviours and lack of safety guarantees in RL for real vehicles.
method PCPO framework with trust regions and parallel learners.
result Safe learning confirmed for autonomous vehicles with fast convergence.
The safety and resilience of fully autonomous vehicles (AVs) are of significant concern, as exemplified by several headline-making accidents. While AV development today involves verification, validation, and testing, end-to-end assessment of AV systems under accidental faults in realistic driving scenarios has been lar…
New risk metric for AI systems reduces safety risks with minimal data.
problem Risk assessment in multi-agent AI systems.
method Free Energy Principle applied to risk metrics, introducing Cumulative Risk Exposure.
result Gatekeepers improve system safety in autonomous vehicle fleets.
This work improves vehicle trajectory prediction for safer self-driving cars.
problem Improving trajectory predictions for safer self-driving cars.
method Deep-learning-based method combining AI and physically grounded models.
result Proposes a method that outperforms existing state-of-the-art.
A novel controller for wheeled robots handles joystick inputs for smooth steering.
problem Steering control for differential-drive wheeled robots from indirect joystick inputs.
method Developed a geometric controller based on Darboux frame kinematics.
result Smooth trajectories achieved with safety constraints and no desired states.
SECRM-2D improves RL-based autonomous driving with safety guarantees.
problem Safety and efficiency trade-offs in RL-based autonomous driving.
method RL-based controller with safety constraints for efficient and comfortable driving.
result SECRM-2D avoids crashes and improves efficiency and comfort compared to baselines.
Automated testing framework finds weaknesses in deep control policies.
problem Safety of deep neural network control policies is difficult to validate.
method Adversarial reinforcement learning to test and find weaknesses.
result Framework finds weaknesses not evident during manual testing.
Predict real-time crash risks during hurricane evacuations using connected vehicle data.
problem Mitigate crash risks during hurricane evacuations by predicting high-risk locations.
method Used connected vehicle data to predict crash risks in real-time, considering weather and traffic features.
result Gaussian Process Boosting and Extreme Gradient Boosting models performed best, with recall of 0.91.
Improved vehicle motion prediction with uncertainty estimation.
problem Robust motion prediction for autonomous vehicles, especially under distributional shift.
method Presented an approach significantly improving the benchmark and taking 2nd place on the leaderboard.
result Significantly improved motion prediction and uncertainty measurement.
Safe reinforcement learning for autonomous vehicles using prediction constraints.
problem Safe reinforcement learning for safety-critical applications like autonomous vehicles.
method Use prediction to constrain exploration in reinforcement learning models.
result Successfully learned intersection handling behaviors on an autonomous vehicle.
Study uses vehicle trajectory data to predict traffic incidents on highways.
problem Early detection of traffic incidents to reduce secondary crashes.
method Machine learning algorithms (Logistic Regression, Random Forest, Extreme Gradient Boost, Artificial Neural Network) applied to vehicle trajectory data.
result Random Forest model performs best for incident prediction.
Reinforcement Learning (RL) algorithms have found limited success beyond simulated applications, and one main reason is the absence of safety guarantees during the learning process. Real world systems would realistically fail or break before an optimal controller can be learned. To address this issue, we propose a cont…
A tree-based IDS detects cyber-attacks in AV networks.
problem Cyber-attacks in AV and IoV networks.
method Tree-structure machine learning models, ensemble learning, feature selection.
result High detection rate and low computational cost achieved.
Situational awareness in vehicular networks could be substantially improved utilizing reliable trajectory prediction methods. More precise situational awareness, in turn, results in notably better performance of critical safety applications, such as Forward Collision Warning (FCW), as well as comfort applications like …
Automated vehicles need efficient testing, which this method addresses.
problem Current testing practices are insufficient for automated vehicles.
method Gaussian Process Classification to identify performance boundaries.
result It is feasible to test for challenging scenarios more efficiently.
Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems using machine-learning and deep-learning models, such as automated-driving vehicles. Quality assurance frameworks are required for such machine learning systems, but there are no widely accepted and established quality-assurance …
Research tackles safety of deep learning in safety-critical tasks.
problem Safety concerns of deep learning in perception tasks for autonomous agents.
method Technical enumeration and discussions on safety concerns and mitigation methods.
result Need for more mitigation methods to ensure safety of deep learning.
Deep learning maps road safety features from streetview imagery.
problem Accurate mapping of road safety features for safer roads.
method Proposes a deep learning approach with LSTM to capture spatial autocorrelation.
result Model outperforms baseline methods in mapping road safety features.
A novel observer-based method detects and recovers anomalies in CAV sensor readings.
problem Improving safety and security in connected and automated vehicles.
method Combines model-based signal filtering and anomaly detection methods using AEKF and OCSVM.
result The proposed method achieves better anomaly detection performance compared to traditional methods.
Deep learning improves vehicle control performance and generalizes well.
problem Designing a controller for autonomous vehicles in diverse scenarios.
method Application of deep learning methods for vehicle control.
result Deep learning methods provide excellent performance and generalization.
Survey of algorithms for testing AI-driven CPS safety.
problem Testing AI-driven CPS for safety in complex environments.
method Survey of applied algorithms for safety validation.
result Survey of existing tools and techniques for safety validation.
Paper discovers manoeuvres from vehicle telematics data.
problem Analyzing driving behaviour from vehicle data.
method Used motif detection in time-series with a modified EMD algorithm.
result Validated motif discovery for complex manoeuvres.
The paper evaluates and improves uncertainty estimates in neural networks for safety-critical applications.
problem Quantifying uncertainty in neural networks for safety-critical systems.
method Proposes a statistical test for evaluating uncertainty realism in neural networks and transfers a classification architecture to image-to-image tasks.
result The variational U-Net architecture significantly improves uncertainty realism in image-to-image tasks compared to a plain model.
Safety evaluation of self-driving technologies has been extensively studied. One recent approach uses Monte Carlo based evaluation to estimate the occurrence probabilities of safety-critical events as safety measures. These Monte Carlo samples are generated from stochastic input models constructed based on real-world d…
Automated vehicles learn to predict upcoming maneuvers with high accuracy.
problem Making self-driving cars feel safer by anticipating future actions.
method Machine learning techniques applied to a large dataset of real-world driving.
result Automated vehicles can predict maneuvers up to 5 seconds in advance with high accuracy.
The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers may not be ideal. Similarly, it may not be effective to design an a-priori cost…
While machine learning systems show high success rate in many complex tasks, research shows they can also fail in very unexpected situations. Rise of machine learning products in safety-critical industries cause an increase in attention in evaluating model robustness and estimating failure probability in machine learni…
Automated road infrastructure mapping using connected vehicle data and deep learning.
problem Manual identification of intersections is laborious and time-consuming.
method Geohashing, YOLOv5 algorithm for classification of road segments and intersections.
result Overall classification accuracy of 95%, with high F1 scores for straight roads and intersections.
Scenario-based testing for the safety validation of highly automated vehicles is a promising approach that is being examined in research and industry. This approach heavily relies on data from real-world scenarios to derive the necessary scenario information for testing. Measurement data should be collected at a reason…
We demonstrate the first application of deep reinforcement learning to autonomous driving. From randomly initialised parameters, our model is able to learn a policy for lane following in a handful of training episodes using a single monocular image as input. We provide a general and easy to obtain reward: the distance …
Paper introduces zero-space memory protection for CNNs without ECC overhead.
problem Ensuring reliability of CNNs in safety-critical applications.
method In-place zero-space ECC with weight distribution-oriented training.
result First known zero-space cost memory protection for CNNs.
This paper surveys DRL for autonomous vehicle motion planning.
problem Designing intelligent motion planning for autonomous vehicles.
method Deep Reinforcement Learning (DRL) for hierarchical motion planning.
result Survey of state-of-the-art DRL solutions for autonomous vehicle motion planning.
The paper proposes an on-line monitoring framework for continuous real-time safety/security in learning-based control systems (specifically application to a unmanned ground vehicle). We monitor validity of mappings from sensor inputs to actuator commands, controller-focused anomaly detection (CFAM), and from actuator c…
Study improves self-driving safety in dynamic environments.
problem Safe self-driving in non-stationary urban settings.
method Neurosymbolic Meta-Reinforcement Lookahead Learning (NUMERLA).
result Self-driving agents can adapt safely in real-time.
To improve efficiency and reduce failures in autonomous vehicles, research has focused on developing robust and safe learning methods that take into account disturbances in the environment. Existing literature in robust reinforcement learning poses the learning problem as a two player game between the autonomous system…
TensorFI injects faults in TensorFlow programs to assess their reliability.
problem Ensuring reliability of machine learning systems in safety-critical domains.
method TensorFI is a flexible fault injection framework for TensorFlow applications.
result TensorFI evaluates the resilience of 12 ML programs, including autonomous vehicle DNNs.
This paper improves transportation efficiency by teaching automated vehicles to cooperate.
problem Improving efficiency and safety of transportation systems with automated vehicles.
method Multi-agent graph reinforcement learning with attention mechanism.
result Automated vehicles can achieve better performance when learning to cooperate with each other.
Adaptive vehicle trajectory prediction for safer autonomous driving.
problem Inability of current methods to guarantee physical feasibility and adapt to human driving policies.
method Bayesian recurrent neural network combining policy and physical models, with gradient-based training and parameter adaptation.
result The proposed method ensures physical feasibility and adaptability to human driving policies.
BAMS uses Bayesian sampling to discover AV failures more efficiently and accurately.
problem Discovering potential failure cases in autonomous vehicles efficiently and accurately.
method Bayesian adaptive multifidelity sampling (BAMS) prioritizes exploration of low performance regions.
result BAMS discovers 10 times more issues than traditional methods with narrower rate estimates.
Evaluation and validation of complicated control systems are crucial to guarantee usability and safety. Usually, failure happens in some very rarely encountered situations, but once triggered, the consequence is disastrous. Accelerated Evaluation is a methodology that efficiently tests those rarely-occurring yet critic…