A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
This paper explores formal verification for autonomous systems, identifying limitations and proposing improvements.
Classifier-based AI safety gates fail in self-improvement, even with advanced verification methods.
PEREGRiNN verifies safety of ReLU NNs by penalizing relaxation in a greedy manner.
Autonomous vehicles rely on machine learning to solve challenging tasks in perception and motion planning. However, automotive software safety standards have not fully evolved to address the challenges of machine learning safety such as interpretability, verification, and performance limitations. In this paper, we revi…
Abstract Neural Networks (ANNs) improve DNN verification efficiency.
Develops first robustness verification for complex Transformers.
Recent advances in machine learning and artificial intelligence are now being considered in safety-critical autonomous systems where software defects may cause severe harm to humans and the environment. Design organizations in these domains are currently unable to provide convincing arguments that their systems are saf…
Despite the tremendous advances that have been made in the last decade on developing useful machine-learning applications, their wider adoption has been hindered by the lack of strong assurance guarantees that can be made about their behavior. In this paper, we consider how formal verification techniques developed for …
Theoretical limits on verifying self-improving systems without risking unbounded utility.
The safety and resilience of fully autonomous vehicles (AVs) are of significant concern, as exemplified by several headline-making accidents. While AV development today involves verification, validation, and testing, end-to-end assessment of AV systems under accidental faults in realistic driving scenarios has been lar…
DIFFRNN verifies RNNs for safety and equivalence.
GPUPoly verifies large neural networks robustly on GPUs.
Deep neural networks have achieved impressive experimental results in image classification, but can surprisingly be unstable with respect to adversarial perturbations, that is, minimal changes to the input image that cause the network to misclassify it. With potential applications including perception modules and end-t…
Safe learning of stochastic dynamics with safety constraints.
Survey of algorithms for testing AI-driven CPS safety.
To use neural networks in safety-critical settings it is paramount to provide assurances on their runtime operation. Recent work on ReLU networks has sought to verify whether inputs belonging to a bounded box can ever yield some undesirable output. Input-splitting procedures, a particular type of verification mechanism…
Accelerates DNN robustness verification with target labels.
Formal verification of neural networks is essential for their deployment in safety-critical areas. Many available formal verification methods have been shown to be instances of a unified Branch and Bound (BaB) formulation. We propose a novel framework for designing an effective branching strategy for BaB. Specifically,…
NeuroDiff improves neural network equivalence verification with fine-grained approximations.
The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN model satisfies certain input-output properties. Despite the reputation of learned …
Artificial Neural Networks (ANNs) have demonstrated remarkable utility in various challenging machine learning applications. While formally verified properties of their behaviors are highly desired, they have proven notoriously difficult to derive and enforce. Existing approaches typically formulate this problem as a p…
Verifying correctness of deep neural networks (DNNs) is challenging. We study a generic reachability problem for feed-forward DNNs which, for a given set of inputs to the network and a Lipschitz-continuous function over its outputs, computes the lower and upper bound on the function values. Because the network and the …
Paper proposes a dataset quality process for ML systems.
This paper provides a comprehensive benchmark and taxonomy for certifiably robust DNN defenses.
DeepDyve uses simpler neural networks to verify DNNs for faults.
Advances in the field of Machine Learning and Deep Neural Networks (DNNs) has enabled rapid development of sophisticated and autonomous systems. However, the inherent complexity to rigorously assure the safe operation of such systems hinders their real-world adoption in safety-critical domains such as aerospace and med…
Revel tackles safe exploration in RL with verified symbolic policies.
Generalizes neural network verification by adding arbitrary cutting planes.
Debona improves neural network verification by faster and tighter bounds.
Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world systems. As a consequence, learning algorithms are rarely applied on safety-crit…
Paper proves neural networks can be approximated using interval bounds.
Two impossibility theorems show formal alignment certification is impossible for AI systems.
Formalizes weak and strong verification for LLMs, controlling errors without assumptions.
Despite the improved accuracy of deep neural networks, the discovery of adversarial examples has raised serious safety concerns. In this paper, we study two variants of pointwise robustness, the maximum safe radius problem, which for a given input sample computes the minimum distance to an adversarial example, and the …
PRoA assesses deep learning robustness against practical functional perturbations.
Deep neural networks (DNNs) are increasingly being adopted for sensing and control functions in a variety of safety and mission-critical systems such as self-driving cars, autonomous air vehicles, medical diagnostics, and industrial robotics. Failures of such systems can lead to loss of life or property, which necessit…
ANNs predict SAFARI-1 neutron fluxes with uncertainties.
Paper develops PAC verification for hypothesis classes and statistical algorithms.
Hypothesis testing is an important problem with applications in target localization, clinical trials etc. Many active hypothesis testing strategies operate in two phases: an exploration phase and a verification phase. In the exploration phase, selection of experiments is such that a moderate level of confidence on the …
We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more easily. To this end, we identify two properties of network models - weight sparsity a…
New methods combat data poisoning attacks in bandit algorithms using limited verification.
In this paper we demonstrate that performance of a speaker verification system can be improved by concatenating electroencephalography (EEG) signal features with speech signal features or only using EEG signal features. We use state-of-the-art end-to-end deep learning model for performing speaker verification and we de…
Improves neural network verification by merging abstract domains and Lagrangian methods.
Paper develops a model for verifying facts in tables without pre-retrieved evidence.
The increasing inclusion of Machine Learning (ML) models in safety critical systems like autonomous cars have led to the development of multiple model-based ML testing techniques. One common denominator of these testing techniques is their assumption that training programs are adequate and bug-free. These techniques on…
Efficiently verifies neural networks by handling neuron splits, improving speed and accuracy.
RLVR maintains safety while improving reasoning capabilities in LLMs.
Researchers find floating point errors can mislead neural network verifiers.