The paper uses conformal prediction to monitor CPS with machine learning components.
problem Ensuring trustworthy CPS with machine learning components.
method Conformal prediction framework for real-time assurance monitoring of CPS with machine learning.
result The method provides well-calibrated confidence and limits the number of alarms.
A novel ML verification technique using manifold learning.
problem Ensuring trust in machine learning systems.
method Variational autoencoder for extracting a low-dimensional manifold from high-dimensional training data.
result The manifold provides diverse test data, fault-revealing test cases, and independent runtime trust assessment.
Novel framework monitors cardiac image segmentation models in real-time.
problem Ensuring continuous high model performance and segmentation results in clinics.
method Formulated as anomaly detection, the framework derives surrogate quality measures for segmentation.
result Demonstrated accurate, fast, and scalable quality control monitoring.
Proposes real-time risk monitoring for machine learning systems under unknown shifts.
problem Dynamic distribution shifts challenge real-world machine learning systems' risk assurances.
method Sequential hypothesis testing with 'testing by betting' to detect risk violations.
result Effective real-time risk monitoring under various unknown shifts.
The paper proposes an on-line monitoring framework for continuous real-time safety/security in learning-based control systems (specifically application to a unmanned ground vehicle). We monitor validity of mappings from sensor inputs to actuator commands, controller-focused anomaly detection (CFAM), and from actuator c…
A new process model for machine learning applications with quality assurance.
problem Lack of standard process model for machine learning applications.
method Six-phase process model with quality assurance methodology.
result Proposes a new process model for machine learning applications.
New framework uses OR to ensure AI systems make safe decisions.
problem Ensuring generative AI systems make safe decisions as they gain autonomy.
method Developed a conceptual framework combining flow-based models and adversarial robustness.
result Increased autonomy requires new OR approaches for feasibility, robustness, and stress testing.
As technology become more advanced, those who design, use and are otherwise affected by it want to know that it will perform correctly, and understand why it does what it does, and how to use it appropriately. In essence they want to be able to trust the systems that are being designed. In this survey we present assura…
People who design, use, and are affected by autonomous artificially intelligent agents want to be able to \emph{trust} such agents -- that is, to know that these agents will perform correctly, to understand the reasoning behind their actions, and to know how to use them appropriately. Many techniques have been devised …
This work bridges outlier and drift detection by comparing inputs to a part of the reference distribution.
problem Monitoring machine learning models to ensure they operate within their validated distribution.
method Comparing a set of inputs to a chosen part of the reference distribution.
result A new approach that bridges outlier detection and drift detection.
Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems using machine-learning and deep-learning models, such as automated-driving vehicles. Quality assurance frameworks are required for such machine learning systems, but there are no widely accepted and established quality-assurance …
The paper optimizes exceptions in a statistical production system using machine learning.
problem Lack of curated and labeled training data for machine learning in data quality assurance.
method Explainable supervised machine learning to identify and prioritize exceptions.
result Improvement in the quality and efficiency of exceptions generated and authenticated by users.
The paper designs neural networks with assurance for controlling nonlinear systems.
problem Designing neural networks with assurance for nonlinear system control.
method Bounding the number of affine functions needed for a CPWA function, connecting it to a TLL NN architecture.
result The TLL NN architecture is parameterized by the number of affine functions in the CPWA function it realizes.
Machine learning has evolved into an enabling technology for a wide range of highly successful applications. The potential for this success to continue and accelerate has placed machine learning (ML) at the top of research, economic and political agendas. Such unprecedented interest is fuelled by a vision of ML applica…
In recent years, car makers and tech companies have been racing towards self driving cars. It seems that the main parameter in this race is who will have the first car on the road. The goal of this paper is to add to the equation two additional crucial parameters. The first is standardization of safety assurance --- wh…
Deep learning calibrates CO2 storage formations from seismic and well data.
problem Uncertainty in CO2 storage formation properties.
method Two deep learning models for well and seismic data, integrated into MCMC history matching.
result Significant uncertainty reduction in key parameters and accurate CO2 plume predictions.
We provide sufficient conditions assuring that a suitably decorated 2-polyhedron can be thickened to a compact 4-dimensional Stein domain. We also study a class of flat polyhedra in 4-manifolds and find conditions assuring that they admit Stein, compact neighborhoods. We base our calculations on Turaev's shadows suitab…
Advances in the field of Machine Learning and Deep Neural Networks (DNNs) has enabled rapid development of sophisticated and autonomous systems. However, the inherent complexity to rigorously assure the safe operation of such systems hinders their real-world adoption in safety-critical domains such as aerospace and med…
Develops ML-DQA for healthcare data quality assurance.
problem Inconsistent use of real-world data in machine learning projects.
method Develops ML-DQA framework based on RWD best practices.
result Five generalizable practices emerge from ML-DQA implementation.
Two novel models predict bus travel times with uncertainty, improving connection assurance.
problem Improving bus connection assurance by handling travel time uncertainty.
method Two novel approaches: Deep Quantile Regression (DQR) and Bayesian Recurrent Neural Networks (BRNN).
result DQR model performs best for 80%, 90%, and 95% prediction intervals, with small underestimation.
Given a properly embedded graph Gamma in a ball B and a punctured sphere Sigma properly embedded in B - Gamma, we examine the conditions on Gamma that are necessary to assure that Sigma is boundary parallel.
Owing to the expeditious growth in the information and communication technologies, smart cities have raised the expectations in terms of efficient functioning and management. One key aspect of residents' daily comfort is assured through affording reliable traffic management and route planning. Comprehensively, the majo…
We study the geometry of the leaf closure space of regular and singular Riemannian foliations. We give conditions which assure that this leaf space is a singular symplectic or Kähler space.
New AI governance framework tackles risks in finance.
problem Risks from evolving AI models in finance.
method Agent-based framework with modular governance architecture.
result Controls quarantine harmful behavior in real time.
We present a simple remark that assures that the invariant theory of certain real Lie groups coincides with that of the underlying affine, real algebraic groups. In particular, this result applies to the non-compact orthogonal or symplectic Lie groups.
AI systems that explain their decisions can be monitored for harmful intentions.
problem Monitoring AI systems' decision-making processes for harmful intentions is imperfect and can miss some misbehavior.
method Monitoring the chain of thought (CoT) of AI systems that communicate in human language.
result CoT monitoring is a promising but fragile approach to AI safety.
Despite the tremendous advances that have been made in the last decade on developing useful machine-learning applications, their wider adoption has been hindered by the lack of strong assurance guarantees that can be made about their behavior. In this paper, we consider how formal verification techniques developed for …
GRAND ensures node-level differential privacy for network data.
problem Lack of node-level differential privacy for network data.
method Proposes GRAND, the first mechanism for releasing networks with node-level differential privacy and preserving structural properties.
result GRAND releases networks while ensuring node-level differential privacy and preserving structural properties.
Let (M,ω,J,g) be a non-compact almost Kähler manifold. In this paper we provide various criteria that assure that ωk induces a non trivial class in the reduced Lp maximal/minimal cohomology of (M,g). Furthermore in the last part we explore some topological applications of our results.
Simple online monitor detects unsafe LLM outputs.
problem LLMs generate unsafe outputs despite training.
method Thresholding external verifier signal to decide alarms.
result Simple design competitive with advanced methods.
This research tackles monitoring machine learning algorithms post-deployment, addressing performativity issues.
problem Monitoring machine learning algorithms after deployment, especially when they affect their own data-generating process.
method Uses causal inference techniques to navigate performativity and compares different monitoring criteria and data sources.
result Different monitoring systems have varying operating characteristics and implications for ML monitoring design.
Paper improves ETF tail-risk monitoring reliability.
problem Unreliable ETF risk monitoring under degraded data.
method Combines quality checks, prediction, scoring, and adjustment.
result Improves tail-risk monitoring, especially during stressed periods.
This paper introduces modal epistemic tools for risk management.
problem Identifying and certifying risk claims when institutions lack the necessary epistemic stance.
method Develops crisp and fuzzy modal semantics for assurance and working commitment, distinguishing between object-level risk claims and meta-level epistemic diagnostics.
result Risk governance should model evidential incompleteness and failures of escalation, not just hazards and losses.
PITMonitor monitors model calibration over time with formal error guarantees.
problem Fixed-sample tests applied to models over time can lead to false alarms.
method PITMonitor uses mixture e-processes to detect distributional shifts in probability integral transforms.
result PITMonitor achieves competitive detection rates on river's FriedmanDrift benchmark.
The paper adds explanation to predictive process monitoring.
problem Equipping predictive business process monitoring with explanation capabilities.
method Used game theory of Shapley Values to obtain robust explanations.
result First time explanations given in predictive business process monitoring.
IDS algorithm optimizes sequential decisions in various monitoring settings.
problem Optimizing sequential decisions in complex monitoring scenarios.
method Information-directed sampling (IDS) algorithm for linear partial monitoring.
result IDS achieves nearly worst-case rate optimality in finite-action games.
A new method monitors unstructured 3D shapes without registration.
problem Error-prone registration and mesh reconstruction steps in PCD monitoring.
method Intrinsic geometric properties of shapes, using Laplacian and geodesic distances.
result Effective monitoring of defects without registration and mesh reconstruction.
Focuses on monitoring and explaining models in real-world applications.
problem Ensuring high quality machine learning services in production environments.
method Statistical techniques for model performance and data monitoring, explanations of predictions.
result Challenges and solutions for implementing monitoring and explanation in production models.
The paper finds sign-changing solutions for a specific type of elliptic equation.
problem Existence of sign-changing solutions for a Yamabe type equation.
method Investigates a critical elliptic equation with a Yamabe type operator on a compact manifold with boundary.
result Existence of sign-changing solutions assured under certain geometric conditions.
Neural system optimizes glucose levels in diabetics.
problem Limited research on continuous glucose maintenance devices.
method Differential predictive control with neural policy and differentiable modeling.
result Improves glucose level optimization in real-time.
We present a numerical scheme to calculate fluctuation identities for exponential Lévy processes in the continuous monitoring case. This includes the Spitzer identities for touching a single upper or lower barrier, and the more difficult case of the two-barriers exit problem. These identities are given in the Fourier-L…
Optimal probing framework for scalable network monitoring.
problem Efficiently monitor growing cloud networks with limited budgets.
method A- and E-optimal experimental designs, Frank-Wolfe algorithm approximations.
result Significant reduction in probing budget with low estimation errors.
The paper proposes a method to create efficient remote monitoring models.
problem Large and complex machine learning models are unsuitable for remote monitoring on edge devices.
method Decompose the model into a simple local monitoring function and a complex correction term evaluated on the server.
result The proposed framework learns monitoring models with significantly reduced complexity that maintain safety.
RAGuard improves safety in LLMs for offshore wind maintenance.
problem Conventional LLMs fail with specialised or unexpected scenarios in offshore wind maintenance.
method Integrates safety-critical documents alongside technical manuals in RAG framework.
result RAGuard increases safety recall from almost 0% to over 50% while maintaining technical recall above 60%.
Let G be a compact connected Lie group and let H be a subgroup fixed by an involution. A classical result assures that the action of the complex reductive group HC on the flag variety F of G admits a finite number of orbits. In this article we propose a formula for the branching coefficients of the symmetric p…
New monitoring method detects ML risk models' performance changes in medical interventions.
problem Monitoring ML risk models in healthcare is complicated by confounding medical interventions.
method Developed a new score-based CUSUM monitoring procedure with dynamic control limits.
result Valid inference is possible if conditional exchangeability or time-constant selection bias hold.
Emerging wearable sensors have enabled the unprecedented ability to continuously monitor human activities for healthcare purposes. However, with so many ambient sensors collecting different measurements, it becomes important not only to maintain good monitoring accuracy, but also low power consumption to ensure sustain…
We introduce a novel Deep Learning framework, which quantitatively estimates image segmentation quality without the need for human inspection or labeling. We refer to this method as a Quality Assurance Network -- QANet. Specifically, given an image and a `proposed' corresponding segmentation, obtained by any method inc…