arXiv research

Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems using machine-learning and deep-learning models, such as automated-driving vehicles. Quality assurance frameworks are required for such machine learning systems, but there are no widely accepted and established quality-assurance …

The paper optimizes exceptions in a statistical production system using machine learning.

A new process model for machine learning applications with quality assurance.

Develops ML-DQA for healthcare data quality assurance.

We introduce a novel Deep Learning framework, which quantitatively estimates image segmentation quality without the need for human inspection or labeling. We refer to this method as a Quality Assurance Network -- QANet. Specifically, given an image and a `proposed' corresponding segmentation, obtained by any method inc…

The increasing use of machine-learning (ML) enabled systems in critical tasks fuels the quest for novel verification and validation techniques yet grounded in accepted system assurance principles. In traditional system development, model-based techniques have been widely adopted, where the central premise is that abstr…

As technology become more advanced, those who design, use and are otherwise affected by it want to know that it will perform correctly, and understand why it does what it does, and how to use it appropriately. In essence they want to be able to trust the systems that are being designed. In this survey we present assura…

Novel framework monitors cardiac image segmentation models in real-time.

Do-AIQ framework evaluates AI algorithms' quality using DOE.

People who design, use, and are affected by autonomous artificially intelligent agents want to be able to \emph{trust} such agents -- that is, to know that these agents will perform correctly, to understand the reasoning behind their actions, and to know how to use them appropriately. Many techniques have been devised …

Magnetic resonance (MR) imaging offers a wide variety of imaging techniques. A large amount of data is created per examination which needs to be checked for sufficient quality in order to derive a meaningful diagnosis. This is a manual process and therefore time- and cost-intensive. Any imaging artifacts originating fr…

In this paper, we build an organization of high-dimensional datasets that cannot be cleanly embedded into a low-dimensional representation due to missing entries and a subset of the features being irrelevant to modeling functions of interest. Our algorithm begins by defining coarse neighborhoods of the points and defin…

We study reinforcement learning of chatbots with recurrent neural network architectures when the rewards are noisy and expensive to obtain. For instance, a chatbot used in automated customer service support can be scored by quality assurance agents, but this process can be expensive, time consuming and noisy. Previous …

modAL is a modular active learning framework for Python, aimed to make active learning research and practice simpler. Its distinguishing features are (i) clear and modular object oriented design (ii) full compatibility with scikit-learn models and workflows. These features make fast prototyping and easy extensibility p…

TBAL reduces manual annotation but requires validated data.

With the rapid growth of crowdsourcing platforms it has become easy and relatively inexpensive to collect a dataset labeled by multiple annotators in a short time. However due to the lack of control over the quality of the annotators, some abnormal annotators may be affected by position bias which can potentially degra…

Develops a deep metric learning approach for detecting bugs in video games.

The paper designs neural networks with assurance for controlling nonlinear systems.

Machine learning has evolved into an enabling technology for a wide range of highly successful applications. The potential for this success to continue and accelerate has placed machine learning (ML) at the top of research, economic and political agendas. Such unprecedented interest is fuelled by a vision of ML applica…

In recent years, car makers and tech companies have been racing towards self driving cars. It seems that the main parameter in this race is who will have the first car on the road. The goal of this paper is to add to the equation two additional crucial parameters. The first is standardization of safety assurance --- wh…

We provide sufficient conditions assuring that a suitably decorated 2-polyhedron can be thickened to a compact 4-dimensional Stein domain. We also study a class of flat polyhedra in 4-manifolds and find conditions assuring that they admit Stein, compact neighborhoods. We base our calculations on Turaev's shadows suitab…

Avaya Conversational Intelligence(ACI) is an end-to-end, cloud-based solution for real-time Spoken Language Understanding for call centers. It combines large vocabulary, real-time speech recognition, transcript refinement, and entity and intent recognition in order to convert live audio into a rich, actionable stream o…

Advances in the field of Machine Learning and Deep Neural Networks (DNNs) has enabled rapid development of sophisticated and autonomous systems. However, the inherent complexity to rigorously assure the safe operation of such systems hinders their real-world adoption in safety-critical domains such as aerospace and med…

Machine learning components such as deep neural networks are used extensively in Cyber-Physical Systems (CPS). However, they may introduce new types of hazards that can have disastrous consequences and need to be addressed for engineering trustworthy systems. Although deep neural networks offer advanced capabilities, t…

Owing to the expeditious growth in the information and communication technologies, smart cities have raised the expectations in terms of efficient functioning and management. One key aspect of residents' daily comfort is assured through affording reliable traffic management and route planning. Comprehensively, the majo…

Two novel models predict bus travel times with uncertainty, improving connection assurance.

Given a properly embedded graph Gamma in a ball B and a punctured sphere Sigma properly embedded in B - Gamma, we examine the conditions on Gamma that are necessary to assure that Sigma is boundary parallel.

We study the geometry of the leaf closure space of regular and singular Riemannian foliations. We give conditions which assure that this leaf space is a singular symplectic or Kähler space.

New framework uses OR to ensure AI systems make safe decisions.

Crowdsourcing and active learning reduce manual annotation in social media event classification.

We present a simple remark that assures that the invariant theory of certain real Lie groups coincides with that of the underlying affine, real algebraic groups. In particular, this result applies to the non-compact orthogonal or symplectic Lie groups.

MFRL-BI controls manufacturing processes without needing accurate models.

GRAND ensures node-level differential privacy for network data.

Let $(M,ω,J,g)$ be a non-compact almost Kähler manifold. In this paper we provide various criteria that assure that $ω^k$ induces a non trivial class in the reduced $L^p$ maximal/minimal cohomology of $(M,g)$. Furthermore in the last part we explore some topological applications of our results.

This paper introduces modal epistemic tools for risk management.

Time Series Classification (TSC) problems are encountered in many real life data mining tasks ranging from medicine and security to human activity recognition and food safety. With the recent success of deep neural networks in various domains such as computer vision and natural language processing, researchers started …

The paper finds sign-changing solutions for a specific type of elliptic equation.

RAGuard improves safety in LLMs for offshore wind maintenance.

Let $G$ be a compact connected Lie group and let H be a subgroup fixed by an involution. A classical result assures that the action of the complex reductive group $H_C$ on the flag variety $F$ of $G$ admits a finite number of orbits. In this article we propose a formula for the branching coefficients of the symmetric p…

This lecture is devoted to review some of the main properties of multisymplectic geometry. In particular, after reminding the standard definition of multisymplectic manifold, we introduce its characteristic submanifolds, the canonical models, and other relevant kinds of multisymplectic manifolds, such as those where th…

A dataset for evaluating engagement with scientific video lectures.

Stablecoins promise to bridge fiat currencies with the world of cryptocurrencies. They provide a way for users to take advantage of the benefits of digital currencies, such as ability to transfer assets over the internet, provide assurance on minting schedules and scarcity, and enable new asset classes, while also part…

Deep neural networks (DNNs) are increasingly being adopted for sensing and control functions in a variety of safety and mission-critical systems such as self-driving cars, autonomous air vehicles, medical diagnostics, and industrial robotics. Failures of such systems can lead to loss of life or property, which necessit…

The methodology of community detection can be divided into two principles: imposing a network model on a given graph, or optimizing a designed objective function. The former provides guarantees on theoretical detectability but falls short when the graph is inconsistent with the underlying model. The latter is model-fre…

A new framework uses deep reinforcement learning to improve aircraft separation in busy airspace.

In this paper, we present the principal components of an economic scenario generator (ESG), both for the theoretical design and for practical implementation. The choice of these components should be linked to the ultimate vocation of the economic scenario generator, which can be either a tool for pricing financial prod…

Existence of hypersurfaces in warped product manifolds proven.

Practitioners sometimes suggest to use a combination of Sobol sequences and orthonormal polynomials when applying an LSMC algorithm for evaluation of option prices or in the context of risk capital calculation under the Solvency II regime. In this paper, we give a theoretical justification why good implementations of a…