CROC identifies the earliest-changing stream as the root cause in multi-stream data.
problem Distribution-free root cause analysis in multi-stream data with unknown distributional changes.
method Conformal p-values and finite-sample valid confidence sets.
result CROC efficiently isolates the root cause under minimal assumptions.
Paper simplifies calculating causation probabilities and ranks root causes.
problem Computational challenges in assessing causal relationships.
method Algorithmic simplifications and novel methodological framework for Root Cause Analysis.
result Significantly reduces computational complexity for calculating causation probabilities.
Identifies root causes of outliers in unknown cyclic graphs.
problem Outliers in unknown cyclic graphs with linear structural equations.
method Identifies a short list of potential root causes based on strong perturbation and structural equations.
result The shortlist includes true root causes and their parents on the cycle.
Performance monitoring, anomaly detection, and root-cause analysis in complex cyber-physical systems (CPSs) are often highly intractable due to widely diverse operational modes, disparate data types, and complex fault propagation mechanisms. This paper presents a new data-driven framework for root-cause analysis, based…
New method combines FMEA and Bayesian Network for root cause analysis in lithium-ion battery production.
problem Complex cause-effect relationships in lithium-ion battery production.
method Combining FMEA with Bayesian Network to detect and resolve inconsistencies.
result Holistic method builds large-scale cross-process Bayesian Failure Network for root cause analysis.
Paper adapts causal analysis for time-dependent systems, especially energy management.
problem Challenges in root-cause analysis for systems with lagged time-dependencies, particularly in energy management.
method Adapts causal root-cause analysis method to time-dependent systems, discusses two truncation approaches.
result Extension effectively localizes root-causes in feature and time domain with enough lags.
Identifies patient-specific root causes of disease using structural equation models.
problem Detecting significant variables in complex diseases that differ between patients.
method Defining patient-specific root causes as exogenous errors in a structural equation model, quantifying predictivity using Shapley values, and developing a fast algorithm called Root Causal Inference.
result Significant improvements in accuracy by uncovering root causes with large effect sizes at the individual level but clinically insignificant effect sizes at the group level.
CD-RCA method identifies causal relationships in prediction errors without predefined graphs.
problem Challenges in diagnosing prediction errors due to lack of transparency in black-box models.
method Causal-Discovery-based Root-Cause Analysis (CD-RCA) method that estimates causal relationships without predefined causal graphs.
result CD-RCA outperforms heuristic attribution methods in identifying variable contributions to prediction errors.
Paper tackles anomaly detection with missing causal knowledge.
problem Detect anomalies with missing structural knowledge.
method Simple, efficient methods for polytree causal graphs.
result Heuristic identifies root causes based on anomaly scores.
Paper tackles anomaly detection and RCA in dynamical systems using ICODE Networks.
problem Anomalies in dynamical systems impact performance and reliability.
method Proposes ICODE Networks for anomaly detection, RCA, and type classification.
result Demonstrates the ability to accurately detect anomalies, classify types, and pinpoint origins.
Root cause analysis in a large-scale production environment is challenging due to the complexity of services running across global data centers. Due to the distributed nature of a large-scale system, the various hardware, software, and tooling logs are often maintained separately, making it difficult to review the logs…
New method identifies root causes in presence of latent confounding.
problem Identifying root causes in the presence of latent variables.
method Extract Errors with Latents (EEL) procedure for inferring root causes.
result Superior accuracy and robustness compared to previous methods.
New definition of patient-specific root causes of disease using counterfactuals.
problem Lack of rigorous mathematical formulation for automatic detection of root causes.
method Proposes a counterfactual definition matching clinical intuition and uses Shapley values for causal contribution scores.
result Adapts to disease prevalence, accounts for noisy labels, and admits fast computation.
Root Cause Analysis for Anomalies is challenging because of the trade-off between the accuracy and its explanatory friendliness, required for industrial applications. In this paper we propose a framework for simple and friendly RCA within the Bayesian regime under certain restrictions (that Hessian at the mode is diago…
The recent increase in the scale and complexity of software systems has introduced new challenges to the time series monitoring and anomaly detection process. A major drawback of existing anomaly detection methods is that they lack contextual information to help stakeholders identify the cause of anomalies. This proble…
Deep neural networks (DNNs) are shown to be promising solutions in many challenging artificial intelligence tasks. However, it is very hard to figure out whether the low precision of a DNN model is an inevitable result, or caused by defects. This paper aims at addressing this challenging problem. We find that the inter…
New model identifies patient-specific disease root causes.
problem Identifying root causes of complex diseases varying between patients.
method Generalized Root Causal Inference (GRCI) algorithm for heteroscedastic noise model.
result GRCI accurately extracts patient-specific root causes.
Paper tackles RCA in complex networks with unknown interdependencies.
problem Difficult RCA in networked systems due to unknown interdependencies.
method Federated learning for feature-partitioned, nonlinear data without modifying client models.
result Established theoretical convergence guarantees and validated on real-world data.
Unlike traditional programs (such as operating systems or word processors) which have large amounts of code, machine learning tasks use programs with relatively small amounts of code (written in machine learning libraries), but voluminous amounts of data. Just like developers of traditional programs debug errors in the…
We describe a formal approach to identify 'root causes' of outliers observed in n variables X1,…,Xn in a scenario where the causal relation between the variables is a known directed acyclic graph (DAG). To this end, we first introduce a systematic way to define outlier scores. Further, we introduce the concep…
New method falsifies causal graphs using outlier events.
problem Inferring causal relationships from data is hard.
method Falsify candidate causal graphs based on outlier propagation.
result Statistical tests control false positives and have power guarantees.
Method identifies root causes of anomalies in causal processes.
problem Identifying root causes of anomalies in causal processes.
method Noisy functional causal model, Bayesian learning, gradient-based attribution.
result Proposes efficient method to compute anomaly attribution scores.
We consider predicting the user's head motion in 360-degree videos, with 2 modalities only: the past user's positions and the video content (not knowing other users' traces). We make two main contributions. First, we re-examine existing deep-learning approaches for this problem and identify hidden flaws from a thorough…
NetRCA algorithm locates network faults by analyzing derived features and leveraging unlabeled data.
problem Locating the true root cause of network faults is challenging due to complex architectures and limited labeled data.
method NetRCA algorithm extracts derived features, generates new training data, and combines multiple models to enhance performance.
result NetRCA outperforms existing methods in fault cause localization on real-world data.
RAID algorithm detects anomalies in real-time IoT systems.
problem Anomaly detection limitations in multivariate dynamic processes.
method Adapts to non-stationary effects and handles data drift.
result Improved detection accuracy and root cause isolation.
We consider the problem of classifying business process instances based on structural features derived from event logs. The main motivation is to provide machine learning based techniques with quick response times for interactive computer assisted root cause analysis. In particular, we create structural features from p…
Machine learning tasks entail the use of complex computational pipelines to reach quantitative and qualitative conclusions. If some of the activities in a pipeline produce erroneous or uninformative outputs, the pipeline may fail or produce incorrect results. Inferring the root cause of failures and unexpected behavior…
Identifies shifts in causal mechanisms between related datasets using ANMs.
problem Estimating the full causal structure from data is challenging; focus on identifying shifts in causal mechanisms.
method Assumes nonlinear additive noise models, uses Jacobian of score function for mixture distribution to identify shifts.
result Shows applicability of the approach on synthetic and real-world data.
Factor analysis or sometimes referred to as variable analysis has been extensively used in classification problems for identifying specific factors that are significant to particular classes. This type of analysis has been widely used in application such as customer segmentation, medical research, network traffic, imag…
VerifAI toolkit improves neural network-based aircraft taxiing system safety.
problem Improving safety of autonomous aircraft taxiing systems using neural networks.
method Unified approach to formal analysis and retraining of AI systems, including falsification, debugging, and retraining.
result Improved neural network performance and reduced failure cases in aircraft taxiing system.
Markowitz's celebrated mean--variance portfolio optimization theory assumes that the means and covariances of the underlying asset returns are known. In practice, they are unknown and have to be estimated from historical data. Plugging the estimates into the efficient frontier that assumes known parameters has led to p…
Method uses Seq2Seq learning to automatically generate recovery commands for ICT systems.
problem Manual decision-making for recovery commands is time-consuming and error-prone.
method Seq2Seq neural network model trained on past logs and commands.
result The model can estimate accurate recovery commands from new failures.
Although modern portfolio theory has been in existence for over 60 years, fund managers often struggle to get its models to produce reliable portfolio allocations without strongly constraining the decision vector by tight bands of strategic allocation targets. The two main root causes to this problem are inadequate par…
TL-PCA uses transfer learning to improve PCA performance with limited target data.
problem PCA performance is limited with scarce target data.
method Transfer learning approach to PCA (TL-PCA) that combines source task knowledge with target task data.
result Improved PCA representation for dimensionality reduction with limited target data.
Single neuron sensitivity reveals model weaknesses.
problem Understanding model susceptibility to adversarial attacks.
method Analyzing sensitivity of individual neurons to perturbations.
result Single neuron attacks are as effective as full model attacks.
This paper tackles ranking-based performance normalization for optimization algorithms.
problem Ranking optimization algorithms across diverse numerical scales disrupts performance comparisons.
method Introduces absolute ranking and a sampling-based computational method to address numerical scale variation.
result Provides a more robust framework for assessing performance across multiple algorithms and problems.
During the fabrication of casting parts sensor data is typically automatically recorded and accumulated for process monitoring and defect diagnosis. As casting is a thermal process with many interacting process parameters, root cause analysis tends to be tedious and ineffective. We show how a decomposition based on non…
New insights into why Transformers are hard to train, leading to a new method to stabilize them.
problem Understanding and stabilizing the training of Transformers.
method Analyzing the amplification effect in Transformer models and proposing Admin to stabilize training.
result Admin stabilizes early stage training and improves performance.
Paper extends SI method for detecting CPs in complex systems' frequency domain.
problem Identifying change points in complex systems' frequency domain.
method Extends SI framework to frequency domain using DFT properties and develops valid p-values.
result Reliable detection of genuine CPs with strong statistical guarantees.
Improved continuous-time consistency models for large-scale image generation.
problem Training instability and discretization errors in existing diffusion models.
method Unified theoretical framework, improved diffusion process, and network architecture.
result Trained continuous-time CMs at 1.5B parameters, achieving state-of-the-art FID scores.
Local convolutions bias neural networks towards high-frequency adversarial examples.
problem High-frequency adversarial examples in neural networks.
method Analysis of different linear and nonlinear architectures, focusing on the impact of local convolution operations.
result Local convolutions induce an implicit bias towards high frequency features, leading to high-frequency adversarial examples.
New simulation model predicts financial market dynamics with high accuracy.
problem Extreme difficulty in financial market projections due to human behavioural complexity.
method Agent-based modeling with a hierarchical knowledge architecture to simulate diverse human groups.
result Simulator achieves 13.29% deviation in crisis scenarios and lower mean square error under normal conditions.
Several scalable sample-based methods to compute the Kullback Leibler (KL) divergence between two distributions have been proposed and applied in large-scale machine learning models. While they have been found to be unstable, the theoretical root cause of the problem is not clear. In this paper, we study a generative a…
Uniswap V3 struggles with price accuracy during sudden market drops.
problem Price inaccuracies on Uniswap V3 during abrupt price drops.
method Empirical study of Uniswap V3's performance during market shocks.
result Liquidity providers lack agility and incentives in volatile conditions.
Modeling delayed Granger causality in Hawkes processes.
problem Capturing the time lag between causal events in multivariate Hawkes processes.
method Proposed a Hawkes process model with latent time lags, using Variational Auto-Encoder (VAE) for inference.
result Identified and inferred time lags with posterior distributions, improving event prediction and root cause analysis.
New optimization methods improve Cox Proportional Hazards model training for high-dimensional data.
problem Vanishing second order derivatives in Newton method prevent convergence for high-dimensional CPH model training.
method Construct and minimize surrogate functions exploiting hidden mathematical structures of CPH model.
result Global convergence and monotonic loss decrease, leading to sparse and high-quality models.
Framework detects anomalies in industrial processes using deep learning.
problem Detect anomalies in complex industrial processes.
method Causal-based framework with unsupervised deep learning.
result Successfully validated abstract contexts of blast furnace assets.
BC-ACI corrects time series forecast bias, improving prediction intervals.
problem Persistent bias in time series forecasts leads to overly conservative prediction intervals.
method Augments ACI with an EWM estimate of forecast bias to correct nonconformity scores and re-center intervals.
result Reduces Winkler interval scores by 13-17% under distribution shifts, improving calibration.