CROC identifies the earliest-changing stream as the root cause in multi-stream data.
problem Distribution-free root cause analysis in multi-stream data with unknown distributional changes.
method Conformal p-values and finite-sample valid confidence sets.
result CROC efficiently isolates the root cause under minimal assumptions.
Paper simplifies calculating causation probabilities and ranks root causes.
problem Computational challenges in assessing causal relationships.
method Algorithmic simplifications and novel methodological framework for Root Cause Analysis.
result Significantly reduces computational complexity for calculating causation probabilities.
Identifies root causes of outliers in unknown cyclic graphs.
problem Outliers in unknown cyclic graphs with linear structural equations.
method Identifies a short list of potential root causes based on strong perturbation and structural equations.
result The shortlist includes true root causes and their parents on the cycle.
The paper proposes a method to identify root causes of anomalies in time series data.
problem Challenges in identifying the root cause of anomalies in complex software systems.
method Analyzes time series fluctuations to track the propagation of effects through hidden states.
result Identifies causal patterns among observed fluctuations to isolate root causes.
New method combines FMEA and Bayesian Network for root cause analysis in lithium-ion battery production.
problem Complex cause-effect relationships in lithium-ion battery production.
method Combining FMEA with Bayesian Network to detect and resolve inconsistencies.
result Holistic method builds large-scale cross-process Bayesian Failure Network for root cause analysis.
Performance monitoring, anomaly detection, and root-cause analysis in complex cyber-physical systems (CPSs) are often highly intractable due to widely diverse operational modes, disparate data types, and complex fault propagation mechanisms. This paper presents a new data-driven framework for root-cause analysis, based…
Identifies patient-specific root causes of disease using structural equation models.
problem Detecting significant variables in complex diseases that differ between patients.
method Defining patient-specific root causes as exogenous errors in a structural equation model, quantifying predictivity using Shapley values, and developing a fast algorithm called Root Causal Inference.
result Significant improvements in accuracy by uncovering root causes with large effect sizes at the individual level but clinically insignificant effect sizes at the group level.
Paper adapts causal analysis for time-dependent systems, especially energy management.
problem Challenges in root-cause analysis for systems with lagged time-dependencies, particularly in energy management.
method Adapts causal root-cause analysis method to time-dependent systems, discusses two truncation approaches.
result Extension effectively localizes root-causes in feature and time domain with enough lags.
Paper tackles anomaly detection with missing causal knowledge.
problem Detect anomalies with missing structural knowledge.
method Simple, efficient methods for polytree causal graphs.
result Heuristic identifies root causes based on anomaly scores.
CD-RCA method identifies causal relationships in prediction errors without predefined graphs.
problem Challenges in diagnosing prediction errors due to lack of transparency in black-box models.
method Causal-Discovery-based Root-Cause Analysis (CD-RCA) method that estimates causal relationships without predefined causal graphs.
result CD-RCA outperforms heuristic attribution methods in identifying variable contributions to prediction errors.
Paper tackles anomaly detection and RCA in dynamical systems using ICODE Networks.
problem Anomalies in dynamical systems impact performance and reliability.
method Proposes ICODE Networks for anomaly detection, RCA, and type classification.
result Demonstrates the ability to accurately detect anomalies, classify types, and pinpoint origins.
New method identifies root causes in presence of latent confounding.
problem Identifying root causes in the presence of latent variables.
method Extract Errors with Latents (EEL) procedure for inferring root causes.
result Superior accuracy and robustness compared to previous methods.
New definition of patient-specific root causes of disease using counterfactuals.
problem Lack of rigorous mathematical formulation for automatic detection of root causes.
method Proposes a counterfactual definition matching clinical intuition and uses Shapley values for causal contribution scores.
result Adapts to disease prevalence, accounts for noisy labels, and admits fast computation.
Identifies root causes of outliers using causal DAGs.
problem Detecting and understanding the causes of anomalies in interrelated variables.
method Formal approach using causal directed acyclic graphs (DAGs), outlier scores, and Shapley values.
result Quantifies the extent of outlier scores attributed to ancestors.
New model identifies patient-specific disease root causes.
problem Identifying root causes of complex diseases varying between patients.
method Generalized Root Causal Inference (GRCI) algorithm for heteroscedastic noise model.
result GRCI accurately extracts patient-specific root causes.
Deep neural networks (DNNs) are shown to be promising solutions in many challenging artificial intelligence tasks. However, it is very hard to figure out whether the low precision of a DNN model is an inevitable result, or caused by defects. This paper aims at addressing this challenging problem. We find that the inter…
Root cause analysis in a large-scale production environment is challenging due to the complexity of services running across global data centers. Due to the distributed nature of a large-scale system, the various hardware, software, and tooling logs are often maintained separately, making it difficult to review the logs…
Root Cause Analysis for Anomalies is challenging because of the trade-off between the accuracy and its explanatory friendliness, required for industrial applications. In this paper we propose a framework for simple and friendly RCA within the Bayesian regime under certain restrictions (that Hessian at the mode is diago…
New method falsifies causal graphs using outlier events.
problem Inferring causal relationships from data is hard.
method Falsify candidate causal graphs based on outlier propagation.
result Statistical tests control false positives and have power guarantees.
Paper tackles RCA in complex networks with unknown interdependencies.
problem Difficult RCA in networked systems due to unknown interdependencies.
method Federated learning for feature-partitioned, nonlinear data without modifying client models.
result Established theoretical convergence guarantees and validated on real-world data.
Unlike traditional programs (such as operating systems or word processors) which have large amounts of code, machine learning tasks use programs with relatively small amounts of code (written in machine learning libraries), but voluminous amounts of data. Just like developers of traditional programs debug errors in the…
NetRCA algorithm locates network faults by analyzing derived features and leveraging unlabeled data.
problem Locating the true root cause of network faults is challenging due to complex architectures and limited labeled data.
method NetRCA algorithm extracts derived features, generates new training data, and combines multiple models to enhance performance.
result NetRCA outperforms existing methods in fault cause localization on real-world data.
Method identifies root causes of anomalies in causal processes.
problem Identifying root causes of anomalies in causal processes.
method Noisy functional causal model, Bayesian learning, gradient-based attribution.
result Proposes efficient method to compute anomaly attribution scores.
RAID algorithm detects anomalies in real-time IoT systems.
problem Anomaly detection limitations in multivariate dynamic processes.
method Adapts to non-stationary effects and handles data drift.
result Improved detection accuracy and root cause isolation.
We consider the problem of classifying business process instances based on structural features derived from event logs. The main motivation is to provide machine learning based techniques with quick response times for interactive computer assisted root cause analysis. In particular, we create structural features from p…
New deep architecture improves head motion prediction in 360° videos.
problem Predicting user head motion in 360-degree videos using past positions and video content.
method Re-examined existing deep-learning approaches, identified flaws, and designed a new TRACK architecture.
result TRACK achieves state-of-the-art performance, outperforming competitors by up to 20 percent.
VerifAI toolkit improves neural network-based aircraft taxiing system safety.
problem Improving safety of autonomous aircraft taxiing systems using neural networks.
method Unified approach to formal analysis and retraining of AI systems, including falsification, debugging, and retraining.
result Improved neural network performance and reduced failure cases in aircraft taxiing system.
New approach identifies and explains errors in machine learning pipelines.
problem Challenges in identifying and explaining errors in complex machine learning pipelines.
method Uses iteration and provenance to automatically infer root causes of failures.
result Significantly improves precision and recall compared to state-of-the-art methods.
The paper proposes a new probability distribution for rooted trees.
problem Overfitting in tree selection for statistical models.
method Bayesian approach with a generalized probability distribution for rooted trees.
result Recursive methods to evaluate the probability distribution without approximations.
Identifies shifts in causal mechanisms between related datasets using ANMs.
problem Estimating the full causal structure from data is challenging; focus on identifying shifts in causal mechanisms.
method Assumes nonlinear additive noise models, uses Jacobian of score function for mixture distribution to identify shifts.
result Shows applicability of the approach on synthetic and real-world data.
During the fabrication of casting parts sensor data is typically automatically recorded and accumulated for process monitoring and defect diagnosis. As casting is a thermal process with many interacting process parameters, root cause analysis tends to be tedious and ineffective. We show how a decomposition based on non…
Through the direct study of the analysis estimator we derive oracle inequalities with fast and slow rates by adapting the arguments involving projections by Dalalyan, Hebiri and Lederer (2017). We then extend the theory to the square root analysis estimator. Finally, we focus on (square root) total variation regularize…
Factor analysis or sometimes referred to as variable analysis has been extensively used in classification problems for identifying specific factors that are significant to particular classes. This type of analysis has been widely used in application such as customer segmentation, medical research, network traffic, imag…
Local convolutions bias neural networks towards high-frequency adversarial examples.
problem High-frequency adversarial examples in neural networks.
method Analysis of different linear and nonlinear architectures, focusing on the impact of local convolution operations.
result Local convolutions induce an implicit bias towards high frequency features, leading to high-frequency adversarial examples.
Microsoft's internal big data analytics platform is comprised of hundreds of thousands of machines, serving over half a million jobs daily, from thousands of users. The majority of these jobs are recurring and are crucial for the company's operation. Although administrators spend significant effort tuning system perfor…
Several recently proposed stochastic optimization methods that have been successfully used in training deep networks such as RMSProp, Adam, Adadelta, Nadam are based on using gradient updates scaled by square roots of exponential moving averages of squared past gradients. In many applications, e.g. learning with large …
Markowitz's celebrated mean--variance portfolio optimization theory assumes that the means and covariances of the underlying asset returns are known. In practice, they are unknown and have to be estimated from historical data. Plugging the estimates into the efficient frontier that assumes known parameters has led to p…
New method differentiates square-root Kalman filters robustly.
problem Gradient calculation issues in square-root Kalman filters.
method Closed-form chain rule derived from Gramian identity, resolves non-orthogonal and rank-deficient issues.
result Robust automatic differentiation for Kalman filters, resolving numerical stability and gradient issues.
Paper examines adversarial attacks on event cause analysis in power grids.
problem Adversarial attacks manipulate data to mislead event classifiers.
method Investigated adversarial attacks on CNN-based event cause analysis.
result Demonstrated adversaries can misclassify events through stealthy data manipulations.
The square root of Fredholm determinants causes numerical instabilities in option pricing models.
problem Numerical instabilities in Fourier-based option pricing for the Volterra Stein-Stein model.
method Characterization of determinant crossing behavior, derivation of transform to handle crossings, efficient algorithms.
result Significant improvement in accuracy and reduction in computational cost for Fourier-based pricing.
In this paper we propose a new method to assist in labeling data arriving from fast running processes using anomaly detection. A result is the possibility to manually classify data arriving at a high rates to train machine learning models. To circumvent the problem of not having a real ground truth we propose specific …
Improved survival analysis using square root Cox's models and neural networks.
problem Feature selection in survival analysis.
method Square root Cox's survival analysis by the fittest linear and neural networks model, directly tuning penalty parameter λ.
result Substantially improved over traditional methods, achieving phase transition in feature selection.
Enhanced ROOT-SGD optimizes stochastic optimization with diminishing stepsizes.
problem Improving statistical efficiency in stochastic optimization.
method Integrates a diminishing stepsize strategy into ROOT-SGD.
result Achieves optimal convergence rates with improved stability and precision.
Boundary effects inflate variance in Gaussian processes, leading to acquisition bias.
problem Boundary-induced acquisition bias in Gaussian processes.
method Traced root cause to geometric mechanism of kernel truncation at domain boundaries.
result Boundary effects create distortion that worsens with dimensionality, affecting acquisition behavior.
Paper connects surface shape analysis and unbalanced optimal transport.
problem Computing the SRNF shape distance on piecewise linear surfaces.
method Characterizes SRNF shape distance as WFR distance pullback, proposes new algorithm for WFR distance computation.
result Direct computation of SRNF shape distance on piecewise linear surfaces.
In practice daily volatility of portfolio returns is transformed to longer holding periods by multiplying by the square-root of time which assumes that returns are not serially correlated. Under this assumption this procedure of scaling can also be applied to contributions to volatility of the assets in the portfolio. …
Unified framework for generating data by modeling causal and correlational dependencies.
problem Modeling both causal and correlational dependencies among latent factors.
method Causal-Correlation Variational Autoencoder (C2VAE) framework.
result Improves generation quality, disentanglement, and intervention fidelity.
Although modern portfolio theory has been in existence for over 60 years, fund managers often struggle to get its models to produce reliable portfolio allocations without strongly constraining the decision vector by tight bands of strategic allocation targets. The two main root causes to this problem are inadequate par…