New method falsifies causal discovery results without ground truth.
problem Evaluation of causal discovery algorithms without ground truth data.
method Detects incompatibilities between causal graphs learned on different subsets of variables.
result Detection of incompatibilities can falsify wrongly inferred causal relations.
We investigate the problem of truth discovery based on opinions from multiple agents who may be unreliable or biased. We consider the case where agents' reliabilities or biases are correlated if they belong to the same community, which defines a group of agents with similar opinions regarding a particular event. An age…
New causal distances improve evaluation of causal discovery algorithms.
problem Evaluating causal discovery algorithms using graphical distances is limited.
method Defined causal distances based on causal distributions rather than graphical structure.
result Improved evaluation of causal discovery algorithms on synthetic and real-world datasets.
We address the problem of latent truth discovery, LTD for short, where the goal is to discover the underlying true values of entity attributes in the presence of noisy, conflicting or incomplete information. Despite a multitude of algorithms to address the LTD problem that can be found in literature, only little is kno…
Generates synthetic manufacturing data for causal discovery benchmarking.
problem Lack of suitable real data for validating causal discovery algorithms.
method Distributional random forests for estimating conditional distributions.
result Semisynthetic manufacturing data adheres to a causal model.
Latent truth discovery, LTD for short, refers to the problem of aggregating ltiple claims from various sources in order to estimate the plausibility of atements about entities. In the absence of a ground truth, this problem is highly challenging, when some sources provide conflicting claims and others no claims at all.…
Improved method for unbiased causal discovery in presence of unobserved confounding.
problem Unbiased data synthesis for causal discovery algorithms in the presence of unobserved confounding.
method Explicit block-hierarchical ancestral sampling to address limitations of implicit parameterization.
result Our approach fully covers the space of causal models, including those generated by implicit parameterization.
New bounds on majority voting's accuracy for multi-class classification problems.
problem Determining the accuracy of majority voting for multi-class classification.
method Analyzing the majority voting function under different voter conditions and distributions.
result The error rate of majority voting exponentially decays or grows with the number of voters under certain conditions.
The problem of estimating event truths from conflicting agent opinions in a social network is investigated. An autoencoder learns the complex relationships between event truths, agent reliabilities and agent observations. A Bayesian network model is proposed to guide the learning process by modeling the relationship of…
Neural causal discovery methods fail to accurately uncover causal structures due to the faithfulness property.
problem Accuracy in neural causal discovery is limited, especially when distinguishing between existing and non-existing causal relationships.
method Systematic evaluation of neural causal discovery methods, focusing on their performance in finite sample regimes and their ability to recover ground-truth graphs.
result Neural networks lack the precision to reliably recover ground-truth causal graphs, even for small graphs and large sample sizes.
Interpretable framework evaluates structure learning methods for causal discovery from observational data.
problem Evaluation of structure learning methods under assumption violations in causal discovery.
method Six-dimensional evaluation metric (DOS) tailored for causal discovery.
result Amortized causal discovery delivers results with high proximity to the optimal solution.
Discovery of causal relations from observational data is essential for many disciplines of science and real-world applications. However, unlike other machine learning algorithms, whose development has been greatly fostered by a large amount of available benchmark datasets, causal discovery algorithms are notoriously di…
CausalTime generates realistic time-series for TSCD evaluation.
problem Lack of realistic synthetic datasets for TSCD performance evaluation.
method Harnessing deep neural networks and normalizing flow for dynamics, extracting causal graphs, and deriving ground truth causal graphs.
result Generated datasets accurately reflect real data and ground truth causal graphs.
Framework isolates causal effects from time series data, improving accuracy under non-stationarity and autocorrelation.
problem Causal inference in non-stationary, autocorrelated time series data.
method Decomposes time series into trend, seasonal, and residual components; performs component-specific causal analysis.
result Framework more accurately recovers ground-truth causal structure than state-of-the-art baselines, especially under strong non-stationarity and temporal autocorrelation.
DECI combines causal discovery and inference in a single model for diverse data types.
problem Combining causal discovery and inference methods for diverse data types.
method Develops a single flow-based non-linear additive noise model (DECI) for causal discovery and inference.
result DECI can recover ground truth causal graphs and perform (C)ATE estimation.
New methods identify concepts in trained embeddings reliably without human labels.
problem Identifying interpretable concepts in trained embedding spaces without human labels.
method Explicitly connecting concept discovery to PCA and ICA, proposing novel approaches for dependent concepts.
result Proven methods outperform competitors on a variety of experiments, achieving up to 29% better alignment with ground truth.
Calibration without labels in multiple testing
problem Interpretable error probabilities in large-scale hypothesis testing
method Constructing pseudo-labels from spacings of ordered p-values result Finding that q-value can be severely miscalibrated TimeGraph creates synthetic datasets for robust time-series causal discovery.
problem Lack of reliable synthetic benchmark datasets for robust time-series causal discovery.
method Developed comprehensive synthetic datasets with temporal properties, including trends, seasonality, and noise.
result Demonstrated significant variations in algorithm performance under realistic temporal conditions.
Proposes a new framework to evaluate causal discovery methods for time series data.
problem Lack of ground truth for causal discovery in time series data.
method Flexible framework for generating synthetic time series data.
result Demonstrates degradation in performance when assumptions are violated.
We introduce Grinch, a new algorithm for large-scale, non-greedy hierarchical clustering with general linkage functions that compute arbitrary similarity between two point sets. The key components of Grinch are its rotate and graft subroutines that efficiently reconfigure the hierarchy as new points arrive, supporting …
The study analyzes and mitigates errors in PC-based causal discovery methods.
problem Errors in PC-based causal discovery methods can lead to incorrect graphs.
method The study introduces coherency scores to detect assumption violations and small sample errors in PC-based methods.
result The coherency scores can detect errors that other methods cannot, bridging between global and local error detection.
CausalRivers benchmarks causal discovery methods on real-world river discharge data.
problem Lack of in-the-wild evaluation of causal discovery methods on complex, real-world data.
method Introduces CausalRivers, a large-scale dataset of river discharge data for benchmarking.
result Demonstrates the utility of CausalRivers in evaluating causal discovery methods.
A new method predicts causal relationships without joint data.
problem Falsifying causal discovery algorithms without ground truth.
method Leave-One-Variable-Out (LOVO) prediction for causal graphs.
result LOVO method correlates prediction error with causal algorithm accuracy.
ProEval efficiently estimates AI performance and discovers failures using pre-trained Gaussian Processes.
problem Resource-intensive evaluation of generative AI models.
method ProEval uses pre-trained Gaussian Processes and Bayesian quadrature to estimate performance and discover failures.
result ProEval requires significantly fewer samples to achieve accurate performance estimates and reveals more diverse failure cases.
Discovery of an accurate causal Bayesian network structure from observational data can be useful in many areas of science. Often the discoveries are made under uncertainty, which can be expressed as probabilities. To guide the use of such discoveries, including directing further investigation, it is important that thos…
One of the most surprising and exciting discoveries in supervised learning was the benefit of overparameterization (i.e. training a very large model) to improving the optimization landscape of a problem, with minimal effect on statistical performance (i.e. generalization). In contrast, unsupervised settings have been u…
This paper introduces a new system for discovering patterns in morphogenetic systems using modular architecture and unsupervised learning.
problem Discovering novel patterns in morphogenetic systems is challenging and often relies on manual tuning.
method Introduces a hierarchical, modular architecture for unsupervised learning of diverse representations combined with goal exploration algorithms.
result The new system efficiently adapts diversity search towards user preferences with minimal feedback.
We discover subgroups for Cox model survival analysis, improving model accuracy.
problem Finding interpretable subsets of data where Cox model is highly accurate.
method Developed new metrics (EPE, CRS) and algorithms to solve subgroup discovery problem.
result Our methods improve model fit and recover known nonlinearities in data.
New algorithm reduces interventional strategy complexity for causal graph discovery.
problem Designing efficient interventional strategies for causal graph discovery.
method Developed an r-adaptive algorithm for causal graph discovery that minimizes the number of interventions.
result Achieved an approximation of O(min{r, log n} * n^{1/min{r, log n}}) for the verification number.
Model discovers causal relationships from video data of physical systems.
problem Discover structural dependencies and causal interactions in physical systems from video data.
method End-to-end model with perception, inference, and dynamics modules; handles unknown interventions.
result Model correctly identifies causal interactions and makes long-term predictions.
M-CaStLe discovers causal structures in multivariate space-time data.
problem Challenges in causal graph discovery for high-dimensional gridded data.
method Generalizes CaStLe to multivariate analyses, using local embeddings and pooling spatial replicates.
result More accurately recovers multivariate causal structure and identifies physical dynamics.
New estimator improves mutual information estimation.
problem Estimating mutual information in data science and machine learning.
method Proposes a new estimator that uses a preliminary estimate of the data distribution.
result A preliminary estimate helps in estimating mutual information more accurately.
The discovery of causal relationships from purely observational data is a fundamental problem in science. The most elementary form of such a causal discovery problem is to decide whether X causes Y or, alternatively, Y causes X, given joint observations of two variables X, Y. An example is to decide whether altitude ca…
CASPER improves DAG structure learning by integrating graph structure into score function.
problem Discovering suboptimal DAGs and model vulnerabilities in causal discovery.
method CASPER integrates graph structure into the score function as a new measure in the causal space, enhancing DAG structure learning via adaptive attention to DAG-ness.
result CASPER outperforms state-of-the-art methods in terms of accuracy and robustness.
CSTS benchmarks time series clustering by evaluating correlation structures.
problem Lack of validated ground truth for objectively assessing clustering quality.
method Synthetic benchmark CSTS for evaluating correlation structures in multivariate time series data.
result CSTS enables precise diagnosis of methodological limitations in correlation-based time series clustering.
New method learns high-quality Laplacian representations for reinforcement learning.
problem Lack of accurate Laplacian representations in large or continuous state spaces.
method Reformulated spectral graph drawing objective to have eigenvectors as unique global minimizer.
result Learned Laplacian representations more faithfully approximate the ground truth.
We consider the problem of learning an interpretable potential energy function from a Hamiltonian system's trajectories. We address this problem for classical, separable Hamiltonian systems. Our approach first constructs a neural network model of the potential and then applies an equation discovery technique to extract…
Causal modeling has long been an attractive topic for many researchers and in recent decades there has seen a surge in theoretical development and discovery algorithms. Generally discovery algorithms can be divided into two approaches: constraint-based and score-based. The constraint-based approach is able to detect co…
Simulated DAGs can mislead structure learning algorithms due to variance patterns.
problem Structure learning algorithms can be misled by variance patterns in simulated DAG models.
method Introduced varsortability as a measure of agreement between marginal variance order and causal order.
result Performance of structure learning algorithms can be explained by high varsortability, but this does not generalize to real-world data.
A method uses non-autonomous equations to classify time signals efficiently.
problem Time signal classification with minimal parameters and high accuracy.
method Develops a framework using non-autonomous dynamical equations to classify time signals.
result The method achieves comparable accuracy with fewer parameters than existing methods.
New truthful calibration errors improve model ranking in multiclass prediction.
problem Non-truthful calibration errors can mislead model comparisons.
method Introduced perfectly truthful calibration errors for multiclass predictions.
result Truthful calibration errors preserve decision-theoretic dominance and stabilize model rankings.
In this paper, we propose multi-variable LSTM capable of accurate forecasting and variable importance interpretation for time series with exogenous variables. Current attention mechanism in recurrent neural networks mostly focuses on the temporal aspect of data and falls short of characterizing variable importance. To …
XGES improves GES by favoring early edge deletion, outperforming GES in finite data settings.
problem Learning directed acyclic graphs from finite data.
method Extremely Greedy Equivalent Search (XGES) improves GES by favoring early edge deletion.
result XGES consistently outperforms GES in recovering the correct graphs, and is 10 times faster.
The paper tackles causal rule discovery from observational data.
problem Challenges in inferring causal effects from observational data due to confounding factors and high variance.
method Measures causal effect from observational data, providing graphical criteria and a conservative estimator.
result Proposes an efficient algorithm that maximises the estimator and discovers meaningful causal rules.
New calibration measure SSCE ensures truthful prediction, unlike existing measures.
problem Ensuring truthful calibration measures in sequential prediction.
method Introduced a new calibration measure, Subsampled Smooth Calibration Error (SSCE).
result SSCE ensures truthful prediction, while existing measures are far from truthful.
This paper presents KeypointNet, an end-to-end geometric reasoning framework to learn an optimal set of category-specific 3D keypoints, along with their detectors. Given a single image, KeypointNet extracts 3D keypoints that are optimized for a downstream task. We demonstrate this framework on 3D pose estimation by pro…
A new perfectly truthful calibration measure improves prediction reliability.
problem Improving the reliability of predictions by ensuring they are conditionally unbiased.
method Designing a simple, perfectly truthful calibration measure called ATB.
result ATB is the first perfectly truthful calibration measure in the batch setting.
New model predicts energy prices under different scenarios.
problem Complex causal relationships in energy markets with continuous regime changes.
method Augmented Time Series Structural Causal Models (ATSCM) integrating neural causal discovery.
result Enables novel counterfactual queries in energy markets.