A new differentiable model for sampling DAGs that speeds up optimization.
problem Efficiently sampling and learning DAG structures in continuous optimization.
method DP-DAG model with VI-DP-DAG for DAG learning from data.
result VI-DP-DAG outperforms other methods in DAG structure and causal mechanism learning.
Polynomial-time methods count and sample DAGs from equivalence classes.
problem Counting and sampling DAGs from Markov equivalence classes.
method Polynomial-time algorithms for DAGs.
result Counting and sampling can be done in polynomial time.
A directed acyclic graph (DAG) is the most common graphical model for representing causal relationships among a set of variables. When restricted to using only observational data, the structure of the ground truth DAG is identifiable only up to Markov equivalence, based on conditional independence relations among the v…
Paper proposes DAG-DB for learning discrete DAGs via backpropagation.
problem Learning Directed Acyclic Graphs (DAGs) from data.
method DAG-DB uses Discrete Backpropagation with I-MLE and Straight-Through Estimation.
result DAG-DB learns DAGs effectively using probabilistic sampling and backpropagation.
Optimal sample complexity for learning Gaussian DAG models established.
problem Learning the structure of Gaussian DAG models from observational data.
method Established minimax optimal sample complexity for two settings: equal variances without ordering knowledge and general linear models with ordering knowledge.
result Optimal sample complexity n≍qlog(d/q) for both settings, matching undirected graphical models under equal variances. We study the Bayesian model averaging approach to learning Bayesian network structures (DAGs) from data. We develop new algorithms including the first algorithm that is able to efficiently sample DAGs according to the exact structure posterior. The DAG samples can then be used to construct estimators for the posterior …
Paper studies sparsity and DAG constraints for learning linear DAGs.
problem Learning DAGs from data is challenging due to the large search space.
method Formulates structure learning as a constrained optimization problem with soft sparsity and DAG constraints.
result Soft sparsity and DAG constraints lead to an easier optimization problem.
In Peña (2007), MCMC sampling is applied to approximately calculate the ratio of essential graphs (EGs) to directed acyclic graphs (DAGs) for up to 20 nodes. In the present paper, we extend that work from 20 to 31 nodes. We also extend that work by computing the approximate ratio of connected EGs to connected DAGs, of …
Optimal sample complexity for learning DDAGs from noisy data.
problem Learning interactions in linear dynamical systems over DAGs.
method Proposed a metric and algorithm based on PSD matrix for reconstruction.
result Optimal sample complexity n=Θ(qlog(p/q)) for learning DDAGs. Bayesian method models binary response and covariates for two groups, estimating causal relationships.
problem Estimating causal relationships between binary response and covariates in observational data.
method Gaussian DAG-probit model with MCMC sampling for posterior distribution estimation.
result Validated method on simulated and real datasets, showing value of grouping variable in causality.
Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations are correlated according to an undirected network. Under this model, we develop a …
New method aggregates bootstrapped DAGs for causal discovery.
problem Aggregation of bootstrapped DAGs ignores higher-order structures.
method Theoretical framework and new DAG aggregation algorithm.
result Proposed method outperforms state-of-the-art solutions.
DrBO uses Bayesian optimization to learn DAGs more efficiently.
problem Inaccurate and inefficient DAG learning from observational data.
method Bayesian optimization to find high-scoring DAGs efficiently.
result DrBO finds higher-scoring DAGs more efficiently than existing methods.
Polynomial-time methods count and sample DAGs from Markov classes.
problem Counting and sampling Markov equivalent DAGs.
method Polynomial-time algorithms for DAGs from Markov classes.
result Long-standing open problem solved, making practical infeasible strategies feasible.
Bayesian method identifies causal DAG structure from non-Gaussian errors.
problem Learning causal structure from non-Gaussian errors in Bayesian networks.
method Bayesian hierarchical model with DAG prior for non-Gaussian errors.
result Posterior DAG selection consistency achieved under mild assumptions.
DAG-WGAN learns causal structures using Wasserstein distance.
problem Learning causal structures from data with combinatorial challenges.
method Combines Wasserstein distance, auto-encoder, and acyclicity constraint.
result Demonstrates good performance compared to state-of-the-art models.
Learning a faithful directed acyclic graph (DAG) from samples of a joint distribution is a challenging combinatorial problem, owing to the intractable search space superexponential in the number of graph nodes. A recent breakthrough formulates the problem as a continuous optimization with a structural constraint that e…
DAGgr aggregates multiple DAGs to stabilize causal structure learning.
problem Stability in learning causal structure from data.
method Model averaging of candidate DAGs weighted by predictive likelihood, with acyclicity enforced.
result DAGgr consistently outperforms individual DAGs and bootstrap-aggregation baselines.
Fuzzy cognitive maps (FCMs) model feedback causal relations in interwoven webs of causality and policy variables. FCMs are fuzzy signed directed graphs that allow degrees of causal influence and event occurrence. Such causal models can simulate a wide range of policy scenarios and decision processes. Their directed loo…
We consider distributions arising from a mixture of causal models, where each model is represented by a directed acyclic graph (DAG). We provide a graphical representation of such mixture distributions and prove that this representation encodes the conditional independence relations of the mixture distribution. We then…
A new sampler improves the inference of causal structures from observational data.
problem Inferring causal relationships from observational data when DAGs are Markov equivalent.
method Developed a non-reversible Markov chain, Causal Zig-Zag sampler, targeting Markov Equivalence Classes of DAGs.
result The sampler improves mixing and offers efficient algorithms for DAG inference.
Learning the directed acyclic graph (DAG) structure of a Bayesian network from observational data is a notoriously difficult problem for which many hardness results are known. In this paper we propose a provably polynomial-time algorithm for learning sparse Gaussian Bayesian networks with equal noise variance --- a cla…
Simulated DAGs can mislead structure learning algorithms due to variance patterns.
problem Structure learning algorithms can be misled by variance patterns in simulated DAG models.
method Introduced varsortability as a measure of agreement between marginal variance order and causal order.
result Performance of structure learning algorithms can be explained by high varsortability, but this does not generalize to real-world data.
Directed acyclic graph (DAG) models are popular for capturing causal relationships. From observational and interventional data, a DAG model can only be determined up to its \emph{interventional Markov equivalence class} (I-MEC). We investigate the size of MECs for random DAG models generated by uniformly sampling and o…
Develops methods for constructing parameter priors in DAG models.
problem Constructing parameter priors for model choice among DAG models.
method Introduces assumptions and methods for parameter priors construction and marginal likelihood computation.
result The only parameter prior for complete Gaussian DAG models that satisfies assumptions is the normal-Wishart distribution.
DAGnosis uses DAGs to identify and localize data inconsistencies.
problem Handling data inconsistencies in machine learning models at deployment time.
method Directed acyclic graphs (DAGs) to encode feature probability distribution and independencies.
result Localization of inconsistencies and insights into their causes.
Bayesian structure learning improved using GFlowNets.
problem Inferring Bayesian network structure from data.
method Using Generative Flow Networks (GFlowNets) for approximating posterior DAG distributions.
result DAG-GFlowNet provides an accurate approximation of the posterior over DAGs.
Probabilistic graphical models are graphical representations of probability distributions. Graphical models have applications in many fields including biology, social sciences, linguistic, neuroscience. In this paper, we propose directed acyclic graphs (DAGs) learning via bootstrap aggregating. The proposed procedure i…
A new method for identifying causal directions in complex systems.
problem Identifying causal relationships in nonlinear systems with limited data.
method Sequential edge orientation approach using pairwise additive noise model.
result The method can recover true causal DAGs under nonlinear additive noise models.
Paper proposes a method to improve DAG structure reconstruction using auxiliary DAGs.
problem Improving DAG structure reconstruction with limited data.
method Introduces structural similarity measures and a transfer learning framework.
result Significant improvement in DAG reconstruction, even with dissimilar auxiliary DAGs.
We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with p≫n. Our main results establish support recovery guarantees and deviation bounds for a family of penalized least-squares estima…
Extends causal additive models to include higher-order interactions.
problem Inferring causal insights from data with higher-order mechanisms.
method Introduces directed acyclic hypergraphs to represent higher-order interactions in causal structure learning.
result Learning more complex hypergraphs can lead to better empirical results.
New DAG constraints improve differentiable DAG learning.
problem Recovering DAG structures from observational data is hard due to combinatorial optimization.
method Developed analytic functions to formulate DAG constraints, closed under differentiation, summation, and multiplication.
result Analytic DAG constraints outperform previous methods in various settings.
New method improves DAG learning by using large coefficients for higher-order terms.
problem Recovering DAG structures from observational data is challenging due to combinatorial optimization.
method Proposes truncated matrix power iteration to approximate DAG constraints efficiently.
result Empirically outperforms previous methods by a factor of 3 or more in structural Hamming distance.
Several real problems ranging from text classification to computational biology are characterized by hierarchical multi-label classification tasks. Most of the methods presented in literature focused on tree-structured taxonomies, but only few on taxonomies structured according to a Directed Acyclic Graph (DAG). In thi…
CASPER improves DAG structure learning by integrating graph structure into score function.
problem Discovering suboptimal DAGs and model vulnerabilities in causal discovery.
method CASPER integrates graph structure into the score function as a new measure in the causal space, enhancing DAG structure learning via adaptive attention to DAG-ness.
result CASPER outperforms state-of-the-art methods in terms of accuracy and robustness.
CASTLE learns causal DAG to improve model generalization.
problem Improving model generalization to out-of-sample data.
method CASTLE learns causal relationships via adjacency matrix embedded in neural network input layers, reconstructing only causal features.
result CASTLE leads to better out-of-sample predictions compared to other regularizers.
Learning DAG or Bayesian network models is an important problem in multi-variate causal inference. However, a number of challenges arises in learning large-scale DAG models including model identifiability and computational complexity since the space of directed graphs is huge. In this paper, we address these issues in …
Bayesian networks are probabilistic graphical models widely employed to understand dependencies in high dimensional data, and even to facilitate causal discovery. Learning the underlying network structure, which is encoded as a directed acyclic graph (DAG) is highly challenging mainly due to the vast number of possible…
Estimates multiple related causal graphs with shared causal order.
problem Discovering multiple related Gaussian DAGs with shared causal order.
method Proposes a l1/l2-regularized MLE for joint estimation of K linear structural equation models. result Joint estimator achieves better sample complexity and consistency in causal order recovery.
This paper proposes MM-DAGs for analyzing traffic congestion, learning multiple DAGs jointly.
problem Analyzing multi-modal traffic data with overlapping and distinct variables.
method Developed MM-DAGs for multi-task, multi-modal DAG learning, using multi-modal regression and CD measure.
result Proved the effectiveness of MM-DAGs in traffic congestion analysis.
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study dee…
Paper introduces MN-DAG for modeling evolving causal relationships in multivariate time series.
problem Modeling causal relationships that evolve over time and occur at different scales.
method Probabilistic generative model based on spectral and causality theories, combined with Bayesian stochastic variational inference.
result MN-CASTLE outperforms baseline models in identifying causal relationships in multivariate time series data.
Efficiently learns DAG structures without cycles.
problem Learning DAG structures efficiently with constraints.
method Proposes DAG-NoCurl, a two-step algorithm to find and project acyclic graphs.
result Significantly improves efficiency over existing methods, often by more than one order of magnitude.
We show that the square Hellinger distance between two Bayesian networks on the same directed graph, G, is subadditive with respect to the neighborhoods of G. Namely, if P and Q are the probability distributions defined by two Bayesian networks on the same DAG, our inequality states that the square Hellinger di…
Proposes a hierarchical model for learning discrete Bayesian networks with shrinkage.
problem Learning discrete Bayesian networks with high-order interactions and cell probabilities.
method Hierarchical Dirichlet shrinkage model with Metropolis-adjusted Langevin algorithm for sampling.
result Efficiently learns graph structure and selects between DAGs from sparse count data.
The search space of Bayesian Network structures is usually defined as Acyclic Directed Graphs (DAGs) and the search is done by local transformations of DAGs. But the space of Bayesian Networks is ordered by DAG Markov model inclusion and it is natural to consider that a good search policy should take this into account.…
Deep Gaussian Processes model functions on DAGs with partially observed data.
problem Reconstructing and inferring from partially observed functions on DAGs with noisy measurements.
method Place priors over functions on DAGs, theoretically study prior-collapse behavior, and offer a structured variational approximation.
result Almost-sure lower bounds on the preservation of input distinctions and interpretability of simulator hierarchies.