New method tests causal relationships from data without needing to learn the entire graph.
problem Testing if a causal graph belongs to a specific Markov equivalence class from observational data.
method Established bounds on the number of independence tests required and provided an algorithm that matches these bounds.
result Testing requires exponentially less independence tests compared to learning, especially in graphs with high in-degrees and small clique sizes.
As in the case of the associahedron and cyclohedron, the permutohedron can also be defined as an appropriate compactification of a configuration space of points on an interval or on a circle. The construction of the compactification endows the permutohedron with a projection to the cyclohedron, and the cyclohedron with…
Polytopes A(P) for posets P compactify spaces of order-preserving maps.
problem Compactifying spaces of order-preserving maps for posets.
method Constructing polytopes A(P) and compactifying spaces of order-preserving maps. result Polytopes A(P) correspond to nested collections of subsets of posets. A new differentiable model for sampling DAGs that speeds up optimization.
problem Efficiently sampling and learning DAG structures in continuous optimization.
method DP-DAG model with VI-DP-DAG for DAG learning from data.
result VI-DP-DAG outperforms other methods in DAG structure and causal mechanism learning.
We realize Stasheff's multiplihedron geometrically as the moduli space of stable quilted disks. This generalizes the geometric realization of the associahedron as the moduli space of stable disks. We show that this moduli space is the non-negative real part of a complex moduli space of stable scaled marked curves.
Paper proposes a method to improve DAG structure reconstruction using auxiliary DAGs.
problem Improving DAG structure reconstruction with limited data.
method Introduces structural similarity measures and a transfer learning framework.
result Significant improvement in DAG reconstruction, even with dissimilar auxiliary DAGs.
Paper studies sparsity and DAG constraints for learning linear DAGs.
problem Learning DAGs from data is challenging due to the large search space.
method Formulates structure learning as a constrained optimization problem with soft sparsity and DAG constraints.
result Soft sparsity and DAG constraints lead to an easier optimization problem.
New DAG constraints improve differentiable DAG learning.
problem Recovering DAG structures from observational data is hard due to combinatorial optimization.
method Developed analytic functions to formulate DAG constraints, closed under differentiation, summation, and multiplication.
result Analytic DAG constraints outperform previous methods in various settings.
New method improves DAG learning by using large coefficients for higher-order terms.
problem Recovering DAG structures from observational data is challenging due to combinatorial optimization.
method Proposes truncated matrix power iteration to approximate DAG constraints efficiently.
result Empirically outperforms previous methods by a factor of 3 or more in structural Hamming distance.
Several real problems ranging from text classification to computational biology are characterized by hierarchical multi-label classification tasks. Most of the methods presented in literature focused on tree-structured taxonomies, but only few on taxonomies structured according to a Directed Acyclic Graph (DAG). In thi…
CASPER improves DAG structure learning by integrating graph structure into score function.
problem Discovering suboptimal DAGs and model vulnerabilities in causal discovery.
method CASPER integrates graph structure into the score function as a new measure in the causal space, enhancing DAG structure learning via adaptive attention to DAG-ness.
result CASPER outperforms state-of-the-art methods in terms of accuracy and robustness.
Learning DAG or Bayesian network models is an important problem in multi-variate causal inference. However, a number of challenges arises in learning large-scale DAG models including model identifiability and computational complexity since the space of directed graphs is huge. In this paper, we address these issues in …
DrBO uses Bayesian optimization to learn DAGs more efficiently.
problem Inaccurate and inefficient DAG learning from observational data.
method Bayesian optimization to find high-scoring DAGs efficiently.
result DrBO finds higher-scoring DAGs more efficiently than existing methods.
This paper proposes MM-DAGs for analyzing traffic congestion, learning multiple DAGs jointly.
problem Analyzing multi-modal traffic data with overlapping and distinct variables.
method Developed MM-DAGs for multi-task, multi-modal DAG learning, using multi-modal regression and CD measure.
result Proved the effectiveness of MM-DAGs in traffic congestion analysis.
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study dee…
Efficiently learns DAG structures without cycles.
problem Learning DAG structures efficiently with constraints.
method Proposes DAG-NoCurl, a two-step algorithm to find and project acyclic graphs.
result Significantly improves efficiency over existing methods, often by more than one order of magnitude.
New method aggregates bootstrapped DAGs for causal discovery.
problem Aggregation of bootstrapped DAGs ignores higher-order structures.
method Theoretical framework and new DAG aggregation algorithm.
result Proposed method outperforms state-of-the-art solutions.
The search space of Bayesian Network structures is usually defined as Acyclic Directed Graphs (DAGs) and the search is done by local transformations of DAGs. But the space of Bayesian Networks is ordered by DAG Markov model inclusion and it is natural to consider that a good search policy should take this into account.…
This paper considers the problem of estimating the structure of multiple related directed acyclic graph (DAG) models. Building on recent developments in exact estimation of DAGs using integer linear programming (ILP), we present an ILP approach for joint estimation over multiple DAGs, that does not require that the ver…
Paper proposes DAG-DB for learning discrete DAGs via backpropagation.
problem Learning Directed Acyclic Graphs (DAGs) from data.
method DAG-DB uses Discrete Backpropagation with I-MLE and Straight-Through Estimation.
result DAG-DB learns DAGs effectively using probabilistic sampling and backpropagation.
A directed acyclic graph (DAG) is the most common graphical model for representing causal relationships among a set of variables. When restricted to using only observational data, the structure of the ground truth DAG is identifiable only up to Markov equivalence, based on conditional independence relations among the v…
In Peña (2007), MCMC sampling is applied to approximately calculate the ratio of essential graphs (EGs) to directed acyclic graphs (DAGs) for up to 20 nodes. In the present paper, we extend that work from 20 to 31 nodes. We also extend that work by computing the approximate ratio of connected EGs to connected DAGs, of …
DAG-FM discovers causal relationships from heterogeneous data.
problem Challenges in causal discovery from heterogeneous causal mechanisms.
method DAG-FM uses two specialized Transformer-based sub-modules and a robust tabular interaction block to model complex row-column interactions.
result DAG-FM achieves state-of-the-art performance on synthetic and real-world datasets.
There are several ways of a construction of a boundary of a symmetric space using pencils of geodesics: the Karpelevich boundary, the visibility boundary, the associahedral boundary, and the sea urchin. We give explicit descriptions of these boundaries. We obtain some moduli space like polyhedra as sections of these co…
Bayesian method identifies causal DAG structure from non-Gaussian errors.
problem Learning causal structure from non-Gaussian errors in Bayesian networks.
method Bayesian hierarchical model with DAG prior for non-Gaussian errors.
result Posterior DAG selection consistency achieved under mild assumptions.
Causal processes in biomedicine may contain cycles, evolve over time or differ between populations. However, many graphical models cannot accommodate these conditions. We propose to model causation using a mixture of directed cyclic graphs (DAGs), where the joint distribution in a population follows a DAG at any single…
This is an investigation of the role of shuffling and concatenating in the theory of graph drawing. A simple syntactic description of these and related operations is proved complete in the context of finite partial orders, as general as possible. An explanation based on that is given for a previously investigated colla…
Bayesian method models binary response and covariates for two groups, estimating causal relationships.
problem Estimating causal relationships between binary response and covariates in observational data.
method Gaussian DAG-probit model with MCMC sampling for posterior distribution estimation.
result Validated method on simulated and real datasets, showing value of grouping variable in causality.
ALIAS uses RL to learn DAGs without acyclicity constraints.
problem Efficiently learning DAGs from observational data without acyclicity constraints.
method ALIAS employs RL to generate DAGs in a single step with optimal complexity, bypassing acyclicity constraints.
result ALIAS outperforms state-of-the-art methods in causal discovery.
Efficiently learns linear non-Gaussian DAGs with noisy nodes.
problem Learning DAGs with non-Gaussian noise and diverging number of nodes.
method Proposes a novel method using topological layers for bottom-up reconstruction and consistent parent-child relations.
result Topological layers can be exactly reconstructed and parent-child relations established without faithfulness assumption.
BCD Nets use variational inference to estimate DAGs with uncertainty.
problem Uncertainty in inferring causal graphs from limited data.
method Variational inference framework for Bayesian DAG estimation.
result BCD Nets outperform maximum-likelihood methods in low data regimes.
The paper develops personalized DAG models for web user behavior.
problem Understanding user behavior transitions between websites with user heterogeneity and network dependency.
method Personalized Binomial DAG models with network-structured covariates, embedding network structure into a dimension-reduced covariate, learning node neighborhoods, and exploring variance-mean relation.
result The proposed algorithm outperforms state-of-the-art competitors in heterogeneous data.
DAPDAG learns DAG structure to adapt predictions across domains.
problem Predicting in a new domain without labeled data.
method Auto-encoder with DAG reconstruction as auxiliary task.
result Reconstructing DAG benefits approximate inference and prediction.
GES algorithm improves consistency for nonparametric DAG models.
problem Consistent estimation of nonparametric DAG models.
method Greedy equivalence search with new consistency proof for nonparametric families.
result Consistency of GES for general nonparametric DAG models with smooth factorization.
DAG-WGAN learns causal structures using Wasserstein distance.
problem Learning causal structures from data with combinatorial challenges.
method Combines Wasserstein distance, auto-encoder, and acyclicity constraint.
result Demonstrates good performance compared to state-of-the-art models.
Paper proposes a new multi-task causal Gaussian process model for better prediction and uncertainty estimation.
problem Learning causal effects of interventions on different subsets of variables in a DAG.
method DAG-GP model that allows information sharing across interventions and experiments on different variables.
result DAG-GP achieves the best fitting performance and faster optimal intervention selection compared to single-task models.
A new method learns DAGs from data using permutation optimization.
problem Discovering latent DAGs from observational data.
method Optimizes over the Permutahedron to learn topological orderings and edges.
result Our method optimizes exact DAGs, is modular, and performs well on real-world data.
Polynomial-time methods count and sample DAGs from equivalence classes.
problem Counting and sampling DAGs from Markov equivalence classes.
method Polynomial-time algorithms for DAGs.
result Counting and sampling can be done in polynomial time.
Framework for learning sparse DAGs from data.
problem Learning sparse directed acyclic graphs (DAGs) from data.
method Algebraic characterization of DAGs extended to nonparametric SEM, continuous optimization problem.
result General framework applicable to various nonparametric and semiparametric models.
Proposes supervised method for whole DAG causal structure learning.
problem Learning causal directions from data, especially for whole DAG structure.
method Supervised learning approach using permutation equivariant models.
result Promising results compared to previous approaches on synthetic and real data.
The paper tackles learning varying DAG structures based on contextual features.
problem Learning a single DAG for the entire population from observational data.
method A neural network that maps contextual features to a weighted adjacency matrix of a DAG, with a projection layer to ensure acyclicity.
result The new approach can recover context-specific DAGs where existing methods fail.
Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations are correlated according to an undirected network. Under this model, we develop a …
Discover causal structure from mixtures of DAGs using latent variable algorithms.
problem Discover causal structure from distributions arising from mixtures of DAGs.
method Causal structure discovery algorithms such as FCI for latent variables.
result Recover a 'union' of the component DAGs and identify varying conditional distributions.
Proposes a method to estimate causal effects over a range of DAGs, addressing uncertainty in prior knowledge.
problem Uncertainty in prior knowledge of causal relationships between variables.
method Gradient-based optimization method providing bounds for causal queries over a collection of causal graphs.
result Bounds achieve good coverage and sharpness for causal queries in various settings.
Given an n-gon, the poset of all collections of pairwise non-crossing diagonals is isomorphic to the face poset of some convex polytope called \textit{associahedron}. We replace in this setting the n-gon (viewed as a disc with n marked points on the boundary) with an arbitrary oriented surface with a number of la…
ICP models flexible DAG structures using Bayesian nonparametrics.
problem Learning the structure of complex neural networks.
method Bayesian nonparametric prior on DAGs and orders controlled by a latent Beta Process.
result ICP supports every possible DAG structure.
ExDAG solves DAG learning problems with low structural Hamming distance.
problem Learning DAGs with low structural Hamming distance under identifiability assumptions.
method Mixed-integer quadratic programming (MIQP) with branch-and-bound-and-cut algorithm and lazy constraints.
result ExDAG guarantees global convergence and provides a real-time quality assessment.
Majority bit estimation in noisy random recursive DAGs.
problem Estimating the majority bit in a noisy random recursive DAG.
method Majority rule among nodes, with bit flipping and noisy channel.
result Identification of the threshold for p at which majority rule yields errors.