Paper studies sparsity and DAG constraints for learning linear DAGs.
problem Learning DAGs from data is challenging due to the large search space.
method Formulates structure learning as a constrained optimization problem with soft sparsity and DAG constraints.
result Soft sparsity and DAG constraints lead to an easier optimization problem.
A new differentiable model for sampling DAGs that speeds up optimization.
problem Efficiently sampling and learning DAG structures in continuous optimization.
method DP-DAG model with VI-DP-DAG for DAG learning from data.
result VI-DP-DAG outperforms other methods in DAG structure and causal mechanism learning.
Efficiently learns linear non-Gaussian DAGs with noisy nodes.
problem Learning DAGs with non-Gaussian noise and diverging number of nodes.
method Proposes a novel method using topological layers for bottom-up reconstruction and consistent parent-child relations.
result Topological layers can be exactly reconstructed and parent-child relations established without faithfulness assumption.
This paper considers the problem of estimating the structure of multiple related directed acyclic graph (DAG) models. Building on recent developments in exact estimation of DAGs using integer linear programming (ILP), we present an ILP approach for joint estimation over multiple DAGs, that does not require that the ver…
We establish a new framework for statistical estimation of directed acyclic graphs (DAGs) when data are generated from a linear, possibly non-Gaussian structural equation model. Our framework consists of two parts: (1) inferring the moralized graph from the support of the inverse covariance matrix; and (2) selecting th…
New method tests DAGs without assuming linear or independent data.
problem Testing DAGs with nonlinear and time-dependent data.
method Structural, supervised and generative adversarial learning.
result Asymptotic guarantees for the test, allowing diverging data dimensions.
Proposes a method to estimate causal effects over a range of DAGs, addressing uncertainty in prior knowledge.
problem Uncertainty in prior knowledge of causal relationships between variables.
method Gradient-based optimization method providing bounds for causal queries over a collection of causal graphs.
result Bounds achieve good coverage and sharpness for causal queries in various settings.
Efficiently learns DAG structures without cycles.
problem Learning DAG structures efficiently with constraints.
method Proposes DAG-NoCurl, a two-step algorithm to find and project acyclic graphs.
result Significantly improves efficiency over existing methods, often by more than one order of magnitude.
This paper proposes MM-DAGs for analyzing traffic congestion, learning multiple DAGs jointly.
problem Analyzing multi-modal traffic data with overlapping and distinct variables.
method Developed MM-DAGs for multi-task, multi-modal DAG learning, using multi-modal regression and CD measure.
result Proved the effectiveness of MM-DAGs in traffic congestion analysis.
Paper recovers latent causal structure and linear transformation from indirect observations.
problem Recovering latent causal structure and linear transformation from indirect observations.
method Established sufficient conditions for DAG recovery, leveraged score function properties, and used soft/hard interventions.
result Perfect recovery of latent DAG structure and linear transformation up to scaling using soft interventions, hard interventions with additional hypothesis testing.
Paper proposes a new method to identify causal graphs with latent variables using higher-order cumulants.
problem Estimating causal directed acyclic graphs with latent confounders.
method Uses higher-order cumulants to identify causal structures among observed and latent variables.
result Validates the proposed algorithm through simulations and real-world data.
Bayesian method identifies causal DAG structure from non-Gaussian errors.
problem Learning causal structure from non-Gaussian errors in Bayesian networks.
method Bayesian hierarchical model with DAG prior for non-Gaussian errors.
result Posterior DAG selection consistency achieved under mild assumptions.
New proof shows how to identify DAGs with weakly increasing errors.
problem Identifying the true DAG in models with weakly increasing error variances.
method Minimum-trace DAG method and hill climbing algorithm with R2R neighborhood.
result Hill climbing algorithm without strict local optima under weakly increasing error variances.
Optimal sample complexity for learning Gaussian DAG models established.
problem Learning the structure of Gaussian DAG models from observational data.
method Established minimax optimal sample complexity for two settings: equal variances without ordering knowledge and general linear models with ordering knowledge.
result Optimal sample complexity n≍qlog(d/q) for both settings, matching undirected graphical models under equal variances. BCD Nets use variational inference to estimate DAGs with uncertainty.
problem Uncertainty in inferring causal graphs from limited data.
method Variational inference framework for Bayesian DAG estimation.
result BCD Nets outperform maximum-likelihood methods in low data regimes.
Optimal sample complexity for learning DDAGs from noisy data.
problem Learning interactions in linear dynamical systems over DAGs.
method Proposed a metric and algorithm based on PSD matrix for reconstruction.
result Optimal sample complexity n=Θ(qlog(p/q)) for learning DDAGs. Develops methods for constructing parameter priors in DAG models.
problem Constructing parameter priors for model choice among DAG models.
method Introduces assumptions and methods for parameter priors construction and marginal likelihood computation.
result The only parameter prior for complete Gaussian DAG models that satisfies assumptions is the normal-Wishart distribution.
We develop a framework for learning sparse nonparametric directed acyclic graphs (DAGs) from data. Our approach is based on a recent algebraic characterization of DAGs that led to a fully continuous program for score-based learning of DAG models parametrized by a linear structural equation model (SEM). We extend this a…
We propose a linear-time, single-pass, top-down algorithm for multiple testing on directed acyclic graphs (DAGs), where nodes represent hypotheses and edges specify a partial ordering in which hypotheses must be tested. The procedure is guaranteed to reject a sub-DAG with bounded false discovery rate (FDR) while satisf…
pLSTM tackles long-range language modeling and computer vision tasks with parallelizable linear source transition mark networks.
problem Challenges of existing recurrent architectures in handling sequences and multi-dimensional data.
method Introduces pLSTM, a parallelizable linear source transition mark network for linear graphs and DAGs, addressing vanishing/exploding activation/gradient issues.
result pLSTM outperforms Transformers in long-range tasks like arrow-pointing extrapolation and image size extrapolation.
Paper introduces a new identifiability criterion for DAGs using conditional variances.
problem Challenges in discovering causal relationships from observational data.
method Introduces a novel identifiability criterion for DAGs using conditional variances. Uses weak majorization on Cholesky factor of covariance matrix for learning DAGs.
result Demonstrates effectiveness of the new approach in recovering DAGs through simulations and real data analysis.
Learning a faithful directed acyclic graph (DAG) from samples of a joint distribution is a challenging combinatorial problem, owing to the intractable search space superexponential in the number of graph nodes. A recent breakthrough formulates the problem as a continuous optimization with a structural constraint that e…
Paper develops a method to learn causal networks with non-invertible functions.
problem Identifying causal relationships from observational data with non-invertible functional relationships.
method Proposes a test for non-invertible bivariate causal models and develops a method to incorporate this test in structure learning of DAGs.
result Our algorithms outperform existing DAG learning methods in identifying causal graphical structures.
We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with p≫n. Our main results establish support recovery guarantees and deviation bounds for a family of penalized least-squares estima…
New method identifies extreme risk propagation in financial networks.
problem Understanding extreme risk in financial networks.
method Max-linear structural equation model, hard-thresholding, Hamming distance.
result Sparse DAG for extreme risk propagation estimated.
DAGMA learns DAGs faster and more accurately using log-determinant acyclicity.
problem Learning directed acyclic graphs from data efficiently and accurately.
method DAGMA uses M-matrices and log-determinant acyclicity to optimize DAG learning.
result DAGMA achieves faster and more accurate DAG learning compared to existing methods.
Paper proposes a method to improve DAG structure reconstruction using auxiliary DAGs.
problem Improving DAG structure reconstruction with limited data.
method Introduces structural similarity measures and a transfer learning framework.
result Significant improvement in DAG reconstruction, even with dissimilar auxiliary DAGs.
New DAG constraints improve differentiable DAG learning.
problem Recovering DAG structures from observational data is hard due to combinatorial optimization.
method Developed analytic functions to formulate DAG constraints, closed under differentiation, summation, and multiplication.
result Analytic DAG constraints outperform previous methods in various settings.
ZICO learns DAGs from zero-inflated count data efficiently.
problem Learning network structures from zero-inflated count data.
method ZICO uses node-wise likelihoods with canonical links and a differentiable surrogate constraint for acyclicity.
result ZICO achieves superior performance and faster runtimes on simulated data.
A novel method for learning DAGs from positive-valued data.
problem Causal discovery from observational data of positive-valued variables.
method Hybrid Moment-Ratio Scoring (H-MRS) algorithm combining moment-based scoring and log-scale regression.
result H-MRS integrates log-scale Ridge regression for moment-ratio estimation with a greedy ordering procedure based on raw-scale moment ratios, followed by Elastic Net-based parent selection.
New method discovers causal relationships in large-scale data.
problem Discovering causal relationships in large datasets with thousands of variables.
method Factor Directed Acyclic Graphs (f-DAGs) combined with continuous optimization.
result Achieved causal discovery on thousands of variables.
Paper proposes a fast algorithm to recover causal DAGs with latent variables.
problem Discovering causal relationships in the presence of latent variables.
method Cholesky factorization of covariance matrix with optimization for latent variables.
result The algorithm significantly outperforms previous methods in synthetic and real-world datasets.
New insights into convergence of optimization methods for DAG structure learning.
problem Unclear convergence properties of optimization methods for structure learning.
method Examined the convergence of augmented Lagrangian method (ALM) and quadratic penalty method (QPM) for structure learning.
result Standard convergence result of ALM does not hold in various cases, and QPM is prone to ill-conditioning.
Neural Spacetimes learn DAGs by embedding nodes in a spacetime manifold.
problem Learning representations of weighted directed acyclic graphs (DAGs).
method Trainable deep learning-based geometries (Neural Spacetimes) that encode both edge weights and causality.
result Universal embedding theorem for DAGs with sub-cubic parameters and low distortion.
Paper introduces VBG for Bayesian causal structure and mechanism learning.
problem Bayesian causal structure learning with uncertainty over models.
method Variational Bayes-DAG-GFlowNet (VBG) method.
result VBG outperforms existing methods in modeling posterior over DAGs and mechanisms.
New method improves DAG learning by using large coefficients for higher-order terms.
problem Recovering DAG structures from observational data is challenging due to combinatorial optimization.
method Proposes truncated matrix power iteration to approximate DAG constraints efficiently.
result Empirically outperforms previous methods by a factor of 3 or more in structural Hamming distance.
Estimates multiple related causal graphs with shared causal order.
problem Discovering multiple related Gaussian DAGs with shared causal order.
method Proposes a l1/l2-regularized MLE for joint estimation of K linear structural equation models. result Joint estimator achieves better sample complexity and consistency in causal order recovery.
Several real problems ranging from text classification to computational biology are characterized by hierarchical multi-label classification tasks. Most of the methods presented in literature focused on tree-structured taxonomies, but only few on taxonomies structured according to a Directed Acyclic Graph (DAG). In thi…
A new method infers causal gene regulatory networks from parallel CRISPR interventions and transcriptomic data.
problem Learning causal gene regulatory networks from observational data is complicated by lack of identifiability and a combinatorial solution space.
method A continuous optimization framework that leverages observational and interventional data to infer a single causal structure, assuming a linear Structural Equation Model (SEM).
result A provably consistent estimator of the true DAG under mild assumptions.
New estimators for causal effects in DAGs with hidden variables, addressing computational and statistical challenges.
problem Estimating causal effects in DAGs with hidden variables beyond traditional criteria.
method Introduces novel one-step corrected plug-in and targeted minimum loss-based estimators for causal effects in DAGs with hidden variables.
result Root-n consistent causal effect estimates with desirable statistical properties.
CASPER improves DAG structure learning by integrating graph structure into score function.
problem Discovering suboptimal DAGs and model vulnerabilities in causal discovery.
method CASPER integrates graph structure into the score function as a new measure in the causal space, enhancing DAG structure learning via adaptive attention to DAG-ness.
result CASPER outperforms state-of-the-art methods in terms of accuracy and robustness.
A new method learns DAGs from Gaussian data without verifying acyclicity.
problem Learning DAGs from Gaussian data without verifying acyclicity.
method Relaxation technique for permutation matrix estimation and cyclic coordinatewise descent for sparse Cholesky factor estimation.
result The method recovers DAGs without verifying acyclicity constraints.
Learning DAG or Bayesian network models is an important problem in multi-variate causal inference. However, a number of challenges arises in learning large-scale DAG models including model identifiability and computational complexity since the space of directed graphs is huge. In this paper, we address these issues in …
DrBO uses Bayesian optimization to learn DAGs more efficiently.
problem Inaccurate and inefficient DAG learning from observational data.
method Bayesian optimization to find high-scoring DAGs efficiently.
result DrBO finds higher-scoring DAGs more efficiently than existing methods.
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study dee…
New method aggregates bootstrapped DAGs for causal discovery.
problem Aggregation of bootstrapped DAGs ignores higher-order structures.
method Theoretical framework and new DAG aggregation algorithm.
result Proposed method outperforms state-of-the-art solutions.
Bayesian method recovers causal structure in SEMs with equal error variances.
problem Recovering causal structure in SEMs with equal error variances.
method Bayesian DAG selection method using g-priors and the key property of minimum expected squared errors.
result The method consistently recovers the true graph without additional distributional assumptions.
The search space of Bayesian Network structures is usually defined as Acyclic Directed Graphs (DAGs) and the search is done by local transformations of DAGs. But the space of Bayesian Networks is ordered by DAG Markov model inclusion and it is natural to consider that a good search policy should take this into account.…