Graphical causal models are an important tool for knowledge discovery because they can represent both the causal relations between variables and the multivariate probability distributions over the data. Once learned, causal graphs can be used for classification, feature selection and hypothesis generation, while reveal…
New method learns graph structure with hidden causes from observational data.
problem Learning the structure of linear non-Gaussian models with hidden causes.
method Augments hidden variable structure by learning multidirected edges and uses higher order cumulants.
result Correct structure recovery for bow-free acyclic mixed graphs with multi-directed edges.
"Mixed Data" comprising a large number of heterogeneous variables (e.g. count, binary, continuous, skewed continuous, among other data types) are prevalent in varied areas such as genomics and proteomics, imaging genetics, national security, social networking, and Internet advertising. There have been limited efforts a…
Directed acyclic graphs (DAGs) are a popular framework to express multivariate probability distributions. Acyclic directed mixed graphs (ADMGs) are generalizations of DAGs that can succinctly capture much richer sets of conditional independencies, and are especially useful in modeling the effects of latent variables im…
In this paper, we unify the Markov theory of a variety of different types of graphs used in graphical Markov models by introducing the class of loopless mixed graphs, and show that all independence models induced by m-separation on such graphs are compositional graphoids. We focus in particular on the subclass of rib…
New method clusters directed graphs using Koopman operators.
problem Challenges in clustering directed graphs, especially complex eigenvalues and lack of cluster definition.
method Relate graph Laplacians to transfer operators and metastable sets in stochastic systems, derive clustering algorithms for directed and time-evolving graphs.
result Clusters can be interpreted as coherent sets, useful for analyzing transport and mixing processes.
In this paper we discuss four problems regarding Markov equivalences for subclasses of loopless mixed graphs. We classify these four problems as finding conditions for internal Markov equivalence, which is Markov equivalence within a subclass, for external Markov equivalence, which is Markov equivalence between subclas…
This paper characterizes a specific type of twisted Artin groups embedded in knot groups.
problem Embedding twisted right-angled Artin groups in knot groups.
method Defined and characterized twisted right-angled Artin groups through mixed graphs and Klein bottle relations.
result Completely determined which twisted right-angled Artin groups can be embedded in knot groups.
We solve structure learning for cyclic linear causal models using observational data.
problem Learning the structure of cyclic linear causal models from observational data.
method Assuming simple graphs, we use a criterion for distributional equivalence and implement a greedy search method.
result We show that simple cyclic models are of expected dimension and justify score-based methods for structure learning.
Probabilistic inference in graphical models is the task of computing marginal and conditional densities of interest from a factorized representation of a joint probability distribution. Inference algorithms such as variable elimination and belief propagation take advantage of constraints embedded in this factorization …
Unified framework for stability and generalization of Push-Sum in decentralized learning over directed graphs.
problem Understanding stability and generalization of Push-Sum in decentralized learning over directed networks.
method Developed a unified uniform-stability framework for SGP algorithm, incorporating imbalance-aware consistency bounds.
result Established finite-iteration stability and optimization guarantees for convex and non-convex objectives.
INDEQS: A Graph-Based Neural Controlled Differential Equation Framework for Forecasting
problem Forecasting time series with neural networks
method Incorporating prior knowledge of a directed graph
result Outer informedness consistently improves forecasting accuracy
The paper shows that relaxing assumptions about causal graphs can lead to exponentially large equivalence classes.
problem The size of Markov equivalence classes under relaxed assumptions.
method Analytical proofs for three settings: sparse random directed acyclic graphs, uniformly random acyclic directed mixed graphs, and uniformly random directed cyclic graphs.
result Exponentially large lower bounds for the expected size of Markov equivalence classes.
New method recovers causal DAGs from general environments without strict assumptions.
problem Recovering causal DAGs from real-world data with varying distributions.
method Formalizes desiderata for causal representation learning in general environments, leveraging sufficient change conditions up to third-order derivatives.
result Fully recovers latent DAG and identifies latent variables up to minor indeterminacies under nonparametric mixing.
This paper extends stable blanket theory to models with hidden variables and causal cycles.
problem Identifying stable predictors in models with hidden variables and causal cycles.
method Use acyclic directed mixed graphs (ADMGs) and directed graphs (DGs) with m-separation and σ-separation to characterize and construct intervention-stable predictor sets. result Graphical characterizations of Markov blankets, stable frontiers, and stable blankets in models with hidden variables and cycles.
This paper examines properties of feedforward graphs to improve neural network performance.
problem The choice of computational graph can significantly impact neural network performance.
method The paper introduces two measures: fidelity and mixing time, and evaluates popular graphs using these measures.
result Popular graphs are evaluated based on fidelity and mixing time, revealing their performance implications.
FDR criterion simplifies complex causal graphs to a standard front-door setting.
problem Complex causal graphs make identification of causal effects difficult and computationally infeasible.
method Front-door reducibility (FDR) criterion and FDR-TID algorithm.
result Many graphs can be simplified to a standard front-door setting, making causal effect identification simpler and more interpretable.
We investigate probabilistic graphical models that allow for both cycles and latent variables. For this we introduce directed graphs with hyperedges (HEDGes), generalizing and combining both marginalized directed acyclic graphs (mDAGs) that can model latent (dependent) variables, and directed mixed graphs (DMGs) that c…
DiMMSB models directed mixed membership networks, identifying distinct community structures.
problem Modeling directed mixed membership networks with distinct community structures.
method Directed Mixed Membership Stochastic Blockmodel (DiMMSB) with DiSP algorithm.
result DiSP algorithm is asymptotically consistent and outperforms competitors.
We introduce a new family of graphical models that consists of graphs with possibly directed, undirected and bidirected edges but without directed cycles. We show that these models are suitable for representing causal models with additive error terms. We provide a set of sufficient graphical criteria for the identifica…
Causal graphs, such as directed acyclic graphs (DAGs) and partial ancestral graphs (PAGs), represent causal relationships among variables in a model. Methods exist for learning DAGs and PAGs from data and for converting DAGs to PAGs. However, these methods are significantly limited in that they only output a single cau…
New examples of mixed-type zero-curvature graphs found.
problem Finding new examples of zero-curvature graphs in Lorentz-Minkowski space.
method Using Konderak's representation formula to construct entire zero-curvature graphs over specific planes.
result Existence of new types of entire zero-curvature graphs in mixed-type in Lorentz-Minkowski space.
DCRL learns causal relationships from mixed-type discrete data.
problem Challenges in learning causal relationships from discrete, mixed-type data.
method Generative framework modeling directed acyclic graph and sparse bipartite graph, flexible measurement models for different types of data.
result Consistent recovery of latent causal structure from observed data distribution.
We extend Andersson-Madigan-Perlman chain graphs by (i) relaxing the semidirected acyclity constraint so that only directed cycles are forbidden, and (ii) allowing up to two edges between any pair of nodes. We introduce global, and ordered local and pairwise Markov properties for the new models. We show the equivalence…
Gaussian graphical models are semi-algebraic subsets of the cone of positive definite covariance matrices. Submatrices with low rank correspond to generalizations of conditional independence constraints on collections of random variables. We give a precise graph-theoretic characterization of when submatrices of the cov…
Develops mixed quantization for graph vector bundles.
problem Solving asymptotic spectral problems on graph vector bundles.
method Mixed quantization technique for graph vector bundles.
result Applications to various spectral problems.
Survey of methods to recover CI graphs from feature relationships.
problem Recovering conditional independence graphs from feature relationships.
method Traditional optimization methods and deep learning architectures are discussed.
result Advances in techniques to recover CI graphs are studied.
New method learns DAG structure in clustered data, accounting for local variations.
problem Learning DAG structure in clustered data with varying effects.
method Extends mixed models to structure learning, using a differentiable graph coupling mechanism.
result Asymptotically recovers true structure, detecting dependencies missed by other methods.
Develops a model for causal discovery in path spaces.
problem Discover causal relationships in path spaces using asymmetric independence.
method Theory linking E-separation in DMGs to conditional independence in SDEs, proving global Markov property, characterizing equivalence classes of graphs.
result Each equivalence class of graphs has a greatest element as a parsimonious representation, which can be identified from data.
It is classically known that the only zero mean curvature entire graphs in the Euclidean 3-space are planes, by Bernstein's theorem. A surface in Lorentz-Minkowski 3-space R13 is called of mixed type if it changes causal type from space-like to time-like. In R13, Osamu Kobayashi found …
In this paper, we study classes of graphs with three types of edges that capture the modified independence structure of a directed acyclic graph (DAG) after marginalisation over unobserved variables and conditioning on selection variables using the m-separation criterion. These include MC, summary, and ancestral grap…
Study designs experiments to identify causal graph structure with cycles and latent confounders.
problem Identify causal graph structure with cycles and latent confounders.
method Established lower bounds, developed CI and do see tests algorithms, and proved tightness.
result Proposed algorithms can recover all causal edges except for double adjacent bidirected edges.
The constraints arising from DAG models with latent variables can be naturally represented by means of acyclic directed mixed graphs (ADMGs). Such graphs contain directed and bidirected arrows, and contain no directed cycles. DAGs with latent variables imply independence constraints in the distribution resulting from a…
A novel graph spectral method for mixed categorical and numerical data.
problem Feature learning for mixed data types (numerical and categorical).
method Graph spectral decomposition of the graph Laplacian to model probabilistic dependence structure.
result Increased separability and clusterability of observations in the transformed feature space.
New framework relaxes independence assumption for graph-mixing dependencies.
problem Tackles limitations of existing generalization results for graph-mixing dependencies.
method Proposes a framework where dependencies decay with graph distance, derives generalization bounds leveraging online-to-PAC framework.
result Derives high-probability generalization guarantees that depend on mixing rate and graph's chromatic number.
Existing popular methods for semi-supervised learning with Graph Neural Networks (such as the Graph Convolutional Network) provably cannot learn a general class of neighborhood mixing relationships. To address this weakness, we propose a new model, MixHop, that can learn these relationships, including difference operat…
Forré introduces a new conditional independence notion for mixed variables.
problem Unified framework for random and non-stochastic variables.
method Unified framework of transitional conditional independence and causal calculus for iDMGs.
result Unified framework connects conditional independencies to graphical separation criteria.
Improves decentralized learning by optimizing graph mixing for data heterogeneity.
problem Data heterogeneity impacts convergence in decentralized learning, but existing methods ignore this.
method Characterized and quantified the relationship between graph mixing and data heterogeneity. Proposed an optimization approach to improve convergence.
result Our approach leads to improved test performance across various tasks.
Maximizes mixing efficiency in surface braids.
problem Finding the maximum mixing efficiency in surface braids.
method Introduced an efficient algorithm to compute topological entropy and TEPO for surface braids.
result Conjectured a novel candidate braid to have maximal mixing efficiency.
New graph types help identify complex relationships.
problem Understanding complex relationships in data.
method Introducing separable and essentially separable graphs to characterize and identify graphical models.
result Developed algorithms to identify equivalence classes of essentially separable graphs.
Identifying causal direction in location-scale noise models with hidden variables
problem Causal discovery in location-scale noise models with hidden variables
method ADMGs satisfying a bow-free condition
result First identifiability result for causally insufficient models beyond noise additivity
Clustering is fundamental for gaining insights from complex networks, and spectral clustering (SC) is a popular approach. Conventional SC focuses on second-order structures (e.g., edges connecting two nodes) without direct consideration of higher-order structures (e.g., triangles and cliques). This has motivated SC ext…
DPERC efficiently estimates covariance matrices for mixed data with missing values.
problem Estimating covariance matrices for datasets with missing values and mixed features.
method Direct Parameter Estimation for Randomly Missing Data with Categorical Features (DPERC).
result DPERC outperforms other methods in estimating covariance matrices for mixed data with missing values.
New method learns DAGs from noisy data without identifiability assumptions.
problem Learning DAGs from non-identifiable Gaussian models with heteroscedastic noise.
method Mixed-integer programming framework for medium-sized problems.
result Asymptotically optimal solution with early stopping criterion.
Graph matching in noisy environments with Markovian errors.
problem Graph matching under time-dependent Markovian noise.
method Introduced edgelighter error model and analyzed graph matching thresholds.
result Graph matching thresholds and mixing times are of order Θ(n2logn) for Erdős-Rényi graphs, and O(nαlogn) for Stochastic Block Model graphs. NOTMAD estimates context-specific Bayesian networks without breaking datasets.
problem Non-convexity of acyclic graphs limits sharing information between context-specific estimators.
method NOTMAD models context-specific Bayesian networks as mixtures of archetypal DAGs, estimating structures and parameters jointly.
result NOTMAD shares information between context-specific acyclic graphs, enabling single-sample resolution.
We introduce a novel multivariate random process producing Bernoulli outputs per dimension, that can possibly formalize binary interactions in various graphical structures and can be used to model opinion dynamics, epidemics, financial and biological time series data, etc. We call this a Bernoulli Autoregressive Proces…
The paper proposes a new model to analyze directed networks and accurately estimate community memberships.
problem Modeling and estimating community memberships in directed networks with heterogeneous degrees.
method Directed Degree Corrected Mixed Membership (DiDCMM) model and DiMSC algorithm.
result The proposed DiMSC algorithm is asymptotically consistent and provides error bounds for community membership vectors.