arXiv research

Dual PC algorithm improves structure learning of Bayesian networks.

AutoPC optimizes hyperparameters for the PC algorithm to improve its performance.

The PC algorithm allows investigators to estimate a complete partially directed acyclic graph (CPDAG) from a finite dataset, but few groups have investigated strategies for estimating and controlling the false discovery rate (FDR) of the edges in the CPDAG. In this paper, we introduce PC with p-values (PC-p), a fast al…

PCS-UQ framework improves uncertainty quantification for machine learning models.

Quasi-conformal (QC) theory is an important topic in complex analysis, which studies geometric patterns of deformations between shapes. Recently, computational QC geometry has been developed and has made significant contributions to medical imaging, computer graphics and computer vision. Existing computational QC theor…

Building and expanding on principles of statistics, machine learning, and scientific inquiry, we propose the predictability, computability, and stability (PCS) framework for veridical data science. Our framework, comprised of both a workflow and documentation, aims to provide responsible, reliable, reproducible, and tr…

New algorithm learns causal structures by intersecting Markov blankets.

It was shown recently that the $K$ L1-norm principal components (L1-PCs) of a real-valued data matrix $\mathbf X \in \mathbb R^{D \times N}$ ($N$ data samples of $D$ dimensions) can be exactly calculated with cost $\mathcal{O}(2^{NK})$ or, when advantageous, $\mathcal{O}(N^{dK - K + 1})$ where $d=\mathrm{rank}(\mathbf …

The paper improves PCS approximation for ranking and selection under limited simulation budgets.

Predictive coding networks are shown to be stable, robust, and converge faster than backpropagation.

This paper deals with multivariate regression chain graphs (MVR CGs), which were introduced by Cox and Wermuth [3,4] to represent linear causal models with correlated errors. We consider the PC-like algorithm for structure learning of MVR CGs, which is a constraint-based method proposed by Sonntag and Peña in [18]. We …

New PCstar algorithm discovers causal structure of max-linear Bayesian networks.

The study analyzes and mitigates errors in PC-based causal discovery methods.

We address the problem of finding a minimal separator in an Andersson-Madigan-Perlman chain graph (AMP CG), namely, finding a set Z of nodes that separates a given nonadjacent pair of nodes such that no proper subset of Z separates that pair. We analyze several versions of this problem and offer polynomial-time algorit…

We consider constraint-based methods for causal structure learning, such as the PC-, FCI-, RFCI- and CCD- algorithms (Spirtes et al. (2000, 1993), Richardson (1996), Colombo et al. (2012), Claassen et al. (2013)). The first step of all these algorithms consists of the PC-algorithm. This algorithm is known to be order-d…

Bayesian scores improve structure learning in probabilistic circuits.

Paper introduces md-vtrees for efficient probabilistic and causal inference.

Generative Adversarial Networks (GAN) can achieve promising performance on learning complex data distributions on different types of data. In this paper, we first show a straightforward extension of existing GAN algorithm is not applicable to point clouds, because the constraint required for discriminators is undefined…

We consider the task of estimating a high-dimensional directed acyclic graph, given observations from a linear structural equation model with arbitrary noise distribution. By exploiting properties of common random graphs, we develop a new algorithm that requires conditioning only on small sets of variables. The propose…

New theory shows predictive coding makes learning landscape easier to navigate.

EiNets improve PCs for scalable probabilistic modeling.

In the past decade, sparse principal component analysis has emerged as an archetypal problem for illustrating statistical-computational tradeoffs. This trend has largely been driven by a line of research aiming to characterize the average-case complexity of sparse PCA through reductions from the planted clique (PC) con…

Bayesian Predictive Coding improves deep learning uncertainty quantification.

Exact inference in the linear regression model with spike and slab priors is often intractable. Expectation propagation (EP) can be used for approximate inference. However, the regular sequential form of EP (R-EP) may fail to converge in this model when the size of the training set is very small. As an alternative, we …

We take steps towards understanding the "posterior collapse (PC)" difficulty in variational autoencoders (VAEs),~i.e. a degenerate optimum in which the latent codes become independent of their corresponding inputs. We rely on calculus of variations and theoretically explore a few popular VAE models, showing that PC alw…

Bio-inspired neural networks use predictive coding for efficient weight updates.

A new algorithm infers causal networks from data using topological thresholds.

PC-PG balances exploration and exploitation in reinforcement learning.

Recently, the intervention calculus when the DAG is absent (IDA) method was developed to estimate lower bounds of causal effects from observational high-dimensional data. Originally it was introduced to assess the effect of baseline biomarkers which do not vary over time. However, in many clinical settings, measurement…

New method solves sparse PCA for multiple components efficiently.

Enhanced PC$^2$ improves surrogate modeling for high-dimensional problems.

Optimal algorithms learn Gaussian trees and polytrees from data.

We study the dynamic interactions and structural changes in global financial indices in the years 1998-2012. We apply a principal component analysis (PCA) to cross-correlation coefficients of the stock indices. We calculate the correlations between principal components (PCs) and each asset, known as PC coefficients. A …

SymCircuit learns PC structure via entropy-regularized RL, improving inference efficiency and accuracy.

A new measure PC allows fair comparison of AIWP and NWP models.

A new algorithm for robust causal discovery in small sample sizes.

Unified framework for structure learning via conditional independence testing.

Study embeds PC matrices into Grassmannian manifold for geometric interpretation.

Parabolic almost conformally symplectic structures were introduced in the first part of this series of articles as a class of geometric structures which have an underlying almost conformally symplectic structure. If this underlying structure is conformally symplectic, then one obtains a PCS-structure. In the current ar…

Regularized MFPCA smooths multivariate functional data for clearer patterns.

New latent variable model improves inflation forecasting accuracy.

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components (PCs) are usually linear combinations of all the original variables, and it is thus…

PNCs balance tractability and expressiveness in probabilistic modeling.

Cluster-DAGs improve causal discovery with prior knowledge.

Discovering causal relationships from data is the ultimate goal of many research areas. Constraint based causal exploration algorithms, such as PC, FCI, RFCI, PC-simple, IDA and Joint-IDA have achieved significant progress and have many applications. A common problem with these methods is the high computational complex…

We consider the problem of inferring the directed, causal graph from observational data, assuming no hidden confounders. We take an information theoretic approach, and make three main contributions. First, we show how through algorithmic information theory we can obtain SCI, a highly robust, effective and computational…

Novel hybrid method for Bayesian network structure learning reduces computational time without sacrificing accuracy.

BinaryConnect is generalized and proven to converge.