PIVID infers DAG structures from data using variational inference and permutations.
problem Estimating the structure of Bayesian networks from observational data.
method PIVID uses variational inference and continuous relaxations of discrete distributions to infer a distribution over permutations and DAGs.
result PIVID outperforms deterministic and Bayesian approaches in estimating DAG structures from data.
AutoBayes automates Bayesian graph exploration for robust machine learning.
problem Learning representations invariant to nuisance variations in machine learning.
method Automated Bayesian inference framework exploring different graphical models.
result Significant performance improvement with nuisance-invariant machine learning pipelines.
Bayesian method improves online NARMAX model identification.
problem Online identification of nonlinear systems with small sample sizes and low noise.
method Variational Bayesian inference using message passing algorithm for polynomial NARMAX models.
result Variational Bayesian estimator outperforms recursive and offline least-squares methods.
Paper introduces VBG for Bayesian causal structure and mechanism learning.
problem Bayesian causal structure learning with uncertainty over models.
method Variational Bayes-DAG-GFlowNet (VBG) method.
result VBG outperforms existing methods in modeling posterior over DAGs and mechanisms.
ProDAG uses variational inference to learn DAGs with uncertainty quantification.
problem Statistical and computational challenges in learning a single DAG from data.
method Bayesian variational inference framework with novel distributions.
result ProDAG outperforms state-of-the-art alternatives in accuracy and uncertainty quantification.
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study dee…
BCD Nets use variational inference to estimate DAGs with uncertainty.
problem Uncertainty in inferring causal graphs from limited data.
method Variational inference framework for Bayesian DAG estimation.
result BCD Nets outperform maximum-likelihood methods in low data regimes.
Proposes BGCN-NRWS for semi-supervised node classification with reduced overfitting.
problem Uncertainty in graph structure for semi-supervised node classification.
method Bayesian Graph Convolutional Network using Neighborhood Random Walk Sampling (BGCN-NRWS) with MCMC graph sampling and variational inference.
result Consistently competitive classification results compared to state-of-the-art.
We propose a framework that lifts the capabilities of graph convolutional networks (GCNs) to scenarios where no input graph is given and increases their robustness to adversarial attacks. We formulate a joint probabilistic model that considers a prior distribution over graphs along with a GCN-based likelihood and devel…
Bayesian neural networks enhance uncertainty estimation in graph contrastive learning.
problem Uncertainty in graph contrastive learning when labeled data is scarce.
method Variational Bayesian neural networks for uncertainty estimation.
result Improved uncertainty estimation and downstream performance on semi-supervised node-classification tasks.
A scalable deep GMRF model for general graphs improves predictions and uncertainty estimates.
problem Handling generally structured data on graphs efficiently.
method A new multi-layer structure of Deep GMRFs designed for general graphs, enabling efficient training and close-to-exact Bayesian inference.
result Close-to-exact Bayesian inference for latent field predictions with uncertainty estimates.
DiBS learns Bayesian network structure and parameters efficiently.
problem Bayesian structure learning with uncertainty reasoning.
method Differentiable framework for continuous latent graph representation, agnostic to local conditional distributions.
result Significantly outperforms related approaches in posterior inference.
Bayesian structure learning improved using GFlowNets.
problem Inferring Bayesian network structure from data.
method Using Generative Flow Networks (GFlowNets) for approximating posterior DAG distributions.
result DAG-GFlowNet provides an accurate approximation of the posterior over DAGs.
Variational Causal Networks approximate Bayesian inference over causal structures.
problem Quantifying uncertainty in causal structure inference from finite data.
method Parametric variational family over DAGs, using Evidence Lower Bound (ELBO) for tractable learning.
result Approximation of the true posterior over DAGs is demonstrated to be good.
Improved phylogenetic tree reconstruction using flexible branch length distributions.
problem Inefficient Markov chain Monte Carlo methods for large sequence datasets.
method Variational Bayesian phylogenetic inference with semi-implicit branch length distributions.
result Proposed method improves marginal likelihood estimation and branch length posterior approximation.
We consider testing and learning problems on causal Bayesian networks as defined by Pearl (Pearl, 2009). Given a causal Bayesian network M on a graph with n discrete variables and bounded in-degree and bounded `confounded components', we show that O(logn) interventions on an unknown causal Bayesian ne…
Graph Neural Network improves causal inference in dynamic systems.
problem Identifying causal relations among multi-variate time series.
method Graph Neural Network approach with score-based method.
result Graph Neural Network significantly outperformed other methods in dynamic Bayesian network inference.
Unified approach to DP problems using Gumbel distribution and variational Bayesian inference.
problem Solving classical optimal path problems in a probabilistic framework.
method Gumbel distribution and variational Bayesian inference for latent optimal paths.
result Unified approach transforms DP problems into directed acyclic graphs with Gibbs distribution.
We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks on semi-supervised learning benchmark experiments, and outperforms the neural net…
Novel framework predicts cell responses to perturbations using GRNs.
problem Predicting cellular responses to perturbations for drug discovery and personalized therapeutics.
method Graph variational Bayesian causal inference framework with refined GRNs and robust estimator.
result Enhanced model performance and robust estimation of perturbation effects.
New method recovers relative rates in spatial compositional data from IMS.
problem Challenges in analyzing spatial data from IMS due to competitive sampling.
method Hierarchical Variational Graph Fused Lasso using heavy-tailed graphical lasso prior and automatic differentiation variational inference.
result Our method outperforms state-of-the-practice point estimate methodologies in IMS and has superior posterior coverage.
We consider the problem of recovering a function input of a differential equation formulated on an unknown domain M. We assume to have access to a discrete domain Mn={x1,…,xn}⊂M, and to noisy measurements of the output solution at p≤n of those points. We introduce a graph-based Bayesian inve…
NOTMAD estimates context-specific Bayesian networks without breaking datasets.
problem Non-convexity of acyclic graphs limits sharing information between context-specific estimators.
method NOTMAD models context-specific Bayesian networks as mixtures of archetypal DAGs, estimating structures and parameters jointly.
result NOTMAD shares information between context-specific acyclic graphs, enabling single-sample resolution.
A Bayesian factor graph reduced to normal form consists in the interconnection of diverter units (or equal constraint units) and Single-Input/Single-Output (SISO) blocks. In this framework localized adaptation rules are explicitly derived from a constrained maximum likelihood (ML) formulation and from a minimum KL-dive…
Proposes a new model for directed graphs combining deep learning and latent variable models.
problem Graph representation learning for directed graphs.
method Deep Latent Space Model (DLSM) integrating GCN encoder and stochastic decoder with hierarchical variational auto-encoder architecture.
result Achieves state-of-the-art performance on link prediction and community detection tasks.
Model predicts stable molecules with AI and physics constraints.
problem Designing stable molecules with limited data.
method Graph Scattering Variational Autoencoder with physical constraints.
result Model generates stable molecules with desired properties.
The benefits of automating design cycles for Bayesian inference-based algorithms are becoming increasingly recognized by the machine learning community. As a result, interest in probabilistic programming frameworks has much increased over the past few years. This paper explores a specific probabilistic programming para…
Improved phylogenetic inference using VBPI-Mixtures for tree topology and branch length.
problem Multimodality of tree-topology posterior distributions in phylogenetic inference.
method VBPI-Mixtures algorithm that uses mixture learning within the BBVI framework.
result VBPI-Mixtures captures tree-topology distributions better than VBPI.
We present a model for random simple graphs with a degree distribution that obeys a power law (i.e., is heavy-tailed). To attain this behavior, the edge probabilities in the graph are constructed from Bertoin-Fujita-Roynette-Yor (BFRY) random variables, which have been recently utilized in Bayesian statistics for the c…
Stable topological summary captures evolving dependency structure in dynamic Bayesian networks.
problem Missing larger-scale patterns in evolving dependency structures in dynamic Bayesian networks.
method Topological approach using Dynamic Bayesian Graphs and persistent homology.
result Stable topological summary (barcodes) captures evolving dependency structure in DBNs.
New principle controls graph-informed adversarial discrepancies.
problem Graph-informed adversarial learning for interpolative divergences.
method Proves infimal subadditivity for interpolative divergences.
result Graph-informed adversarial learning is justified for interpolative divergences.
TyXe enables flexible Bayesian neural networks in Pytorch.
problem Uncertainty estimation in neural networks.
method Separates architecture, prior, inference, and likelihood specification; modular choices for priors, guides, and inference techniques.
result Minimal modifications to existing code for Bayesian neural networks.
Smooth embedding space improves NAS performance.
problem Efficiently predicting good neural architectures.
method Two-sided variational graph autoencoder.
result Smooth embedding space facilitates extrapolation to unseen architectures.
Improved neural network convergence with causal Bayesian modeling in retail performance.
problem Improving neural network convergence in retail performance models.
method Causal Bayesian neural network implementation, removal of weakest SEM path, Flipout layers, Vadam optimizer.
result Neural network convergence improved with removal of the weakest SEM path.
Develops scalable autoencoder for document networks.
problem Sparse and skewed latent node representations in document relational networks.
method Combines graph Poisson factor analysis with Weibull-based graph inference networks.
result Extracts high-quality hierarchical latent document representations.
A new method improves inference for complex Bayesian models.
problem Bayesian inference for doubly intractable distributions is computationally challenging.
method Monte Carlo Stein variational gradient descent (MC-SVGD) approach.
result The method achieves substantial computational gains over existing algorithms.
Improved uncertainty estimation in neural networks with VBLL.
problem Improving uncertainty estimation in neural networks.
method Deterministic variational formulation for training Bayesian last layer neural networks.
result Improves predictive accuracy, calibration, and out-of-distribution detection.
The stochastic block model (SBM) is a generative model revealing macroscopic structures in graphs. Bayesian methods are used for (i) cluster assignment inference and (ii) model selection for the number of clusters. In this paper, we study the behavior of Bayesian inference in the SBM in the large sample limit. Combinin…
New method scales Gaussian processes with derivatives using variational inference.
problem Scaling Gaussian processes with derivative information for high-dimensional problems.
method Introducing inducing directional derivatives to sparsify derivative information using variational inference.
result Achieves fully scalable Gaussian process regression with derivatives.
A new variational method speeds up Bayesian phylogenetic inference.
problem Slow and inefficient MCMC methods in Bayesian phylogenetic inference.
method Combining subsplit Bayesian networks with variational inference for efficient tree topology and branch length estimation.
result Variational approach provides competitive performance with significantly fewer iterations.
Variational Inference shows promise for Bayesian GARCH model estimation.
problem Bayesian estimation of GARCH-family models using Monte Carlo sampling.
method Variational Inference as an alternative to Monte Carlo sampling.
result Variational Inference is a reliable and competitive method for Bayesian learning in GARCH-like models.
New method discovers mean and variance causal graphs from heteroscedastic data.
problem Understanding causal relationships in data with varying variance.
method Bayesian, moment-driven approach inferring separate mean and variance causal graphs.
result Accurately recovers mean and variance structures from heteroscedastic data.
BayesPy is an open-source Python software package for performing variational Bayesian inference. It is based on the variational message passing framework and supports conjugate exponential family models. By removing the tedious task of implementing the variational Bayesian update equations, the user can construct model…
Improved Bayesian inference via variational approximations of generalized rho-posteriors.
problem Robust Bayesian inference under model misspecification and data contamination.
method Introducing a modified ρ-posterior and using PAC-Bayesian analysis with variational approximations. result Theoretical guarantees for tractable inference with competitive robustness and computational efficiency.
Bayesian supertrees method uses variational Bayes for overlapping taxon subsets.
problem Inference of phylogenetic tree topologies for overlapping taxon sets.
method Variational Bayesian approach.
result Demonstrates effectiveness of variational Bayes for Bayesian supertrees.
Variational Prediction simplifies Bayesian inference without test time costs.
problem Bayesian inference's computational costs and posterior predictive distribution marginalization.
method Variational Prediction learns a variational approximation to the posterior predictive distribution using a variational bound.
result Directly learns a variational approximation to the posterior predictive distribution without test time marginalization costs.
BASS efficiently learns time-varying graphs with low complexity and automatic tuning.
problem Estimating time-varying graphical models with efficient and automatic parameter tuning.
method BASS uses temporally-dependent spike-and-slab priors and variational inference to learn graph structures efficiently.
result BASS outperforms existing methods in recovering true graphs, especially for high-dimensional cases.
We review three algorithms for Latent Dirichlet Allocation (LDA). Two of them are variational inference algorithms: Variational Bayesian inference and Online Variational Bayesian inference and one is Markov Chain Monte Carlo (MCMC) algorithm -- Collapsed Gibbs sampling. We compare their time complexity and performance.…