We propose Graphical Generative Adversarial Networks (Graphical-GAN) to model structured data. Graphical-GAN conjoins the power of Bayesian networks on compactly representing the dependency structures among random variables and that of generative adversarial networks on learning expressive dependency functions. We intr…
AGM uses adversarial approach for robust prediction in structured prediction problems.
problem Structured prediction problems with complex relationships between variables.
method Adversarial Graphical Models (AGM) for distributionally robust prediction.
result AGM achieves Fisher consistency and flexibility in loss metrics.
AGMs outperform EGMs in generalizing to unseen inference tasks.
problem Training graphical models for inference tasks not seen during training.
method Adversarial training of an ensemble of discrete graphical models.
result AGMs significantly outperform EGMs in generalization to unseen tasks.
Symbolic knowledge in neural models can inadvertently make them more vulnerable to adversarial attacks.
problem Symbolic knowledge in neural models can make models more susceptible to adversarial attacks.
method Investigated deep probabilistic graphical models that incorporate symbolic knowledge and neural nets.
result Symbolic knowledge can propagate the negative effects of adversarial examples, making models more vulnerable.
Develops deep probabilistic graphical modeling for better flexibility and interpretability.
problem Lack of flexibility in probabilistic graphical models and interpretability in deep learning.
method Combines deep learning and probabilistic graphical modeling to create flexible models with interpretable latent structures.
result Solves problems in probabilistic topic models and introduces new learning algorithms.
New framework for robustness guarantees in discrete domains.
problem Adversarial robustness in constrained discrete domains.
method Graphical framework for adversarial costs, accommodating complex cost functions.
result Provably minimal adversarial cost and robustness guarantees.
New framework integrates imitation and reinforcement learning for better robot performance.
problem Combining reinforcement and imitation learning for intelligent robotics.
method Extends probabilistic generative model framework for reinforcement learning and develops pMDP-MO for Markov decision processes.
result Significantly better performance than reinforcement or imitation learning alone.
The idea of computer vision as the Bayesian inverse problem to computer graphics has a long history and an appealing elegance, but it has proved difficult to directly implement. Instead, most vision tasks are approached via complex bottom-up processing pipelines. Here we show that it is possible to write short, simple …
AutoBayes automates Bayesian graph exploration for robust machine learning.
problem Learning representations invariant to nuisance variations in machine learning.
method Automated Bayesian inference framework exploring different graphical models.
result Significant performance improvement with nuisance-invariant machine learning pipelines.
Quantum-assisted GAN learns MNIST and LSUN datasets.
problem Learning latent variable generative models with adversarial networks.
method Generative adversarial learning with quantum annealing.
result Quantum-assisted GAN successfully learns MNIST and LSUN datasets.
Advances in deep generative networks have led to impressive results in recent years. Nevertheless, such models can often waste their capacity on the minutiae of datasets, presumably due to weak inductive biases in their decoders. This is where graphics engines may come in handy since they abstract away low-level detail…
Adversarial inference on tree models is possible with limited corruption, improving on Kesten-Stigum threshold.
problem Posterior inference on tree-structured graphical models in the presence of adversarial corruption.
method Dynamic programming via belief propagation, constrained adversarial corruption.
result Belief propagation can perform accurate inference with limited adversarial corruption.
Paper tackles unsupervised learning of 3D shapes from single images.
problem Learning 3D shapes from single images without supervision.
method Generative models, variational auto-encoders, adversarial methods.
result Model learns 3D shapes and poses from single images, showing potential for various datasets.
3D adversarial logos can fool object detectors in real-world settings.
problem Creating robust adversarial attacks in 3D rendering views.
method Constructing 3D adversarial logos via texture mapping and differentiable rendering.
result 3D adversarial logos are more versatile and robust than traditional adversarial patches.
Framework explains deep learning candlestick recognition.
problem Deep learning models explain candlestick patterns in a black box.
method Local search adversarial attacks to explain model reasoning.
result Model perceives candlestick patterns similarly to human traders.
The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for each mode or sub-task can greatly improve the performance of imitation learning. …
Method analyzes deep neural network activations to explain adversarial examples.
problem Difficulty in interpreting deep neural network representations.
method Persistent homology over graphical activation structure.
result Adversarial examples are not semantic structure additions but dominant activation structure alterations.
Graphical lasso may fail to fit models when data points are insufficient.
problem When does graphical lasso fail to select and fit a graphical model?
method Computational experiments with graphical lasso.
result Graphical lasso may fail when the number of data points is less than the maximum likelihood threshold.
Bayesian inference on structured models typically relies on the ability to infer posterior distributions of underlying hidden variables. However, inference in implicit models or complex posterior distributions is hard. A popular tool for learning implicit models are generative adversarial networks (GANs) which learn pa…
We consider the problem of learning high-dimensional Gaussian graphical models. The graphical lasso is one of the most popular methods for estimating Gaussian graphical models. However, it does not achieve the oracle rate of convergence. In this paper, we propose the graphical nonconvex optimization for optimal estimat…
Undirected graphical models, or Markov networks, are a popular class of statistical models, used in a wide variety of applications. Popular instances of this class include Gaussian graphical models and Ising models. In many settings, however, it might not be clear which subclass of graphical models to use, particularly…
Paper introduces a nonparametric functional graphical model for random functions.
problem Estimating probabilistic conditional independence in functional graphical models.
method Functional sufficient dimension reduction to relax Gaussian or copula Gaussian assumptions.
result Enhances estimation accuracy and retains probabilistic conditional independence.
Neural random fields (NRFs), referring to a class of generative models that use neural networks to implement potential functions in random fields (a.k.a. energy-based models), are not new but receive less attention with slow progress. Different from various directed graphical models such as generative adversarial netwo…
Probabilistic graphical models combine the graph theory and probability theory to give a multivariate statistical modeling. They provide a unified description of uncertainty using probability and complexity using the graphical model. Especially, graphical models provide the following several useful properties: - Graphi…
Graphical models improve portfolio optimization for financial time series.
problem Optimizing portfolios with time-varying covariance patterns.
method Various graphical models (PCA-KMeans, autoencoders, dynamic clustering, structural learning) to capture covariance matrix patterns.
result Graphical models outperform baseline methods in generating steady returns with low risk.
Paper estimates non-causal graphical models using covariance extension and transportation distance.
problem Estimating non-causal graphical models with smoothing relations.
method Proposes a covariance extension problem and uses transportation distance to minimize error with white noise.
result Solution is a double-sided autoregressive non-causal graphical model.
Nonparametric undirected graphical model selection using diffusion models
problem Undirected graphical model selection
method Diffusion models
result Model selection consistency
rags2ridges simplifies graphical modeling of high-dimensional data.
problem Graphical modeling of high-dimensional precision matrices.
method Modular framework for extraction, visualization, and analysis of Gaussian graphical models.
result Provides a one-stop-shop for graphical modeling of high-dimensional precision matrices.
Bayesian method for estimating functional graphical models from neuroimaging data.
problem Estimating dependence structures from functional data in neuroscience.
method Fully Bayesian regularization scheme, including direct Bayesian analog of functional graphical lasso and graphical horseshoe.
result Insight into brain compensation after traumatic brain injury.
Method solves Gaussian graphical models on ladder graphs efficiently.
problem Solving Gaussian graphical models on ladder graphs efficiently.
method Proposes a method that depends on the position of zeros in local covariance matrices.
result Efficiently solves Gaussian graphical models on ladder graphs under certain conditions.
New framework models complex spatial data with basis functions and graphical vectors.
problem Modeling highly-multivariate spatial processes with varying resolutions.
method Extends graphical lasso to multivariate Gaussian processes with independent graphical vectors at different resolutions, using an orthogonal basis and fusion penalty.
result Linear complexity and parsimonious conditional independence structure in multilevel graphical model.
Estimating tree structured Gaussian Graphical Model from noisy data.
problem Recover the original independence structure from noisy observations.
method Address the unidentifiability of tree structured graphical models and provide an algorithm to find the equivalence class of trees.
result An O(n^3) algorithm to find the equivalence class of trees.
A new graphical model for discrete data without parametric restrictions.
problem Discrete data modeling with restrictions.
method Additive conditional independence and penalized estimation of precision operator.
result Consistency of the estimator in ultrahigh-dimensional settings.
Novel model selection method outperforms current state-of-the-art in high-dimensional graphical models.
problem Accurate model selection in high-dimensional graphical models.
method Graphical Neighbour Information (GNI) criterion.
result Demonstrates oracle performance in high-dimensional model selection, outperforming current methods.
This paper addresses the problem of neighborhood selection for Gaussian graphical models. We present two heuristic algorithms: a forward-backward greedy algorithm for general Gaussian graphical models based on mutual information test, and a threshold-based algorithm for walk summable Gaussian graphical models. Both alg…
A graphical model is a statistical model that is associated to a graph whose nodes correspond to variables of interest. The edges of the graph reflect allowed conditional dependencies among the variables. Graphical models admit computationally convenient factorization properties and have long been a valuable tool for t…
We propose a general modeling and inference framework that composes probabilistic graphical models with deep learning methods and combines their respective strengths. Our model family augments graphical structure in latent variables with neural network observation models. For inference, we extend variational autoencode…
New method aggregates nodes in sparse graphical models.
problem Estimating edge-sparse graphical models.
method Tree-aggregated graphical lasso (tag-lasso) method.
result Aggregates nodes in a data-driven fashion using a tree.
New method for estimating functional Gaussian graphical models for multivariate data.
problem Challenges in extending Gaussian graphical models to multivariate functional data due to compact covariance operators.
method Introducing partial separability for multivariate functional data, leading to a novel Karhunen-Loève expansion and efficient estimation through the joint graphical lasso.
result A well-defined functional Gaussian graphical model that can be identified with a sequence of finite-dimensional graphical models, each of identical fixed dimension.
New graphical criteria for efficient covariate adjustment in non-parametric causal models.
problem Estimating population average treatment effects in observational studies using non-parametric causal graphical models.
method Developed new graphical criteria to determine efficient covariate adjustment sets for estimating treatment effects in non-parametric causal graphical models.
result Graphical criteria for efficient covariate adjustment can be applied in both linear and non-parametric causal models.
The paper develops methods to assess and correct model uncertainties in graphical models.
problem Model uncertainty in probabilistic graphical models.
method Information-theoretic and non-parametric stress tests.
result Ranking and correcting impactful sources of uncertainty in graphical models.
We consider the task of estimating a Gaussian graphical model in the high-dimensional setting. The graphical lasso, which involves maximizing the Gaussian log likelihood subject to an l1 penalty, is a well-studied approach for this task. We begin by introducing a surprising connection between the graphical lasso and hi…
Develops a nonparametric graphical model for conditional independence.
problem Evaluation of conditional independence without distributional assumptions.
method Nonlinear sufficient dimension reduction techniques applied to a nonparametric graphical model.
result Method outperforms existing methods in non-Gaussian settings and high-dimensional data.
Pen-and-paper exercises cover various machine learning topics.
problem None explicitly stated, focuses on learning through exercises.
method Pen-and-paper exercises on machine learning topics.
result Comprehensive coverage of machine learning concepts through exercises.
Layered graphical models improve discriminative learning efficiency.
problem Improving discriminative learning efficiency in graphical models.
method Designing layered graphical models (LGMs) in analogy to neural networks, using tensorized truncated variational inference and backpropagation.
result LGMs achieve competitive results in image classification, comparable to neural networks.
In this article we show the duality between tensor networks and undirected graphical models with discrete variables. We study tensor networks on hypergraphs, which we call tensor hypernetworks. We show that the tensor hypernetwork on a hypergraph exactly corresponds to the graphical model given by the dual hypergraph. …
The aim of this chapter is twofold. In the first part we will provide a brief overview of the mathematical and statistical foundations of graphical models, along with their fundamental properties, estimation and basic inference procedures. In particular we will develop Markov networks (also known as Markov random field…
Clusterpath estimator simplifies graphical model interpretation for large datasets.
problem Difficulty in interpreting graphical models with many variables.
method Clusterpath estimator that groups variables for block-structured precision matrix.
result CGGM outperforms other methods in variable clustering and practical applications.