Paper generalizes EC inference for loopy models.
problem Probabilistic inference in loopy models.
method Generalized Expectation Consistency (GEC) method.
result GEC can be applied to MAP and MMSE estimation.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,341 papers · 148 categories
Trend · papers per month
48 results for “loopy models”
New deep learning model tackles graph data learning challenges.
problem Handling graph structured data challenges in deep learning models.
method Introduces a deep loopy neural network with extensive connections and a new learning algorithm based on spanning trees.
result Demonstrates effectiveness on real-world graph datasets.
This paper presents a Bayesian image segmentation model based on Potts prior and loopy belief propagation. The proposed Bayesian model involves several terms, including the pairwise interactions of Potts models, and the average vectors and covariant matrices of Gauss distributions in color image modeling. These terms a…
PGMax: Factor Graphs for Discrete Probabilistic Graphical Models and Loopy Belief Propagation in JAXcs.LG
PGMax automates PGM inference on GPUs, improving quality and speed.
problem Efficient inference in complex discrete PGMs.
method Factor graph specification and loopy belief propagation in JAX.
result Higher-quality inference with up to 3x speedups.
A neural network model minimizes region-based free energy for faster inference in MRFs.
problem Efficient inference in complex Markov random fields (MRFs).
method Region-based Energy Neural Network (RENN) that directly minimizes region-based free energy.
result RENN outperforms other methods in marginal distribution estimation, partition function estimation, and MRF learning.
Paper solves inverse problem in continuous Markov fields using Bethe approximation and loopy belief propagation.
problem Solving the inverse problem in Markov random fields with non-parametric pair-wise energy function.
method Loopy belief propagation and orthonormal function expansion to approximate the partition function and solve functional optimization.
result Analytic solution to inverse problem in continuous Markov fields.
SOLBP extends efficient inference to uncertain Bayesian networks.
problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.
Belief Propagation solves a relaxed network flow problem.
problem Generalized Min-Cost Network Flow with relaxed flow conservation constraints.
method Extends Belief Propagation to solve a new class of network flow problems.
result Belief Propagation converges to the exact solution of the relaxed network flow problem.
Generalized belief propagation converges to optimal solutions on graphs with motifs.
problem Understanding belief propagation on loopy graphs.
method Study of generalized belief propagation on graphs with motifs.
result Generalized belief propagation converges to the global optimum of the Bethe free energy.
Improved BP algorithm outperforms loopy BP in MAP inference.
problem Limited understanding and poor performance of belief propagation in graphs with loops.
method Introduced belief propagation, a minimization of localized -divergence.
result Significantly outperforms loopy BP in fully-connected graphs for MAP inference.
While learning the maximum likelihood value of parameters of an undirected graphical model is hard, modelling the posterior distribution over parameters given data is harder. Yet, undirected models are ubiquitous in computer vision and text modelling (e.g. conditional random fields). But where Bayesian approaches for d…
Graph Neural Networks improve probabilistic inference in complex graphs.
problem Performing accurate inference in probabilistic graphical models with loops.
method Using Graph Neural Networks to learn and solve message-passing algorithms.
result GNNs outperform traditional belief propagation on loopy graphs.
Efficiently analyzes network vulnerabilities using approximate inference.
problem Scalability issue in exact Bayesian inference for large attack graphs.
method Loopy Belief Propagation applied to attack graphs for approximate inference.
result Approximate inference scales linearly with network size, making analysis viable for larger networks.
Loopy belief propagation (LBP), which is equivalent to the Bethe approximation in statistical mechanics, is a message-passing-type inference method that is widely used to analyze systems based on Markov random fields (MRFs). In this paper, we propose a message-passing-type method to analytically evaluate the quenched a…
We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions approximating the local beliefs at each note of the MRF. This is achieved by cons…
Parameter estimation in Markov random fields (MRFs) is a difficult task, in which inference over the network is run in the inner loop of a gradient descent procedure. Replacing exact inference with approximate methods such as loopy belief propagation (LBP) can suffer from poor convergence. In this paper, we provide a d…
A new Bayesian image segmentation algorithm is proposed by combining a loopy belief propagation with an inverse real space renormalization group transformation to reduce the computational time. In results of our experiment, we observe that the proposed method can reduce the computational time to less than one-tenth of …
ALBU improves LDA performance on small datasets.
problem Limited data impairs variational Bayes in LDA.
method Approximate Loopy Belief message passing algorithm.
result ALBU learns latent distributions more accurately than VB, especially for smaller data sets.
We propose an original model for inferring team strengths using a Markov Random Field, which can be used to generate historical estimates of the offensive and defensive strengths of a team over time. This model was designed to be applied to sports such as soccer or hockey, in which contest outcomes take value in a limi…
We present a novel approximate graph matching algorithm that incorporates seeded data into the graph matching paradigm. Our Joint Optimization of Fidelity and Commensurability (JOFC) algorithm embeds two graphs into a common Euclidean space where the matching inference task can be performed. Through real and simulated …
Proposes a new method for learning MRFs without sampling.
problem Learning deep undirected graphical models (MRFs) efficiently.
method Optimizes a saddle-point objective derived from the Bethe free energy approximation, using trained inference networks to amortize the optimization.
result The method compares favorably with loopy belief propagation and achieves better held-out log likelihood.
DistGP models multi-robot mapping with distributed Gaussian process learning.
problem Collaborative mapping by multiple robots with limited local data.
method Sparse Gaussian process with factorisation and distributed training via GBP.
result DistGP achieves superior accuracy and robustness compared to DiNNO.
Bayesian learning in undirected graphical models|computing posterior distributions over parameters and predictive quantities is exceptionally difficult. We conjecture that for general undirected models, there are no tractable MCMC (Markov Chain Monte Carlo) schemes giving the correct equilibrium distribution over param…
Belief Propagation (BP) is one of the most popular methods for inference in probabilistic graphical models. BP is guaranteed to return the correct answer for tree structures, but can be incorrect or non-convergent for loopy graphical models. Recently, several new approximate inference algorithms based on cavity distrib…
pRSL combines probabilistic rules to improve multi-label classification.
problem Modeling the structure between multi-label classes for better performance.
method Uses probabilistic propositional logic rules and belief propagation to combine predictions from multiple classifiers.
result pRSL achieves state-of-the-art performance on various benchmark datasets.
Paper combines deterministic and stochastic inference methods for PGMs.
problem Combining biases from deterministic methods and high costs from Monte Carlo.
method Sequential Monte Carlo algorithm that uses output from deterministic approximations.
result Improves upon deterministic methods and Monte Carlo by reducing biases and computational costs.
Loopy and generalized belief propagation are popular algorithms for approximate inference in Markov random fields and Bayesian networks. Fixed points of these algorithms correspond to extrema of the Bethe and Kikuchi free energy. However, belief propagation does not always converge, which explains the need for approach…
We speed up marginal inference by ignoring factors that do not significantly contribute to overall accuracy. In order to pick a suitable subset of factors to ignore, we propose three schemes: minimizing the number of model factors under a bound on the KL divergence between pruned and full models; minimizing the KL dive…
The problem of structure estimation in graphical models with latent variables is considered. We characterize conditions for tractable graph estimation and develop efficient methods with provable guarantees. We consider models where the underlying Markov graph is locally tree-like, and the model is in the regime of corr…
Enhances method of moments for learning latent graphical models.
problem Non-convexity in learning latent graphical models.
method Introduces marginalization and conditioning for sequential learning.
result Enables learning of a broader class of loopy latent graphical models.
New model clusters graphs using Gromov-Wasserstein discrepancy.
problem Graph clustering with topological structures and node attributes.
method Gromov-Wasserstein discrepancy for relational graph comparison; learns atoms and weights via minimization of discrepancy.
result Model achieves flexible factorization of unaligned graphs with different sizes.
A new algorithm improves topic model accuracy in small data sets.
problem Limited data leads to inaccurate topic model identification.
method Developed a novel variational message passing algorithm (ALBU) for LDA.
result ALBU learns latent distributions more accurately than Variational Bayes (VB) in small data sets.
Belief propagation recovers backpropagation results.
problem Connection between backpropagation and belief propagation poorly understood.
method Converted backpropagation input to belief propagation input and showed results.
result Backpropagation is a special case of belief propagation.
Belief propagation quickly converges to global optima for ferromagnetic Ising models.
problem Understanding convergence of belief propagation on graphs with cycles.
method Natural initialization and analysis of Ising models on arbitrary graphs.
result Belief propagation converges quickly to the global optimum of the Bethe free energy for ferromagnetic Ising models.
Optimizes leveraged staking strategies in decentralized finance.
problem Maximizing returns on staked assets in decentralized lending platforms.
method Developed a mathematical framework to optimize leveraged staking strategies, reducing the multi-market problem to convex allocation over market exposures.
result Rebalanced leveraged positions can achieve up to 6.2% APY, significantly higher than unleveraged staking.
We consider the problem of estimating undirected triangle-free graphs of high dimensional distributions. Triangle-free graphs form a rich graph family which allows arbitrary loopy structures but 3-cliques. For inferential tractability, we propose a graphical Fermat's principle to regularize the distribution family. Suc…
The problem of active diagnosis arises in several applications such as disease diagnosis, and fault diagnosis in computer networks, where the goal is to rapidly identify the binary states of a set of objects (e.g., faulty or working) by sequentially selecting, and observing, (noisy) responses to binary valued queries. …
Fitting high-dimensional data involves a delicate tradeoff between faithful representation and the use of sparse models. Too often, sparsity assumptions on the fitted model are too restrictive to provide a faithful representation of the observed data. In this paper, we present a novel framework incorporating sparsity i…
In this paper, we present a novel framework incorporating a combination of sparse models in different domains. We posit the observed data as generated from a linear combination of a sparse Gaussian Markov model (with a sparse precision matrix) and a sparse Gaussian independence model (with a sparse covariance matrix). …
It is known that fixed points of loopy belief propagation (BP) correspond to stationary points of the Bethe variational problem, where we minimize the Bethe free energy subject to normalization and marginalization constraints. Unfortunately, this does not entirely explain BP because BP is a dual rather than primal algo…
LP-SparseMAP relaxes SparseMAP for more complex structures.
problem SparseMAP's tractable MAP inference oracle limits its applicability.
method Local polytope relaxation for factor graphs.
result LP-SparseMAP outperforms SparseMAP and Structured SVM in structured prediction tasks.
Combines neural networks and probabilistic graphical models for efficient higher-order inference.
problem Lack of efficient higher-order relational information in graph neural networks and probabilistic graphical models.
method Derives efficient approximate sum-product loopy belief propagation for higher-order PGMs, embeds into neural network, proposes methods for constructing higher-order factors.
result Substantially outperforms state-of-the-art k-order graph neural networks in molecular datasets.
Dynamic trees are mixtures of tree structured belief networks. They solve some of the problems of fixed tree networks at the cost of making exact inference intractable. For this reason approximate methods such as sampling or mean field approaches have been used. However, mean field approximations assume a factorized di…
We propose a novel receiver for orthogonal frequency division multiplexing (OFDM) transmissions in impulsive noise environments. Impulsive noise arises in many modern wireless and wireline communication systems, such as Wi-Fi and powerline communications, due to uncoordinated interference that is much stronger than the…
The paper develops algorithms to accurately identify power grid topology.
problem Identifying the exact topology of a power grid in real-time.
method Graphical model framework for topology estimation using voltage measurements.
result Exact extraction of operational topology is theoretically guaranteed for grid topologies without three-node cycles.
Probabilistic graphical models offer a powerful framework to account for the dependence structure between variables, which is represented as a graph. However, the dependence between variables may render inference tasks intractable. In this paper we review techniques exploiting the graph structure for exact inference, b…
This work clarifies the role of inference types in planning.
problem Lack of consistency in using inference types for planning.
method Variational framework and loopy belief propagation.
result All inference types correspond to different weights in variational problems.
We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance matrix, which can be computationally intensive in large dimensions. Approximate infer…