Improved BP on CRBMs yields better structured prediction results.
problem Structured prediction on CRBMs using current methods is suboptimal.
method Matrix-based belief propagation implementation for CRBMs.
result BP on CRBMs provides significantly better results than CD methods.
Generalized belief propagation converges to optimal solutions on graphs with motifs.
problem Understanding belief propagation on loopy graphs.
method Study of generalized belief propagation on graphs with motifs.
result Generalized belief propagation converges to the global optimum of the Bethe free energy.
Belief propagation recovers backpropagation results.
problem Connection between backpropagation and belief propagation poorly understood.
method Converted backpropagation input to belief propagation input and showed results.
result Backpropagation is a special case of belief propagation.
Belief Propagation solves a relaxed network flow problem.
problem Generalized Min-Cost Network Flow with relaxed flow conservation constraints.
method Extends Belief Propagation to solve a new class of network flow problems.
result Belief Propagation converges to the exact solution of the relaxed network flow problem.
Efficiently learns deep factor graphs using Gaussian belief propagation.
problem Learning in deep factor graphs with efficient inference.
method Treats all relevant quantities as random variables, uses belief propagation for inference.
result Efficiently solves training and prediction problems in deep factor graphs with belief propagation.
Improved error correction using neural networks and belief propagation.
problem Inference in factor graphs with loops or poor approximations.
method Hybrid model combining FG-GNN and belief propagation.
result Hybrid model outperforms belief propagation in error correction tasks.
This thesis investigates belief propagation's performance in graphical models with loops.
problem Belief propagation's performance and convergence guarantees in models with loops are uncertain.
method Investigates how model parameters affect belief propagation's performance, convergence, and approximation quality.
result Model parameters influence the number of fixed points, convergence properties, and approximation quality of belief propagation.
Improved BP algorithm outperforms loopy BP in MAP inference.
problem Limited understanding and poor performance of belief propagation in graphs with loops.
method Introduced α belief propagation, a minimization of localized α-divergence. result Significantly outperforms loopy BP in fully-connected graphs for MAP inference.
New α-BP algorithm improves belief propagation for graphs with loops.
problem Uncertainty in belief propagation for graphs with loops.
method Derive α-BP algorithm motivated by minimizing α-divergence. result Proves convergence conditions for α-BP. New group testing method uses Belief Propagation for accurate screening.
problem Efficiently identifying infected samples in large groups with minimal tests.
method Belief Propagation algorithm for inference in group testing schemes.
result Significantly increased accuracy of infection identification with fewer tests.
Paper uses EXIT analysis for community detection with side information.
problem Community detection in the presence of side information.
method Imported EXIT method from iterative decoding of error control codes.
result Predicts asymptotic phase transition and residual errors for community detection.
GP-SUM filters complex non-Gaussian states using Gaussian Processes.
problem Stochastic dynamic filtering and state propagation with complex beliefs.
method GP-SUM combines sampling and probabilistic Bayes filters, using Gaussian Processes for dynamic and observation models.
result GP-SUM outperforms other filters on benchmarks and predicts non-Gaussian states accurately.
Belief Propagation outperforms other algorithms in reconstructing binary symmetric channel trees.
problem Reconstructing binary symmetric channel trees with bounded memory.
method Combining recursive reconstruction, information theory, and optimal transport.
result Any recursive algorithm with bounded memory for the reconstruction problem on binary symmetric channel trees has a phase transition strictly below the Belief Propagation threshold.
SOLBP extends efficient inference to uncertain Bayesian networks.
problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.
New algorithm improves learning of latent-variable models.
problem Learning general latent-variable graphical models is challenging.
method Predictive Belief Propagation algorithm for general latent-variable graphical models.
result Significantly outperforms EM and spectral algorithms.
Enhances belief propagation to find global optima without increasing computational burden.
problem Improving probabilistic inference accuracy on graphical models.
method Homotopy continuation method that gradually incorporates pairwise potentials.
result SBP finds the global optimum of the Bethe approximation for attractive models.
A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such marginals when the underlying graph is a tree. But it has gained its popularity as …
pRSL combines probabilistic rules to improve multi-label classification.
problem Modeling the structure between multi-label classes for better performance.
method Uses probabilistic propositional logic rules and belief propagation to combine predictions from multiple classifiers.
result pRSL achieves state-of-the-art performance on various benchmark datasets.
GEnBP combines EnKF and GaBP for efficient high-dimensional inference.
problem Efficient inference in high-dimensional models.
method Gaussian Ensemble Belief Propagation algorithm combining EnKF and GaBP.
result GEnBP outperforms existing methods in accuracy and efficiency.
Belief propagation quickly converges to global optima for ferromagnetic Ising models.
problem Understanding convergence of belief propagation on graphs with cycles.
method Natural initialization and analysis of Ising models on arbitrary graphs.
result Belief propagation converges quickly to the global optimum of the Bethe free energy for ferromagnetic Ising models.
This paper improves parallel belief propagation for scalable machine learning.
problem Efficient parallelization of belief propagation for large-scale machine learning tasks.
method Use of scalable relaxed schedulers to parallelize belief propagation.
result Our approach outperforms previous methods in scalability and convergence time.
Improved accuracy in community detection with vertex labels.
problem Efficient inference in stochastic block models with vertex labels.
method Linearized belief propagation algorithm with vertex labels.
result Belief propagation achieves highest accuracy when a function of network parameters has a unique fixed point.
The paper uses belief propagation to analyze rankings and partial orders from partial information.
problem Analyzing rankings and partial orders from incomplete data.
method Continuous spin system and belief propagation algorithm.
result Computes marginal distribution and approximates number of linear extensions.
Proposes a feed-forward method for uncertainty propagation in neural networks.
problem Uncertainty in neural network inputs and activations.
method Feed-forward inference method for belief and neural networks, considering both mean and variance.
result Propagates uncertainty through neural network layers and parameters.
New insights into belief propagation and Bethe approximation for factor graphs.
problem Understanding the correctness and efficiency of belief propagation and its relation to partition functions.
method Viewing factor graphs through the lens of polynomials and reformulating Bethe approximation as a polynomial optimization problem.
result For bipartite normal factor graphs, the Bethe approximation is a lower bound to the partition function under certain analytic conditions.
Improved text summarization using belief propagation on weighted bipartite graphs.
problem Text summarization from a graph theory perspective.
method Generalized belief propagation algorithm for weighted bipartite graphs.
result Our algorithm outperforms greedy methods in text summarization tasks.
Adapts BP-based algorithms for deep learning, improving performance and accuracy.
problem Training deep neural networks with discrete weights and activations.
method Message-passing algorithms based on Belief Propagation, with reinforcement field.
result Comparable performance to SGD-inspired heuristics (BinaryNet) and higher accuracy in predictions.
We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions approximating the local beliefs at each note of the MRF. This is achieved by cons…
BPNNs learn to solve combinatorial problems faster and more accurately.
problem Generalizing belief propagation for efficient problem solving.
method BPNNs are parameterized operators that operate on factor graphs, generalizing BP. BPNN-D is a learned iterative operator that provably maintains BP's properties.
result BPNN-D converges 1.7x faster on Ising models and provides tighter bounds.
Paper solves inverse problem in continuous Markov fields using Bethe approximation and loopy belief propagation.
problem Solving the inverse problem in Markov random fields with non-parametric pair-wise energy function.
method Loopy belief propagation and orthonormal function expansion to approximate the partition function and solve functional optimization.
result Analytic solution to inverse problem in continuous Markov fields.
New algorithm for efficient inference over tree-structured graphs.
problem Inference over probabilistic graphical models with aggregate data.
method Optimal transport theory, Sinkhorn/iterative scaling algorithm, belief propagation.
result Global convergence and polynomial computational complexity.
Approximations of loopy belief propagation, including expectation propagation and approximate message passing, have attracted considerable attention for probabilistic inference problems. This paper proposes and analyzes a generalization of Opper and Winther's expectation consistent (EC) approximate inference method. Th…
Paper proposes a new method for more accurate group testing of infected patients.
problem Identifying infected patients efficiently with reduced tests and corrected errors.
method Adaptive design of pools based on Bayesian posterior prediction using belief propagation algorithm.
result The proposed method results in more accurate identification of infected patients.
Two EP frameworks ensure integrable beliefs in Bayesian estimation problems.
problem Non-integrable beliefs in EP can lead to infeasible solutions.
method Proposes two EP frameworks to keep messages non-integrable.
result Ensures integrable beliefs in EP, even with non-integrable messages.
PGMax automates PGM inference on GPUs, improving quality and speed.
problem Efficient inference in complex discrete PGMs.
method Factor graph specification and loopy belief propagation in JAX.
result Higher-quality inference with up to 3x speedups.
We present a joint message passing approach that combines belief propagation and the mean field approximation. Our analysis is based on the region-based free energy approximation method proposed by Yedidia et al. We show that the message passing fixed-point equations obtained with this combination correspond to station…
This paper presents a Bayesian image segmentation model based on Potts prior and loopy belief propagation. The proposed Bayesian model involves several terms, including the pairwise interactions of Potts models, and the average vectors and covariant matrices of Gauss distributions in color image modeling. These terms a…
Smooth generative model of shapes with uncertainty from silhouette images.
problem Challenges in modeling shapes represented as silhouette images due to intractable posteriors.
method Gaussian Process Deep Belief Networks (GPDBN) that learn from small data and propagate uncertainty.
result Proposed model provides favorable results compared to state-of-the-art models.
A new algorithm estimates aggregate marginals from noisy data in an online manner.
problem Estimating aggregate marginals of a Markov chain from noisy aggregate observations.
method Sliding window Sinkhorn belief propagation (SW-SBP) algorithm.
result Demonstrated improved performance on inferring population flow.
Gaussian BP algorithm converges exponentially under walk summability for cyclic graphs.
problem Convergence rate of Gaussian BP for cyclic graphs.
method Extending known results on walk summability, proving exponential convergence rate.
result Gaussian BP converges exponentially under walk summability for cyclic graphs.
The typical behavior of optimal solutions to portfolio optimization problems with absolute deviation and expected shortfall models using replica analysis was pioneeringly estimated by S. Ciliberti and M. Mézard [Eur. Phys. B. 57, 175 (2007)]; however, they have not yet developed an approximate derivation method for fin…
A neural network model minimizes region-based free energy for faster inference in MRFs.
problem Efficient inference in complex Markov random fields (MRFs).
method Region-based Energy Neural Network (RENN) that directly minimizes region-based free energy.
result RENN outperforms other methods in marginal distribution estimation, partition function estimation, and MRF learning.
BBPL uses block updates to learn Markov random fields without full inference.
problem Training Markov random fields requires inference over all variables, scaling with model size.
method Block-coordinate updates of approximate marginals to compute approximate gradients.
result BBPL converges to the same solution as full inference, despite approximations.
Gaussian BP converges geometrically for pairwise linear Gaussian models.
problem Analyzing convergence of Gaussian belief propagation for pairwise linear Gaussian models.
method Analytical study of updating information matrix and belief mean vector convergence.
result Gaussian BP converges geometrically to a unique positive definite matrix.
Adversarial inference on tree models is possible with limited corruption, improving on Kesten-Stigum threshold.
problem Posterior inference on tree-structured graphical models in the presence of adversarial corruption.
method Dynamic programming via belief propagation, constrained adversarial corruption.
result Belief propagation can perform accurate inference with limited adversarial corruption.
Paper compares hard and soft EM for BN learning from incomplete data.
problem Learning BNs from incomplete data using EM algorithms.
method Investigates the impact of imputation vs. belief propagation in hard and soft EM.
result A decision tree can guide practitioners in choosing the best EM algorithm.
New method for finding function correspondences in binary programs.
problem Finding a correspondence between functions of two binary programs.
method Formulated as a network alignment problem and solved using belief propagation.
result QBinDiff prototype outperforms state-of-the-art diffing tools.
U-Nets use belief propagation for efficient image denoising and classification.
problem Efficiently denoise and classify images using generative hierarchical models.
method Interpreted U-Nets as implementing belief propagation in tree-structured models.
result U-Nets can efficiently approximate denoising functions with sample complexity bounds.