Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

336598130 · Jun 202019922001200920182026
48 results for block belief propagation

BBPL uses block updates to learn Markov random fields without full inference.

problem Training Markov random fields requires inference over all variables, scaling with model size.
method Block-coordinate updates of approximate marginals to compute approximate gradients.
result BBPL converges to the same solution as full inference, despite approximations.

This thesis investigates belief propagation's performance in graphical models with loops.

problem Belief propagation's performance and convergence guarantees in models with loops are uncertain.
method Investigates how model parameters affect belief propagation's performance, convergence, and approximation quality.
result Model parameters influence the number of fixed points, convergence properties, and approximation quality of belief propagation.

Optimal algorithms identified for semi-supervised classification on graphs.

problem Clustering and classification on graphs with relational and feature information.
method Bayesian inference and belief propagation, extended to graph convolution neural networks.
result Identification of a phase transition and asymptotically optimal algorithms.

There is a recent surge of interest in identifying the sharp recovery thresholds for cluster recovery under the stochastic block model. In this paper, we address the more refined question of how many vertices that will be misclassified on average. We consider the binary form of the stochastic block model, where nn ver…

2015-09-10abs ↗pdf ↗

Belief Propagation outperforms other algorithms in reconstructing binary symmetric channel trees.

problem Reconstructing binary symmetric channel trees with bounded memory.
method Combining recursive reconstruction, information theory, and optimal transport.
result Any recursive algorithm with bounded memory for the reconstruction problem on binary symmetric channel trees has a phase transition strictly below the Belief Propagation threshold.

SOLBP extends efficient inference to uncertain Bayesian networks.

problem Inference in uncertain Bayesian networks with second-order probabilities.
method Extends Loopy Belief Propagation to second-order Bayesian networks.
result Generates inferences consistent with sum-product networks, more efficient and scalable.

Enhances belief propagation to find global optima without increasing computational burden.

problem Improving probabilistic inference accuracy on graphical models.
method Homotopy continuation method that gradually incorporates pairwise potentials.
result SBP finds the global optimum of the Bethe approximation for attractive models.

GEnBP combines EnKF and GaBP for efficient high-dimensional inference.

problem Efficient inference in high-dimensional models.
method Gaussian Ensemble Belief Propagation algorithm combining EnKF and GaBP.
result GEnBP outperforms existing methods in accuracy and efficiency.

Belief propagation quickly converges to global optima for ferromagnetic Ising models.

problem Understanding convergence of belief propagation on graphs with cycles.
method Natural initialization and analysis of Ising models on arbitrary graphs.
result Belief propagation converges quickly to the global optimum of the Bethe free energy for ferromagnetic Ising models.

The assumption that the values of model parameters are known or correctly learned, i.e., the Nishimori condition, is one of the requirements for the detectability analysis of the stochastic block model in statistical inference. In practice, however, there is no example demonstrating that we can know the model parameter…

2017-10-24abs ↗pdf ↗

Improved text summarization using belief propagation on weighted bipartite graphs.

problem Text summarization from a graph theory perspective.
method Generalized belief propagation algorithm for weighted bipartite graphs.
result Our algorithm outperforms greedy methods in text summarization tasks.

Efficiently learns deep factor graphs using Gaussian belief propagation.

problem Learning in deep factor graphs with efficient inference.
method Treats all relevant quantities as random variables, uses belief propagation for inference.
result Efficiently solves training and prediction problems in deep factor graphs with belief propagation.

We propose an original particle-based implementation of the Loopy Belief Propagation (LPB) algorithm for pairwise Markov Random Fields (MRF) on a continuous state space. The algorithm constructs adaptively efficient proposal distributions approximating the local beliefs at each note of the MRF. This is achieved by cons…

2015-06-19abs ↗pdf ↗

BPNNs learn to solve combinatorial problems faster and more accurately.

problem Generalizing belief propagation for efficient problem solving.
method BPNNs are parameterized operators that operate on factor graphs, generalizing BP. BPNN-D is a learned iterative operator that provably maintains BP's properties.
result BPNN-D converges 1.7x faster on Ising models and provides tighter bounds.

Neural node embeddings have recently emerged as a powerful representation for supervised learning tasks involving graph-structured data. We leverage this recent advance to develop a novel algorithm for unsupervised community discovery in graphs. Through extensive experimental studies on simulated and real-world data, w…

2016-11-09abs ↗pdf ↗

We propose a feed-forward inference method applicable to belief and neural networks. In a belief network, the method estimates an approximate factorized posterior of all hidden units given the input. In neural networks the method propagates uncertainty of the input through all the layers. In neural networks with inject…

2018-03-28abs ↗pdf ↗

The stochastic block model (SBM) is a random graph model with different group of vertices connecting differently. It is widely employed as a canonical model to study clustering and community detection, and provides a fertile ground to study the information-theoretic and computational tradeoffs that arise in combinatori…

2017-03-29abs ↗pdf ↗

Gaussian BP algorithm converges exponentially under walk summability for cyclic graphs.

problem Convergence rate of Gaussian BP for cyclic graphs.
method Extending known results on walk summability, proving exponential convergence rate.
result Gaussian BP converges exponentially under walk summability for cyclic graphs.

MAP inference for general energy functions remains a challenging problem. While most efforts are channeled towards improving the linear programming (LP) based relaxation, this work is motivated by the quadratic programming (QP) relaxation. We propose a novel MAP relaxation that penalizes the Kullback-Leibler divergence…

2012-06-18abs ↗pdf ↗

The typical behavior of optimal solutions to portfolio optimization problems with absolute deviation and expected shortfall models using replica analysis was pioneeringly estimated by S. Ciliberti and M. Mézard [Eur. Phys. B. 57, 175 (2007)]; however, they have not yet developed an approximate derivation method for fin…

2010-08-23abs ↗pdf ↗

A neural network model minimizes region-based free energy for faster inference in MRFs.

problem Efficient inference in complex Markov random fields (MRFs).
method Region-based Energy Neural Network (RENN) that directly minimizes region-based free energy.
result RENN outperforms other methods in marginal distribution estimation, partition function estimation, and MRF learning.

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise naturally when working with factor graphs. Belief propagation is a widely deplo…

2017-08-08abs ↗pdf ↗

Adversarial inference on tree models is possible with limited corruption, improving on Kesten-Stigum threshold.

problem Posterior inference on tree-structured graphical models in the presence of adversarial corruption.
method Dynamic programming via belief propagation, constrained adversarial corruption.
result Belief propagation can perform accurate inference with limited adversarial corruption.

The proliferation of models for networks raises challenging problems of model selection: the data are sparse and globally dependent, and models are typically high-dimensional and have large numbers of latent variables. Together, these issues mean that the usual model-selection criteria do not work properly for networks…

2012-07-17abs ↗pdf ↗

NoProp learns neural networks without full back-propagation or forward-propagation.

problem Learning hierarchical representations in neural networks.
method NoProp independently learns each block to denoise a noisy target using local targets and back-propagation within the block.
result NoProp is a viable learning algorithm that is easy to use and computationally efficient.