Paper analyzes convergence of distributed inference using BP in linear Gaussian models.
problem Distributed inference convergence in linear Gaussian models.
method Factor graphs, Gaussian belief propagation, local computation, message passing.
result Message information matrix converges to a unique positive definite limit matrix at a doubly exponential rate.
Improved community detection in heterogeneous SBM with side information.
problem Misclassification in community detection with noisy labels.
method Optimal weighted message passing and minimum energy flow.
result Optimal weighting improves misclassification rate in heterogeneous SBM.
AMP method reconstructs rank-one matrices from noisy data efficiently.
problem Reconstructing rank-one matrices with prior structural information from noisy observations.
method Approximate Message Passing (AMP) with random initialization.
result AMP from random initialization converges rapidly and globally.
New algorithms improve rank one signal estimation from noisy data.
problem Estimating a rank one signal matrix from corrupted data with rotationally invariant noise.
method Developed approximate message-passing algorithms exploiting eigenvalues and iterates denoisers.
result Achieves optimal asymptotic estimation error among iterative algorithms.
New algorithm improves signal reconstruction from noisy measurements with side information.
problem Reconstructing unknown signals from noisy linear measurements with side information.
method Integrates side information into approximate message passing (AMP) and tracks performance using state evolution.
result AMP-SI performance is accurately predicted by state evolution.
Enhances graph neural networks with structural message-passing for better generalization.
problem Limited representation power and inability to learn basic graph topological properties.
method Proposes a framework that includes a one-hot encoding of nodes and parametrized message and update functions ensuring permutation equivariance.
result Achieves state-of-the-art results on molecular graph regression on the ZINC dataset.
Develops a Gaussian-based message-passing algorithm for noisy matrix completion.
problem Noisy matrix completion problems.
method Gaussian parameterized belief propagation algorithm.
result Advantages over traditional methods in non-Gaussian noise scenarios.
New distribution simplifies covariance matrix inference.
problem Efficient inference for covariance matrices in large models.
method Incorporates Inverse G-Wishart distribution for variational message passing.
result Elegant and succinct expression of variational message passing fragments.
New statistical model improves protein alignment accuracy.
problem Improving accuracy in protein sequence alignment.
method Inferred a time-dependent Markov process from protein sequences.
result Developed a new optimal matrix (MMLSUM) for protein alignment.
Boolean matrix factorization and Boolean matrix completion from noisy observations are desirable unsupervised data-analysis methods due to their interpretability, but hard to perform due to their NP-hardness. We treat these problems as maximum a posteriori inference problems in a graphical model and present a message p…
Analyze message passing algorithms using free probability theory.
problem Dynamics of message passing algorithms for probabilistic models.
method Use freeness assumptions of random matrix theory.
result Recover and analyze properties of message passing algorithms.
The principal submatrix localization problem deals with recovering a K×K principal submatrix of elevated mean μ in a large n×n symmetric matrix subject to additive standard Gaussian noise. This problem serves as a prototypical example for community detection, in which the community corresponds to the …
Unified model combines feature and label propagation for semi-supervised classification.
problem Combining feature and label propagation for effective semi-supervised classification.
method Unified Message Passing Model (UniMP) using Graph Transformer and masked label prediction.
result Obtains new state-of-the-art results in Open Graph Benchmark (OGB).
New algorithm for signal estimation in noisy matrix models.
problem Signal estimation in rectangular spiked matrix models with rotationally invariant noise.
method Orthogonal Approximate Message Passing (OAMP) algorithm for signal estimation.
result Optimal OAMP algorithm minimizes mean-squared error and achieves Bayes-optimal performance.
This work analyzes mini-batch inference limits and introduces Mini-AMP for clustering.
problem Analyzing information-theoretic limits of mini-batch inference in statistical learning.
method Detailed analysis of Mini-AMP for generalized linear models and low-rank matrix factorization.
result Characterization of optimal performance and phase transitions for mini-batch inference.
Study optimal algorithms for recovering signals through inhomogeneous low-rank channels.
problem Recovering signals through an inhomogeneous low-rank matrix channel.
method Derive and analyze an approximate message-passing algorithm (AMP) and a spectral method.
result The AMP iteration matches the conjectured optimal computational phase transition.
Graph auto-encoder predicts user-item interactions from graph data.
problem Matrix completion for recommender systems from graph data.
method Differentiable message passing on bipartite graphs.
result Competitive performance on collaborative filtering benchmarks.
New method tightens spectral bounds for percolation in clustered networks.
problem Tight spectral bounds for percolation in sparse networks with clustering.
method Message passing algorithm on triangle-non-backtracking matrix.
result Method gives tighter lower-bound to percolation transition.
This paper considers probabilistic estimation of a low-rank matrix from non-linear element-wise measurements of its elements. We derive the corresponding approximate message passing (AMP) algorithm and its state evolution. Relying on non-rigorous but standard assumptions motivated by statistical physics, we characteriz…
DimeNet uses directional message passing to improve molecular predictions.
problem Lack of directional information in graph neural networks for molecules.
method Directional message passing, rotationally equivariant embeddings, spherical functions.
result DimeNet outperforms previous GNNs by 76% on MD17 and 31% on QM9.
We solve matrix denoising with both row and column correlations, setting limits and designing optimal methods.
problem Matrix denoising with doubly heteroscedastic noise (both row and column correlations).
method Established information-theoretic and algorithmic limits, designed a novel spectral estimator with optimality guarantees.
result The novel spectral estimator achieves positive correlation with the signal and Bayes-optimal error under one-sided heteroscedasticity.
Hard phase in inference problems is glassy and hard to reconstruct.
problem Hard phase in inference problems that are hard to solve algorithmically.
method Study of metastable states and their entropy in low-rank matrix factorization.
result AMP algorithm performance is not improved by considering glassy states.
WGNN learns graph representations from incomplete attribute data.
problem Missing node attributes in graphs.
method WGNN learns node representations from decomposed attribute matrices and uses Wasserstein space for message passing.
result WGNN outperforms existing methods in node classification tasks with missing attribute data.
Steerable E(3) Graph Neural Networks incorporate geometric and physical covariant information.
problem Incorporating covariant information like position, force, velocity, or spin in graph neural networks.
method Steerable E(3) Equivariant Graph Neural Networks (SEGNNs) that use steerable MLPs to incorporate geometric and physical covariant information.
result SEGNNs improve upon classic linear point convolutions and recent equivariant graph networks that send invariant messages.
This paper analyzes the Dawid-Skene model in the dense limit and identifies regions where message passing algorithms fail.
problem Optimality of message passing algorithms in the Dawid-Skene model.
method Analysis of the dense limit of the Dawid-Skene model and identification of regions of sub-optimality.
result Characterization of regions where message passing algorithms do not match Bayes-optimal performance.
A new debiasing method for high-dimensional regression with applications to PCR.
problem Debiasing in high-dimensional statistics with i.i.d. samples and sub-Gaussian covariates.
method Spectrum-Aware Debiasing using rescaled gradient descent with spectral information.
result Achieves debiasing in broader contexts with structured dependencies, heavy tails, and low-rank structures.
Study on convergence of graph neural networks on random graphs.
problem Convergence of message passing graph neural networks on large random graphs.
method Extended convergence results to a broad class of aggregation functions using McDiarmid inequality.
result Non-asymptotic bounds for convergence quantified with high probability.
Paper establishes limits for accurately estimating low-rank matrices from noisy, non-linear data.
problem Estimating low-rank matrices from noisy, non-linear observations.
method Proves strong universality result with equivalent Gaussian model and effective prior parameters.
result Signal-to-noise ratio requirement grows as $N^{ rac 12 (1-1/k_F)}$ for accurate reconstruction.
Sparse superposition codes were recently introduced by Barron and Joseph for reliable communication over the AWGN channel at rates approaching the channel capacity. The codebook is defined in terms of a Gaussian design matrix, and codewords are sparse linear combinations of columns of the matrix. In this paper, we prop…
Proposes a new method to optimize graph neural network architectures on heterogeneous information networks.
problem Weaknesses in instability and inflexibility of existing graph neural architecture search methods.
method Partial Message Meta Multigraph search (PMMM) using a differentiable framework to search for a meaningful meta multigraph.
result Significantly more stable and effective than state-of-the-art heterogeneous GNNs.
New system preserves message meaning in wireless networks, improving data rate.
problem Efficiently transmitting message meaning in wireless networks.
method Modeling semantics as hidden random variables, using Information Bottleneck for compression.
result 20 dB SNR improvement for semantic communication.
New algorithm improves graph inference tasks.
problem Complex graph reasoning and prediction tasks.
method Policy Message Passing algorithm reformulates graph inference as stochastic sequential processes.
result Consistently outperforms state-of-the-art models.
Simple AMP algorithm robust to adversarial corruption.
problem Robust approximate message passing in spiked matrix models.
method Spectral pre-processing combined with robust spectral initialization.
result AMP output is close to correct for corrupted data.
Decomposes information into copying and transformation modes.
problem Lack of distinction between copying and transformation in information measures.
method Derives a decomposition of mutual information into copying and transformation components.
result Copy information can be interpreted as minimal physical copying work.
The sum-product or belief propagation (BP) algorithm is a widely-used message-passing algorithm for computing marginal distributions in graphical models with discrete variables. At the core of the BP message updates, when applied to a graphical model with pairwise interactions, lies a matrix-vector product with complex…
New method solves group synchronization with cycle-edge message passing.
problem Solving group synchronization with adversarial or uniform corruption and small noise.
method Cycle-edge message passing procedure using cycle consistency information.
result Exact recovery and linear convergence guarantees under adversarial corruption.
AMP algorithm for matrix tensor product model provides recovery conditions.
problem Generalization of standard spiked matrix models with multiple pairwise observations.
method Approximate message passing with optimal weighing and combining of estimates.
result Asymptotically exact performance description and necessary/sufficient recovery conditions.
A fast, approximate method for variable selection in GLMs tackles correlated data.
problem Variable selection in generalized linear models with correlated data.
method Replica method of statistical mechanics and vector approximate message passing.
result The proposed algorithm provides fast convergence and high approximation accuracy.
New AMP algorithm estimates signals and latent variables in mixed regression models.
problem Estimating signals and latent variables in mixed regression models.
method Approximate Message Passing (AMP) algorithm for matrix GLM.
result State evolution recursion and optimal denoising functions for precise error minimization.
We propose a framework for the derivation and evaluation of distributed iterative algorithms for receiver cooperation in interference-limited wireless systems. Our approach views the processing within and collaboration between receivers as the solution to an inference problem in the probabilistic model of the whole sys…
Study explores rumor spread on Twitter using supervised learning.
problem Rumors spread quickly on social networks, affecting decision-making.
method Microscopic-level analysis of user interactions and features.
result Models predict rumor diffusion with 90% accuracy.
A training-free message passing module improves hypergraph neural networks.
problem Computational intensive training process in hypergraph neural networks.
method Decoupling hypergraph structural information from model learning stage.
result TF-HNN achieves superior performance and training efficiency.
Active sampling algorithm improves accuracy of inferred scores from pairwise comparisons.
problem Inference of accurate scores from time-consuming pairwise comparisons.
method Approximate message passing and expected information gain maximization.
result ASAP offers the highest accuracy of inferred scores compared to existing methods.
Introduces Spectral Graph Network combining spatial and spectral message passing.
problem Relational reasoning in graph structured data.
method Applies message passing to both spatial and spectral domains of a graph.
result Promotes efficient training with fewer iterations and robustness to edge dropout.
Unified theory linking atom-centered and message-passing models for molecular properties.
problem Combining atom-centered and message-passing models for accurate molecular property prediction.
method Generalizing ACDC framework to include multi-centered information, providing a complete linear basis for regression.
result Unified understanding of atom-centered and message-passing models, providing a coherent foundation.
Tree-AMP simplifies inference in complex tree-structured models.
problem Inference in high-dimensional tree-structured models.
method Approximate Message Passing algorithms for various machine learning tasks.
result Theoretical performance predictions and automated entropy estimation.
The paper develops a new algorithm for RBMs using dynamical mean-field theory.
problem Learning in Restricted Boltzmann Machines (RBMs) with complex dependencies.
method Dynamical mean-field theory applied to RBMs with rectangular coupling matrices drawn from a bi-rotation invariant ensemble.
result The algorithm converges globally under a stability criterion, with rates matching numerical simulations.
Study of spiked matrix models with generative priors.
problem Performance enhancement in signal processing and statistical inference.
method Analysis of spiked matrix models with generative priors, using Bayes-optimal performance and enhanced spectral algorithms.
result Approximate message passing algorithm reaches optimal performance.