New model captures complex network phenomena like strong local clustering and community structure.
problem Improving community detection in complex networks with higher-order structures.
method Introduces a Superimposed Stochastic Block Model (SupSBM) and analyzes higher-order spectral clustering methods.
result Proves upper bounds on misclustering error for spectral community detection on SupSBM.
New model allows some connections to be zero, improving network analysis.
problem Networks with block structure and sparsity.
method Sparse Popularity Adjusted Stochastic Block Model (PABM).
result Allows some probabilities of connections to be zero.
Paper studies non-tight reconstruction threshold in a 4-state model with different in/out block mutations.
problem Non-tight reconstruction threshold in a 4-state symmetric model with different in-block and out-block mutations.
method Inspired by the q1+q2 stochastic block model, rigorously analyzes conditions for non-tightness of the reconstruction threshold. result Rigorously gives conditions for the non-tightness of the reconstruction threshold in a 4-state symmetric model.
A central problem in analyzing networks is partitioning them into modules or communities. One of the best tools for this is the stochastic block model, which clusters vertices into blocks with statistically homogeneous pattern of links. Despite its flexibility and popularity, there has been a lack of principled statist…
We generalize the stochastic block model to the important case in which edges are annotated with weights drawn from an exponential family distribution. This generalization introduces several technical difficulties for model estimation, which we solve using a Bayesian approach. We introduce a variational algorithm that …
Estimates change point in dynamic stochastic block model.
problem Estimating the location of a single change point in a dynamic stochastic block model.
method Two methods: least squares with clustering and ignoring community structures.
result Established rates of convergence and asymptotic distributions of change point estimators.
Spectral clustering achieves strong consistency in the stochastic block model under certain conditions.
problem Achieving strong consistency in spectral clustering for the stochastic block model.
method Entrywise analysis of the Fielder eigenvector of graph Laplacians.
result Spectral clustering achieves exact recovery of hidden communities under matching information-theoretic limits.
Stochastic block model shows universal applicability to network inference problems.
problem Finding partitions in complex networks that maximize objective functions.
method Showed equivalence of popular algorithms to maximum likelihood formulation of SBM.
result SBM is nearly universal for solving MPE problems.
Gradient descent and its many variants, including mini-batch stochastic gradient descent, form the algorithmic foundation of modern large-scale machine learning. Due to the size and scale of modern data, gradient computations are often distributed across multiple compute nodes. Unfortunately, such distributed implement…
Solves community detection in sparse hypergraphs above a threshold.
problem Community detection in sparse hypergraphs.
method Generalization of Massoulié's method for sparse random graphs to random hypergraphs.
result Above the threshold, a spectral algorithm constructs a partition correlated with the true partition.
Total variation minimization clusters partially labeled data points.
problem Clustering partially labeled data points in stochastic block models.
method Total variation minimization as a clustering method.
result Total variation minimization allows for accurate clustering under certain model parameters.
Paper introduces a new edge exchangeable block model for complex networks.
problem Limitations of the stochastic block model in analyzing complex networks.
method Develops a Bayesian nonparametric edge exchangeable block model.
result The new model outperforms state-of-the-art SBMs for link prediction.
New method clusters signed graphs using matrix power means.
problem Clustering signed graphs with positive and negative relations.
method Signed Power Mean Laplacian, defined as matrix power mean of normalized standard and signless Laplacians.
result Signed power mean Laplacian captures ground truth clusters under reasonable settings.
Tests if vertices in graphs have the same latent positions.
problem Testing equality of latent positions in random graphs.
method Empirical Mahalanobis distances from spectral embeddings.
result Test statistics follow chi-square distributions under null and local alternatives.
Efficient algorithm for robust recovery in stochastic block models.
problem Robust recovery in stochastic block models.
method Convex optimization framework, addressing optimization landscape challenges.
result Achieves robust recovery without a price of robustness.
The proliferation of models for networks raises challenging problems of model selection: the data are sparse and globally dependent, and models are typically high-dimensional and have large numbers of latent variables. Together, these issues mean that the usual model-selection criteria do not work properly for networks…
New method improves community detection for large networks.
problem Inefficient community detection for large sparse networks.
method Decouples row and column labels in likelihood function for fast alternating maximization.
result Strongly consistent estimates of communities with provable convergence guarantee.
We propose a semidefinite programming (SDP) algorithm for community detection in the stochastic block model, a popular model for networks with latent community structure. We prove that our algorithm achieves exact recovery of the latent communities, up to the information-theoretic limits determined by Abbe and Sandon (…
A new model adjusts for covariates in community detection.
problem Community detection in networks with covariate information.
method Pairwise covariates-adjusted stochastic block model (PCABM) with spectral clustering.
result Consistent community detection and coefficient estimates under sparsity conditions.
Novel model detects communities in noisy multilayer networks.
problem Understanding communities in noisy multilayer networks.
method Hierarchical variational inference for joint detection and typologizing.
result Discover communities of subjects with co-occurrent psychopathologies.
Spectral clustering for directed graphs using likelihood estimation.
problem Clustering directed graphs with edge directions.
method Maximum likelihood estimation on stochastic block models.
result Significant performance gains over existing methods.
Proposes a test for stochastic block models with bounded degrees.
problem Testing Erdös-Rényi model versus bisection stochastic block model with bounded degrees.
method Likelihood-ratio (LR) type procedure based on regularization.
result Limit distributions as power Poisson laws under null and alternative hypotheses.
Paper tackles multi-block min-max optimization with applications in deep AUC maximization.
problem Multi-block min-max bilevel optimization with non-convex strongly-concave upper level and strongly convex lower level.
method Single-loop randomized stochastic algorithm for constant number of blocks per iteration.
result Sample complexity of O(1/ε^4) for finding ε-stationary point, matching optimal complexity.
We analyze the performance of spectral clustering for community extraction in stochastic block models. We show that, under mild conditions, spectral clustering applied to the adjacency matrix of the network can consistently recover hidden communities even when the order of the maximum expected degree is as small as $\l…
New algorithm optimally clusters networks with side information.
problem Improving network clustering with side information.
method Iterative clustering algorithm for Contextual Stochastic Block Model.
result Optimal performance under Contextual Symmetric Stochastic Block Model.
To capture the inherent geometric features of many community detection problems, we propose to use a new random graph model of communities that we call a Geometric Block Model. The geometric block model generalizes the random geometric graphs in the same way that the well-studied stochastic block model generalizes the …
The stochastic block model (SBM) is a probabilistic model for community structure in networks. Typically, only the adjacency matrix is used to perform SBM parameter inference. In this paper, we consider circumstances in which nodes have an associated vector of continuous attributes that are also used to learn the node-…
We analyze the information-theoretic limits for the recovery of node labels in several network models. This includes the Stochastic Block Model, the Exponential Random Graph Model, the Latent Space Model, the Directed Preferential Attachment Model, and the Directed Small-world Model. For the Stochastic Block Model, the…
Two spectral algorithms for community detection in graphs with covariates are compared.
problem Detecting community structure in graphs with covariates.
method Two model-based spectral algorithms are presented and compared.
result The second algorithm often better estimates block assignments by accounting for vertex covariates.
Bayesian Neural Networks built block-by-block with uncertainty estimates.
problem Building interpretable and uncertainty-aware neural networks.
method Bayesian Neural Networks (BNNs) constructed using blocks, with doubly stochastic variational inference for posterior approximation.
result Uncertainty estimates provided for Bayesian Neural Networks.
A new Multi-Stream VAE separates multiple sources in images and audio.
problem Learning disentangled representations in multi-stream data.
method Combines discrete and continuous latent spaces for source separation.
result Competitive performance in separating superimposed digits and sound sources.
We consider community detection in Degree-Corrected Stochastic Block Models (DC-SBM). We propose a spectral clustering algorithm based on a suitably normalized adjacency matrix. We show that this algorithm consistently recovers the block-membership of all but a vanishing fraction of nodes, in the regime where the lowes…
Proposes a Nested Block Model to unify various network block models.
problem Lack of nested structure and differing parameter complexity among block models.
method Formulates a hierarchy of block models (NBM) that includes SBM, DCBM, and PABM as special cases.
result Allows clustering and estimation without preliminary testing, simplifying model selection.
Community detection is an important task in network analysis, in which we aim to learn a network partition that groups together vertices with similar community-level connectivity patterns. By finding such groups of vertices with similar structural roles, we extract a compact representation of the network's large-scale …
Network clustering reveals the organization of a network or corresponding complex system with elements represented as vertices and interactions as edges in a (directed, weighted) graph. Although the notion of clustering can be somewhat loose, network clusters or groups are generally considered as nodes with enriched in…
Improved accuracy in community detection with vertex labels.
problem Efficient inference in stochastic block models with vertex labels.
method Linearized belief propagation algorithm with vertex labels.
result Belief propagation achieves highest accuracy when a function of network parameters has a unique fixed point.
Paper uses SSC for identifying layers with identical community structures in DIMPLE networks.
problem Identifying layers with identical community structures in DIMPLE networks.
method Sparse Subspace Clustering (SSC) for identifying groups of layers with identical community structures.
result SSC leads to strongly consistent between-layer clustering under mild conditions.
Resolving a conjecture of Abbe, Bandeira and Hall, the authors have recently shown that the semidefinite programming (SDP) relaxation of the maximum likelihood estimator achieves the sharp threshold for exactly recovering the community structure under the binary stochastic block model of two equal-sized clusters. The s…
Improved spectral clustering guarantees for dynamic stochastic block models.
problem Analyzing Spectral Clustering in dynamic stochastic block models.
method Extending guarantees to sparse and smooth DSBM, linking sparsity and smoothness.
result Improved error bounds for consistent recovery in dynamic DSBM.
We present a method to estimate block membership of nodes in a random graph generated by a stochastic blockmodel. We use an embedding procedure motivated by the random dot product graph model, a particular example of the latent position model. The embedding associates each node with a vector; these vectors are clustere…
A new method speeds up community detection in graphs.
problem Efficiently detecting communities in large graphs.
method Subsampled semidefinite programming for faster clustering.
result Statistical limits of sketching for community detection established.
The stochastic block model accurately describes most empirical networks but struggles with large diameter and slow-mixing networks.
problem Assessing the quality of fit of the stochastic block model for empirical networks.
method Posterior predictive model checking using network descriptors.
result The stochastic block model can accurately describe most empirical networks but struggles with large diameter and slow-mixing networks.
Study information limits for community detection in sub-hypergraphs.
problem Identify limits for exact community detection in sub-hypergraphs.
method Use Fano's inequality to define model parameters and identify success and failure regions.
result Identify regions where algorithms succeed or fail in exact recovery.
A test for comparing networks using stochastic block models.
problem Determining if two network datasets come from the same model.
method Adopting stochastic block models, the study introduces an efficient algorithm to match estimated network parameters and develops a powerful test.
result The test is consistent and asymptotically follows a chi-squared distribution.
New algorithms recover network structure from noisy snapshots of diffusive processes.
problem Recovering network structure from nodal observations of a diffusive process without knowing the edges.
method Spectral algorithms based on latent stochastic block models and random matrix theory.
result Provable high-accuracy recovery of network partition and SBM parameters.
Efficient private algorithms for estimating block models and mixture models.
problem Estimating block models and mixture models in high-dimensional settings.
method General tools for designing efficient private estimation algorithms.
result First efficient private algorithms for weak and exact recovery of stochastic block models.
We present a method based on the orthogonal symmetric non-negative matrix tri-factorization of the normalized Laplacian matrix for community detection in complex networks. While the exact factorization of a given order may not exist and is NP hard to compute, we obtain an approximate factorization by solving an optimiz…
ALMA improves clustering of multilayer networks.
problem Clustering multilayer networks with distinct layers and communities.
method Alternating minimization algorithm (ALMA) for simultaneous layer partition and community estimation.
result ALMA achieves higher accuracy than TWIST in clustering multilayer networks.