Propagation-regularization improves GNN performance by infusing extra graph information.
problem The effectiveness of graph Laplacian regularization in GNNs is questioned and improved upon.
method Introducing Propagation-regularization (P-reg) to enhance GNN performance.
result P-reg boosts GNN performance on various tasks across multiple datasets.
The paper proves Lipschitz regularity of graph Laplacian eigenvectors on random data clouds.
problem Analyzing the regularity of solutions to graph Laplacian equations on random data points.
method Probabilistic coupling of random walks and interpolation method for point clouds to continuum.
result Graph Laplacian eigenvectors are essentially Lipschitz with constants depending on eigenvalues.
Dual regularized graph Laplacian improves spectral clustering for community detection.
problem Detecting clusters in networks with improved spectral clustering methods.
method Proposes dual regularized graph Laplacian for three spectral clustering approaches.
result Theoretical analysis shows DRSC and DRSLIM yield stable consistent community detection.
This paper presents a bias-variance tradeoff of graph Laplacian regularizer, which is widely used in graph signal processing and semi-supervised learning tasks. The scaling law of the optimal regularization parameter is specified in terms of the spectral graph properties and a novel signal-to-noise ratio parameter, whi…
Paper optimizes Laplacian regularization for sparse network clustering.
problem Improving spectral clustering in sparse networks.
method Formally determines optimal Laplacian regularization.
result Proper regularization is closely tied to state-of-the-art techniques.
Developed a framework for designing filters in spectral GCNNs with improved performance.
problem Designing effective filters for spectral GCNNs with regularization properties.
method Exploring regularization properties of graph Laplacian and proposing a generalized framework for filter design.
result New filters derived from the framework outperform state-of-the-art techniques in semi-supervised node classification.
This paper uses the technology of weighted and regular triangulations to study discrete versions of the Laplacian on piecewise Euclidean manifolds. Regular triangulations are studied in some detail, including flip algorithms. The Laplacian is then studied as an operator on functions of the vertices as a generalized wei…
We define the distance between edges of graphs and study the coarse Ricci curvature on edges. We consider the Laplacian on edges based on the Jost-Horak's definition of the Laplacian on simplicial complexes. As one of our main results, we obtain an estimate of the first non-zero eigenvalue of the Laplacian by the Ricci…
Recently, Mahoney and Orecchia demonstrated that popular diffusion-based procedures to compute a quick \emph{approximation} to the first nontrivial eigenvector of a data graph Laplacian \emph{exactly} solve certain regularized Semi-Definite Programs (SDPs). In this paper, we extend that result by providing a statistica…
Paper studies minimax optimal regression using Laplacian smoothing over graphs.
problem Minimax optimal regression over Sobolev spaces.
method Laplacian smoothing on neighborhood graphs.
result Upper bounds match minimax optimal rates for first-order Sobolev class.
Eigen-stratified models reduce model size and improve performance.
problem Large model size in Laplacian-regularized stratified models.
method Formulate eigen-stratified models with linear combinations of bottom eigenvectors of the graph Laplacian.
result Significant reduction in model size with eigen-stratified models.
This article describes an implementation of a nonparametric Bayesian approach to solving binary classification problems on graphs. We consider a hierarchical Bayesian approach with a prior that is constructed by truncating a series expansion of the soft label function using the graph Laplacian eigenfunctions as basis f…
Study on harmonic maps between cones, linking degrees to graph Laplacian eigenvalues.
problem Understanding harmonic maps between singular spaces.
method Analyzing homogeneous harmonic maps between simplicial cones and their degrees.
result Degrees of homogeneous harmonic maps are related to eigenvalues of discrete graph Laplacians.
Universal inequalities for Laplacian eigenvalues on discrete groups.
problem Proving inequalities for Laplacian eigenvalues on discrete groups.
method Analyzing Laplacian eigenvalues with Dirichlet boundary conditions on subsets of discrete groups.
result Yang-type universal inequalities for Cayley graphs of amenable groups and the d-regular tree.
This paper investigates the use of methods from partial differential equations and the Calculus of variations to study learning problems that are regularized using graph Laplacians. Graph Laplacians are a powerful, flexible method for capturing local and global geometry in many classes of learning problems, and the tec…
Proposes a method to learn graph structure and model parameters jointly in LRSM.
problem The sensitivity of graph weights in LRSM can be arbitrarily large under imbalanced scales and sample sizes.
method Jointly learns graph structure and model parameters by solving a single optimization problem, providing convergence guarantees.
result The proposed approach outperforms existing methods in various real-world numerical examples.
Graph poly-Laplacian method improves regression accuracy.
problem Regression with noisy labels on graphs.
method Graph poly-Laplacian regularization for non-parametric regression.
result Rate of convergence matches known results for smoothing splines.
We provide a theoretical analysis of the representation learning problem aimed at learning the latent variables (design matrix) Θ of observations Y with the knowledge of the coefficient matrix X. The design matrix is learned under the assumption that the latent variables Θ are smooth with respect to a (known) t…
The paper develops a method to sparsify magnetic Laplacians using multi-type spanning forests.
problem Sparsifying magnetic Laplacians for large and dense graphs.
method Sampling multi-type spanning forests using a determinantal point process.
result The method provides statistical guarantees for estimating the connection Laplacian.
New p-Laplacian GNN model tackles heterophilic graphs by improving node classification.
problem Heterophilic graphs where node labels differ, leading to poor GNN performance.
method Proposes p-Laplacian GNN model with a new message passing mechanism derived from discrete regularization. result Significantly outperforms state-of-the-art GNNs on heterophilic benchmarks.
The ℓ1-norm fails to produce sparse solutions in Laplacian constrained graphical models, leading to a complete graph.
problem Learning a sparse graph under Laplacian constrained Gaussian graphical models.
method Introduced a nonconvex sparsity penalty and proposed a new estimator using a sequence of weighted ℓ1-norm penalized sub-problems. Developed a projected gradient descent algorithm with linear convergence rate. result The proposed estimator can recover the edges correctly with high probability and is effective on both synthetic and real-world data sets.
BIG Laplacians bridge combinatorial and Hodge Laplacians for discrete data.
problem Comparing combinatorial and Hodge Laplacians for discrete data.
method Introducing Boundary-Induced Graph (BIG) Laplacians using DEC.
result BIG Laplacian eigenvalues converge to Hodge Laplacian for simple shapes.
S2MAM improves semi-supervised learning by selecting relevant variables and updating similarity metrics.
problem Joint learning from labeled and unlabeled data with geometric structure.
method Bilevel optimization scheme for automatic variable selection and similarity matrix update.
result The proposed S2MAM achieves robust and interpretable predictions.
In this paper we improve the spectral convergence rates for graph-based approximations of Laplace-Beltrami operators constructed from random data. We utilize regularity of the continuum eigenfunctions and strong pointwise consistency results to prove that spectral convergence rates are the same as the pointwise consist…
A new method for few-shot learning using Laplacian regularization.
problem Few-shot learning with limited labeled data.
method Transductive Laplacian-regularized inference for feature embeddings.
result Our method outperforms state-of-the-art methods across various benchmarks.
The p-Laplacian Transformer improves transformer models by assigning higher attention weights to tokens in close proximity.
problem The self-attention mechanism in transformers does not effectively distinguish attention weights between tokens in close and non-close proximity.
method Proposes a novel class of transformers, p-Laplacian Transformers, that use p-Laplacian regularization to assign higher attention weights to tokens in close proximity. result Empirically demonstrates that p-Laplacian Transformers outperform baseline transformers on various benchmark datasets.
Study shows consistency of shallow GCNNs on sampled point clouds under manifold assumption.
problem Consistency of shallow GCNNs on sampled point clouds under manifold assumption.
method Functional analysis perspective, weakly compact product of unit balls, Sobolev regularity, frequency cutoff.
result Proves Γ-convergence of regularized empirical risk minimization functionals and convergence of their global minimizers. This paper explores the recently proposed Graph Convolutional Network architecture proposed in (Kipf & Welling, 2016) The key points of their work is summarized and their results are reproduced. Graph regularization and alternative graph convolution approaches are explored. I find that explicit graph regularization was…
Discrete Green's functions are the inverses or pseudo-inverses of combinatorial Laplacians. We present compact formulas for discrete Green's functions, in terms of the eigensystems of corresponding Laplacians, for products of regular graphs with or without boundary. Explicit formulas are derived for the cycle, torus, a…
New regularization techniques improve stability of deep neural networks.
problem Improving stability of deep neural networks in high-dimensional data.
method Apply manifold regularization to develop new regularizers based on graph Laplacian sparsification.
result Empirically, networks achieve high stability in various perturbation models, including adversarial attacks.
The paper finds minimum Steklov eigenvalues on combinatorial graphs.
problem Finding the minimum Steklov eigenvalues on combinatorial graphs.
method Extending Friedman's nodal domain theory for Laplacian eigenfunctions to Steklov eigenfunctions.
result The minimum of the imth Steklov eigenvalue on a connected combinatorial graph is essentially attained by a star or a regular comb with minimal brooms. Semi-supervised learning on graph structured data has received significant attention with the recent introduction of Graph Convolution Networks (GCN). While traditional methods have focused on optimizing a loss augmented with Laplacian regularization framework, GCNs perform an implicit Laplacian type regularization to …
Paper proposes a robust deep graph-based classifier for noisy labels.
problem Difficulty in feature learning with noisy training labels.
method Convolutional neural networks with graph Laplacian regularization (GLR).
result Proposed method outperforms state-of-the-art classifiers on noisy datasets.
A new method improves graph-based learning for high-dimensional data.
problem Inconsistent high-dimensional learning efficiency of semi-supervised graph regularization.
method Introducing a novel regularization approach involving centering operation.
result Empirical results show improved performance over spectral clustering.
A regularized optimization problem over a large unstructured graph is studied, where the regularization term is tied to the graph geometry. Typical regularization examples include the total variation and the Laplacian regularizations over the graph. When applying the proximal gradient algorithm to solve this problem, t…
Proposes a method to infer complex network topologies from multiple graphs.
problem Learning multiple graph Laplacian matrices from heterogeneous graph signals with intricate topological patterns.
method Structured fusion regularization and ADMM algorithm for efficient computation.
result Establishes a non-asymptotic bound of the estimation error and reflects the effect of key factors on convergence rate.
Unified spectral clustering for sparse networks with heterogeneous degrees.
problem Efficiently detecting communities in sparse networks with varying degrees.
method Developed a parametrized regularized Laplacian matrix for spectral clustering.
result Improved parametrization accounts for network heterogeneity and community hardness.
Study shows how Laplacian semi-supervised learning behaves at low labeling rates.
problem Understanding behavior of Laplacian semi-supervised learning at very low label rates.
method Analysis of random geometric graphs and Γ-convergence tools. result For certain conditions, Laplacian learning becomes degenerate and spikes form; for others, it remains well-posed and consistent.
Unified framework for multi-user bandits using Laplacian kernels.
problem Multi-user contextual bandits with graph-related users and non-linear rewards.
method Joint penalty combining graph smoothness and individual roughness in a unified RKHS.
result Unified multi-user RKHS and effective dimension for regret bounds.
Study asymptotic expansion of graph Laplacian on discretized surfaces, relating spanning trees and cycle-rooted forests.
problem Asymptotic expansion of graph Laplacian on discretized surfaces.
method Relate spanning trees and cycle-rooted spanning forests to zeta-regularized determinants.
result Explicit formula for limit of cycle-rooted spanning forest probability and topological observables.
Graph-based semi-supervised learning is one of the most popular methods in machine learning. Some of its theoretical properties such as bounds for the generalization error and the convergence of the graph Laplacian regularizer have been studied in computer science and statistics literatures. However, a fundamental stat…
DeepVir uses deep matrix factorization to predict antivirals for COVID-19.
problem Predicting effective antivirals for COVID-19 using known drug-virus associations.
method Graphical deep matrix factorization with HyPALM optimization.
result DeepVir outperforms state-of-the-art techniques in predicting antivirals for COVID-19.
New graph convolution captures local features on non-Euclidean grids.
problem Capturing local features on irregular, coarse non-Euclidean grids.
method Low-rank learnable local filters in graph convolutions.
result Proves more expressive than previous spectral graph convolution methods.
We propose Gaussian processes for signals over graphs (GPG) using the apriori knowledge that the target vectors lie over a graph. We incorporate this information using a graph- Laplacian based regularization which enforces the target vectors to have a specific profile in terms of graph Fourier transform coeffcients, fo…
New kernel improves graph learning with fewer labeled data.
problem Limited kernels for node-level problems on graphs.
method Derived from a regularization framework, transductive kernel for graphs with node features.
result Improved learning on fewer training points and non-Euclidean data.
Study shows SNN graph Laplacians converge to k-NN graph Laplacians under large scale asymptotics.
problem Understanding the convergence of SNN graph Laplacians to k-NN graph Laplacians.
method Analyzing the asymptotic behavior of SNN and k-NN graph Laplacians.
result The graph Laplacians of SNN and k-NN graphs converge to the same limit under large scale asymptotics.
Root Laplacian Eigenmaps help in spectral embedding of graphs.
problem Efficient spectral embedding of graphs.
method Square root of graph-Laplacian operator.
result Improved spectral embedding techniques.
This paper characterizes and explains the disagreement between two graph embedding methods.
problem Understanding why two popular graph embedding methods produce different results.
method End-to-end analysis of ASE-LSE latent subspaces, proving conditions for agreement and disagreement.
result No maximal-disagreement graph exists; disagreement is strictly below its theoretical ceiling.