Graph diffusion convolution improves graph learning by leveraging generalized graph diffusion.
problem Noisy and arbitrarily defined edges in real graphs.
method Graph diffusion convolution (GDC) using generalized graph diffusion like heat kernel and personalized PageRank.
result Replacing message passing with graph diffusion convolution leads to significant performance improvements.
Graph diffusion processes approximate manifold heat semigroups using graph transition matrices.
problem Approximating manifold heat semigroups from graph data under low regularity conditions.
method Iterating graph transition matrix P to approximate Qt=etΔ, bounding error in ∞-norm. result Convergence rates O(N−2/(d+6)) for manifold heat semigroup approximation, valid for in-sample and out-of-sample. Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters with linear shift invariant graph filters to generate convolutional features and r…
Proposes an alternative approach to propagate labels in GCNs using network diffusion and clustering.
problem Challenges of training GCNs with limited labeled data and bias in network diffusion methods.
method Clustering nodes into communities, using diffusion to quantify proximity, and comparing topological profiles.
result Identifies nodes most similar to labeled nodes, improving label propagation in GCNs.
Proposes graph neural network layers for manifold-valued graphs.
problem Graphs with features in a Riemannian manifold.
method Diffusion layer and tangent multilayer perceptron.
result Outperforms state-of-the-art networks on Alzheimer's classification.
Improved graph neural network bounds using graph diffusion matrix.
problem Empirical performance of graph neural networks on real-world graphs.
method Unified model of graph neural networks, focusing on feature diffusion matrix stability.
result Generalization bounds scale with largest singular value of feature diffusion matrix, smaller than prior bounds.
Textual network embedding leverages rich text information associated with the network to learn low-dimensional vectorial representations of vertices. Rather than using typical natural language processing (NLP) approaches, recent research exploits the relationship of texts on the same edge to graphically embed text. How…
Spatiotemporal forecasting has various applications in neuroscience, climate and transportation domain. Traffic forecasting is one canonical example of such learning task. The task is challenging due to (1) complex spatial dependency on road networks, (2) non-linear temporal dynamics with changing road conditions and (…
The paper introduces a new loss function to prevent overfitting in semi-supervised graph networks.
problem Overfitting in semi-supervised graph networks trained with cross-entropy loss.
method Proposes an unsupervised manifold smoothness loss to regularize the graph convolutional networks.
result Adding the proposed loss consistently improves performance of graph networks.
We propose the Lanczos network (LanczosNet), which uses the Lanczos algorithm to construct low rank approximations of the graph Laplacian for graph convolution. Relying on the tridiagonal decomposition of the Lanczos algorithm, we not only efficiently exploit multi-scale information via fast approximated computation of…
This work generalizes graph neural networks (GNNs) beyond those based on the Weisfeiler-Lehman (WL) algorithm, graph Laplacians, and diffusions. Our approach, denoted Relational Pooling (RP), draws from the theory of finite partial exchangeability to provide a framework with maximal representation power for graphs. RP …
Transfer learning improves highway traffic forecasting using graph neural networks.
problem Lack of historical data for traffic forecasting on large highway networks.
method Developed a transfer learning approach for DCRNN, a graph neural network for highway forecasting.
result TL-DCRNN can forecast traffic on unseen regions of the highway network with high accuracy.
Proposes using dimensionality reduction with personalized page rank to improve GCNs' performance in node classification.
problem GCNs' limitation in considering only a few propagation steps away nodes, leading to hub node bias.
method Utilizes dimensionality reduction techniques conjugate with personalized page rank to fully account for graph topology.
result Significantly outperforms existing methods in node classification tasks on real-world networks.
Dual-attention GCN improves text classification by adapting to textual complexity.
problem Challenges in learning discriminative features from texts due to graph variants.
method Proposes a dual-attention GCN with connection-attention and hop-attention mechanisms.
result Achieves state-of-the-art performance on text classification tasks.
Stability is a key aspect of data analysis. In many applications, the natural notion of stability is geometric, as illustrated for example in computer vision. Scattering transforms construct deep convolutional representations which are certified stable to input deformations. This stability to deformations can be interp…
Identifies directed graphs from node measurements using polynomial filters.
problem Inferring directed network topology from nodal measurements.
method System identification of graph convolutional filter followed by topology inference.
result Effective recovery of directed graphs from measurements.
Traffic forecasting approaches are critical to developing adaptive strategies for mobility. Traffic patterns have complex spatial and temporal dependencies that make accurate forecasting on large highway networks a challenging task. Recently, diffusion convolutional recurrent neural networks (DCRNNs) have achieved stat…
Analyzes how diffusion models learn, revealing a spectral bias in structure mastery.
problem Understanding the learning dynamics and bias in diffusion models.
method Developed an analytical framework using a Gaussian-equivalence principle to solve gradient-flow dynamics and integrate probability-flow ODEs.
result Exposes a universal inverse-variance spectral law: high-variance structure is mastered faster than low-variance detail.
FlowGN tackles graph representation learning by tracing information flow paths.
problem GCNs struggle with over-smoothing and scalability issues.
method FlowGN introduces a 'SourceoSink' mode and 'information flow path' concept. result FlowGN outperforms state-of-the-art GCNs in public datasets.
New method selects diffusion scales for graph wavelets.
problem Choosing optimal diffusion scales for graph wavelets.
method Proposes an unsupervised method using information theory.
result Method selects diffusion scales for graph wavelets.
iGNN tackles inverse graph prediction using invertible neural networks.
problem Inverse graph prediction problem in data analysis and machine learning.
method Developed invertible graph neural network (iGNN) to solve inverse prediction problem on graphs.
result iGNN model allows efficient generation from output labels and forward prediction.
Graph Beta Diffusion (GBD) generates graphs with mixed discrete and continuous components.
problem Generating graphs with mixed discrete and continuous components.
method Introduces Graph Beta Diffusion (GBD) using a beta diffusion process.
result Competes strongly with existing models across graph benchmarks.
New model learns graph spectra accurately, outperforming existing methods.
problem Graph diffusion models struggle to distinguish certain graph families and their spectra.
method Leveraged random matrix theory to analytically extract spectral properties, introducing Dyson Diffusion Model.
result Dyson Diffusion Model learns graph spectra accurately and outperforms existing models.
Classifies solitons for surface diffusion flow of graphs.
problem Classifying solitons for surface diffusion flow of graphs.
method Classifies solitons including equilibria, self-similar solutions, and travelling waves.
result Classified solitons for surface diffusion flow of entire graphs.
Theory explains creativity in diffusion models generating novel images.
problem Diffusion models generate highly original images far from training data.
method Identified locality and equivariance as inductive biases to prevent optimal score-matching.
result Analytic models predict diffusion model outputs with high accuracy.
A new graph generator uses heat diffusion on graph Laplacians to create new graph structures.
problem Creating realistic and diverse graph structures for various applications.
method Adapting the Generator Matching paradigm to graph data, using graph Laplacian and heat kernel for diffusion.
result The method effectively generates graphs with structural properties of real and synthetic graphs.
Matrix completion models are among the most common formulations of recommender systems. Recent works have showed a boost of performance of these techniques when introducing the pairwise relationships between users/items in the form of graphs, and imposing smoothness priors on these graphs. However, such techniques do n…
Spectral graph convolutional neural networks (CNNs) require approximation to the convolution to alleviate the computational complexity, resulting in performance loss. This paper proposes the topology adaptive graph convolutional network (TAGCN), a novel graph convolutional network defined in the vertex domain. We provi…
Recently, many researchers have been focusing on the definition of neural networks for graphs. The basic component for many of these approaches remains the graph convolution idea proposed almost a decade ago. In this paper, we extend this basic component, following an intuition derived from the well-known convolutional…
This research explores how different discrete diffusion kernels affect graph generation quality.
problem The impact of different discrete diffusion kernels on graph generation quality.
method Developed a family of discrete diffusion kernels that converge to different Bernoulli priors.
result The quality of generated graphs is sensitive to the prior used, challenging previous intuitions.
Attributed graph clustering is challenging as it requires joint modelling of graph structures and node attributes. Recent progress on graph convolutional networks has proved that graph convolution is effective in combining structural and content information, and several recent methods based on it have achieved promisin…
Graph convolutional kernel networks generalize CNNs to graph data.
problem Representing graph-structured data for machine learning.
method Convolutional kernel networks applied to graph data.
result Competitive performance on graph classification benchmarks.
Graph convolutional networks adapt the architecture of convolutional neural networks to learn rich representations of data supported on arbitrary graphs by replacing the convolution operations of convolutional neural networks with graph-dependent linear operations. However, these graph-dependent linear operations are d…
SWAG uses graph convolutions to recommend products.
problem Product recommendation using graph-structured data.
method Graph Convolutional Network (GCN) with weighted random walks and aggregations.
result Graph-based approach improves product recommendations.
Recently, graph neural networks have been adopted in a wide variety of applications ranging from relational representations to modeling irregular data domains such as point clouds and social graphs. However, the space of graph neural network architectures remains highly fragmented impeding the development of optimized …
This paper proposes a new Quantum Spatial Graph Convolutional Neural Network (QSGCNN) model that can directly learn a classification function for graphs of arbitrary sizes. Unlike state-of-the-art Graph Convolutional Neural Network (GCNN) models, the proposed QSGCNN model incorporates the process of identifying transit…
DiPhon generates scalable graphs via diffusion on graphons.
problem Scaling diffusion models to large graphs.
method Formulated a continuous diffusion process on graphon space via Jacobi SDE, discretized for finite graphs.
result DiPhon matches the first moment of graphon dynamics and approximates the second moment.
PARD generates graphs efficiently and invariantly to node ordering.
problem Graph generation sensitivity to node ordering.
method Integrates autoregressive and diffusion models with a partial order for nodes and edges.
result PARD achieves state-of-the-art performance on molecular and non-molecular datasets.
Traffic forecasting is a particularly challenging application of spatiotemporal forecasting, due to the time-varying traffic patterns and the complicated spatial dependencies on road networks. To address this challenge, we learn the traffic network as a graph and propose a novel deep learning framework, Traffic Graph C…
Automates graph convolutional network design for semi-supervised node classification.
problem Designing optimal graph convolutional network architectures for semi-supervised node classification.
method An automatic process to define a problem-specific architecture based on graph structure.
result The proposed method outperforms existing methods in classification performance and network compactness.
A new method for fast graph embedding using diffusion graphs.
problem Efficiently generating graph embeddings for large networks.
method Diffusion graphs for rapid vertex sequence generation.
result Improved accuracy and performance with higher edge density.
GRAND treats GNNs as PDE discretizations, addressing graph learning issues.
problem Graph learning issues like depth, oversmoothing, and bottlenecks.
method Models GNNs as a continuous diffusion process, treating them as PDE discretizations.
result Linear and nonlinear versions of GRAND achieve competitive results on graph benchmarks.
Corrected graph convolutions improve node classification on graphs.
problem Oversmoothing in graph convolutions degrades performance.
method Theoretical analysis based on CSBM, spectral analysis for k rounds of corrected graph convolutions.
result Corrected graph convolutions can improve node classification performance exponentially.
The paper compares PINN methods for solving drift-diffusion equations on metric graphs.
problem Solving drift-diffusion equations on metric graphs using machine learning.
method Comparison of physics-informed neural networks (PINNs) for solving drift-diffusion equations on metric graphs.
result PINNs offer a flexible and versatile tool for solving parameter identification or optimization problems on metric graphs.
The paper bridges spectral and spatial graph convolutions, improving model capacity and transferability.
problem Improving graph neural networks by bridging spectral and spatial design.
method Theoretical demonstration and general framework for spectral analysis, new spectral convolutions, and depthwise separable convolutions.
result General framework allows spectral analysis of ConvGNNs, showing their performance and limits, and proposing new spectral convolutions.
The paper bounds the complexity of GCNs using Rademacher complexity.
problem Understanding the sample complexity of GCNs.
method Derived tight upper and lower bounds of Rademacher complexity for GCN models.
result The derived bounds depend on the largest eigenvalue of the graph filter and the degree distribution.
AEGCN uses autoencoder constraints to improve graph node classification.
problem Node classification on graph domains with reduced information loss.
method Autoencoder-constrained graph convolutional network (AEGCN).
result Adding autoencoder constraints significantly improves graph convolutional network performance.
GCN improved for large graphs with LCF to reduce complexity and noise.
problem Efficiency and effectiveness of graph convolution in large graphs.
method Proposed Low-pass Collaborative Filter (LCF) to simplify graph convolution.
result Significant improvement in effectiveness and efficiency of GCN.