HighwayGraph models long-distance node relations in GNNs with improved performance.
problem Limited-layer information propagation in GNNs hinders long-distance node relation modeling.
method Proposes two solutions: implicit and explicit modeling of long-distance node relations using shallow GNN architectures and a self-training framework.
result HighwayGraph achieves consistent and significant improvements over four GNNs on three benchmark datasets.
Eigen-GNN enhances GNNs by preserving graph structures.
problem Existing shallow GNNs fail to effectively preserve graph structures.
method Integrates eigenspace of graph structures into GNNs as a dimensionality reduction module.
result Eigen-GNN boosts GNNs' ability to preserve graph structures without increasing depth.
Adaptive GPR-GNN optimizes node feature and topology learning.
problem Optimizing GNNs for both node features and graph topology, regardless of homophily or heterophily.
method Adaptive Universal Generalized PageRank (GPR) Graph Neural Network (GPR-GNN) that learns optimal GPR weights.
result Significant performance improvement on node classification tasks compared to state-of-the-art GNNs.
Enhances graph neural networks with random walks to improve performance.
problem Limited input to graph neural networks, especially for molecular data.
method Random walk data processing to enrich graph neural network input.
result Shallow network outperforms deep GNNs using only node features.
This research uncovers high-performing subnetworks in deep GNNs without training.
problem Challenges in applying SLTH to deeper GNNs with high memory requirements.
method Introduces Multicoated Supermasks (M-Sup) and Multi-Stage Folding for GNNs.
result Uncovered untrained recurrent networks with performance similar to trained models.
Simplified NAS for GNN architectures improves efficiency and expressiveness.
problem Efficient and effective discovery of optimal GNN architectures.
method SNAG framework with a novel search space and reinforcement learning.
result SNAG framework outperforms human-designed and existing NAS methods.
Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture. It is because the performance of a GNN architecture is significantly affected b…
PDNAS optimizes GNN architectures for diverse datasets.
problem Inadequate adaptability and combinatorial search space in GNNs.
method Dual architecture search (micro- and macro-architectures) with gradient-based optimization.
result PDNAS finds deeper GNNs with better performance on diverse datasets.
Simplifies GNN models by selecting important features for node classification.
problem Challenges in analyzing and selecting important features in GNN models.
method Decoupling feature aggregation and depth, using softmax and L2-normalization.
result FSGNN achieves comparable or higher accuracy than state-of-the-art GNN models.
GNNs generalize CNNs for graph data, showing equivariance and stability.
problem Processing signals on graphs.
method Graph convolutional filters, nonlinearities, stacked layers.
result GNNs converge to graphon neural networks under graph convergence.
Wide and Deep GNN learns from distributed graphs and retrain online.
problem Decentralized graph support changes over time, causing mismatch between training and testing graphs.
method Wide and Deep GNN architecture with distributed online learning.
result Convergence guarantees for online retraining of the wide part of the GNN.
Graph Neural Network (GNN) is a popular architecture for the analysis of chemical molecules, and it has numerous applications in material and medicinal science. Current lines of GNNs developed for molecular analysis, however, do not fit well on the training set, and their performance does not scale well with the comple…
Paper compares expressive power of GNNs, proving approximation guarantees for practical architectures.
problem Understanding the expressive power of Graph Neural Networks (GNNs).
method Theoretical framework comparing invariant and equivariant GNNs, proving approximation guarantees for practical architectures.
result Folklore Graph Neural Networks (FGNN) are the most expressive architectures for a given tensor order.
Graph neural networks (GNNs) have emerged recently as a powerful architecture for learning node and graph representations. Standard GNNs have the same expressive power as the Weisfeiler-Leman test of graph isomorphism in terms of distinguishing non-isomorphic graphs. However, it was recently shown that this test cannot…
Improved GNN handles long-range dependencies in multi-relational graphs.
problem Vanishing gradients in GNNs for multi-relational graphs.
method Proposes a Gated Graph Neural Network with improved long-range dependency handling.
result Outperforms popular GNN models in synthetic tasks.
Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters with linear shift invariant graph filters to generate convolutional features and r…
In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. In particular, we train and test both methods on early stage disease patients, to verify their performance in challenging conditions, mo…
Paper provides statistical guarantees for GNNs in link prediction.
problem Link prediction accuracy in graph neural networks.
method Proposes a linear GNN architecture (LG-GNN) and derives statistical guarantees.
result LG-GNN produces consistent estimators for edge probabilities and has better detection of high-probability edges.
Paper explores how GNNs can learn graph biconnectivity, finding ESAN is the only known expressive framework.
problem Understanding the expressive power of GNNs beyond the WL test.
method Introduces a novel class of expressivity metrics via graph biconnectivity and develops the GD-WL approach.
result GD-WL consistently outperforms prior GNN architectures in learning biconnectivity metrics.
Semi-supervised node classification in graphs is a fundamental problem in graph mining, and the recently proposed graph neural networks (GNNs) have achieved unparalleled results on this task. Due to their massive success, GNNs have attracted a lot of attention, and many novel architectures have been put forward. In thi…
The paper analyzes oversmoothing in GNNs and quantifies the effects of mixing and denoising.
problem Oversmoothing in Graph Neural Networks (GNNs).
method Non-asymptotic analysis of graph convolutions and effects of mixing and denoising.
result The number of layers required for oversmoothing to occur is O(logN/log(logN)) for dense graphs. Researchers explore statistical perspectives to understand GNN generalization.
problem Limited mathematical understanding of GNN performance.
method Three broad frameworks: learning theory, asymptotics, and random graph models.
result Various theoretical results and open questions identified.
Improved graph neural networks by separating feature aggregation and depth.
problem Understanding feature importance in graph neural networks without prior information.
method Decoupling feature aggregation and depth, using softmax as a regularizer, and introducing 'Soft-Selector' and 'Hop-Normalization'.
result FSGNN model achieves up to 64% accuracy improvements in node classification tasks.
This study presents a novel, deep, fully convolutional architecture which is optimized for the task of EEG-based neonatal seizure detection. Architectures of different depths were designed and tested; varying network depth impacts convolutional receptive fields and the corresponding learned feature complexity. Two deep…
Deep neural networks are over-parameterized, which implies that the number of parameters are much larger than the number of samples used to train the network. Even in such a regime deep architectures do not overfit. This phenomenon is an active area of research and many theories have been proposed trying to understand …
Proposes a 2-WL-based graph convolution for improved graph classification.
problem Limitations of current GNN architectures in discriminative power.
method Introduces a novel 2-dimensional Weisfeiler-Lehman graph convolution.
result 2-WL-GNN architecture is more discriminative than existing GNN approaches.
Automates GNN design for molecular property prediction.
problem Designing and tuning GNN architectures for molecular property prediction is labor-intensive.
method Developed a NAS approach to automatically discover high-performing GNN architectures for MPNNs.
result Automatically discovered MPNNs outperform manually designed GNNs in molecular property prediction.
MAML adapts faster with deeper architectures, especially in shallow tasks.
problem Understanding and improving MAML's fast adaptation.
method Empirical and theoretical studies on MAML's properties and optimization.
result MAML adapts better with deep architectures even for shallow tasks.
New hybrid model reduces MILP solver time by up to 26%.
problem Improving CPU-based MILP solver efficiency.
method Combines GNN and MLP for efficient CPU-based branching.
result Up to 26% reduction in solver running time compared to state-of-the-art methods.
Graph Neural Networks struggle on random graphs without node identifiers.
problem Graph Neural Networks' limitations on random graphs without node identifiers.
method Study of Graph Neural Networks and Structural Graph Neural Networks convergence on large random graphs.
result Structural Graph Neural Networks are more powerful and universal than Graph Neural Networks on random graphs.
TuneUp improves GNN training by focusing on hard-to-learn nodes.
problem Sub-optimal training of GNNs on all nodes equally.
method Two-stage training: base GNN + tail node improvement.
result Significant improvement in tail node prediction performance.
A hierarchy of GNNs based on learnable local features is proposed.
problem Limited understanding of GNN architectures and their systematic construction.
method A hierarchy of GNNs based on aggregation regions is derived, and theoretical results are provided.
result Simple GNN architecture exceeds Weisfeiler-Lehman graph isomorphism test.
This paper classifies G-invariant shallow neural networks.
problem Designing optimal G-invariant neural architectures for G-invariant target functions. method Proving theorems about the classification and morphisms of G-invariant single-hidden-layer neural networks. result Classification of G-invariant shallow neural networks and characterization of morphisms. Improves performance of deep GCNs by controlling node feature variance.
problem Performance degradation in deep Graph Convolutional Networks (GCNs).
method Experimentally examined the role of TRANs and PROPs in GCNs, introduced Node Normalization (NodeNorm).
result Node Normalization effectively controls node feature variance, improving GCN performance in deep models.
Graph neural networks (GNNs), consisting of a cascade of layers applying a graph convolution followed by a pointwise nonlinearity, have become a powerful architecture to process signals supported on graphs. Graph convolutions (and thus, GNNs), rely heavily on knowledge of the graph for operation. However, in many pract…
Efficient deep GNNs achieve state-of-the-art performance without training.
problem Efficiency issue in deep graph neural networks.
method Representing graphs as fixed points of dynamical systems and using small, sparse, untrained recurrent networks.
result Small deep GNNs without training can achieve or improve state-of-the-art performance.
MV-GNN improves molecular property prediction by integrating atom and bond information.
problem Accurately predicting molecular properties using graph neural networks.
method Multi-View Graph Neural Network (MV-GNN) architecture with shared self-attentive readout and cross-dependent message passing.
result MV-GNN achieves superior performance on molecular property prediction benchmarks.
GNNs improve brain activity forecasting in fMRI studies.
problem Understanding neural dynamics in the brain.
method Comparison of GNN architectures for modeling fMRI data.
result GNNs outperform VAR models in robustly scaling to large network studies.
A new aggregation strategy improves GNN performance and learning dynamics.
problem Improving expressivity and learning dynamics of GNNs.
method Proposes a variance-preserving aggregation function (VPA) for GNNs.
result VPA leads to increased predictive performance and improved learning dynamics.
TOGL adds topological info to GNNs, improving graph and node classification.
problem Graph neural networks lack substructure awareness, especially cycles.
method Integrates global topological information using persistent homology.
result Improves predictive performance for graph and node classification.
A theoretical performance analysis of the graph neural network (GNN) is presented. For classification tasks, the neural network approach has the advantage in terms of flexibility that it can be employed in a data-driven manner, whereas Bayesian inference requires the assumption of a specific model. A fundamental questi…
Enhances GNN robustness during inference using Conditional Random Fields.
problem Vulnerability of GNNs to adversarial attacks.
method Post-hoc approach using Conditional Random Fields (CRF).
result Improves robustness of GNNs across various models.
Node Masking improves GNNs' scalability and generalization.
problem Improving GNNs' ability to handle arbitrary graphs.
method Introducing Node Masking to enhance GNNs' performance.
result Node Masking enables GNNs to generalize and scale better.
GNNs learn graph representations, with new theory on their power and limitations.
problem Understanding the capabilities and limitations of GNNs.
method Theoretical analysis of GNNs, focusing on approximation and learning properties.
result New insights into the representation, generalization, and extrapolation of GNNs.
Unified framework for subgraph-enhanced GNNs, improving prediction accuracy and reducing computation time.
problem Limited understanding of subgraph-enhanced GNNs and their relation to the Weisfeiler-Leman hierarchy.
method Theoretical framework, theoretical expressivity results, and data-driven subgraph sampling methods.
result Data-driven subgraph-enhanced GNNs outperform non-data-driven methods in predictive performance.
Learning node embeddings that capture a node's position within the broader graph structure is crucial for many prediction tasks on graphs. However, existing Graph Neural Network (GNN) architectures have limited power in capturing the position/location of a given node with respect to all other nodes of the graph. Here w…
Hyperbolic GNNs improve graph data learning.
problem Learning from graph-structured data.
method Proposes a novel GNN architecture for Riemannian manifolds.
result Hyperbolic GNNs lead to substantial improvements on benchmark datasets.
GraphNorm accelerates GNN training by adapting InstanceNorm, improving convergence and generalization.
problem Improving convergence and generalization of Graph Neural Networks (GNNs).
method Adapting InstanceNorm to GNNs, proposing GraphNorm with a learnable shift.
result GNNs with GraphNorm converge faster and achieve better performance on benchmarks.