Eigen-GNN enhances GNNs by preserving graph structures.
problem Existing shallow GNNs fail to effectively preserve graph structures.
method Integrates eigenspace of graph structures into GNNs as a dimensionality reduction module.
result Eigen-GNN boosts GNNs' ability to preserve graph structures without increasing depth.
SHAKE-GNN scales GNNs for large graphs with multi-scale representations.
problem Scaling Graph Neural Networks (GNNs) to large graphs.
method SHAKE-GNN uses a hierarchy of Kirchhoff Forests for stochastic multi-resolution graph decompositions.
result SHAKE-GNN achieves competitive performance on large-scale graph classification benchmarks.
GPT-GNN pre-trains GNNs on unlabeled graphs to improve downstream performance.
problem Training GNNs requires labeled data, which is expensive.
method Generative pre-training of GNNs on unlabeled data with self-supervision.
result GPT-GNN significantly outperforms state-of-the-art GNNs without pre-training.
LC-GNN improves GNNs for node classification by incorporating label consistency.
problem Limited performance of GNNs due to label consistency assumption not always holding.
method LC-GNN uses node pairs with the same label but unconnected to expand GNN's receptive field.
result LC-GNN outperforms traditional GNNs in semi-supervised node classification.
New insights into GNN optimization reveal skip connections and depth accelerate training.
problem Understanding and optimizing the training of Graph Neural Networks (GNNs).
method Analysis of gradient dynamics in linearized GNNs and empirical validation.
result GNNs are implicitly accelerated by skip connections, more depth, and good label distribution during training.
Survey on GNNs' power and limitations.
problem Theoretical limitations of GNNs.
method Comprehensive overview of GNNs and their variants.
result Provably powerful variants of GNNs.
GNNs with random node initialization are shown to be universally expressive.
problem Limitations of standard GNNs in distinguishing graphs.
method Random node initialization (RNI) to enhance GNNs' expressive power.
result GNNs with RNI are proven to be universally expressive.
Unified framework for adaptive connection sampling in GNNs improves performance and robustness.
problem Over-smoothing and over-fitting in deep GNNs.
method Adaptive connection sampling trained jointly with GNN model parameters.
result Adaptive connection sampling mathematically equivalent to Bayesian GNNs approximation.
New algorithms reduce communication in GNN training.
problem Higher communication costs in GNNs due to sparse connectivity.
method Parallel algorithms for sparse-dense matrix multiplication.
result Asymptotic reduction in communication compared to previous methods.
Graph neural network (GNN), as a powerful representation learning model on graph data, attracts much attention across various disciplines. However, recent studies show that GNN is vulnerable to adversarial attacks. How to make GNN more robust? What are the key vulnerabilities in GNN? How to address the vulnerabilities …
ADMP-GNN dynamically adjusts message-passing layers for better graph learning performance.
problem Fixed message-passing steps in GNNs do not account for nodes' varying computational needs.
method Proposes ADMP-GNN, which dynamically adjusts the number of message-passing layers for each node.
result Improves performance on node classification tasks compared to baseline GNN models.
CI-GNN uses GNNs to diagnose psychiatric disorders by identifying causally relevant brain regions.
problem Leveraging GNNs for psychiatric diagnosis requires interpretable models to understand decision-making.
method CI-GNN integrates Granger causality into GNNs to identify causally relevant subgraphs.
result CI-GNN provides more reliable and concise explanations of psychiatric diagnoses.
Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some non-isomorphic graphs and they cannot learn efficient graph algorithms. In this paper,…
Learning node embeddings that capture a node's position within the broader graph structure is crucial for many prediction tasks on graphs. However, existing Graph Neural Network (GNN) architectures have limited power in capturing the position/location of a given node with respect to all other nodes of the graph. Here w…
UM-GNN improves GNN robustness against poisoning attacks.
problem Vulnerability of GNNs to poisoning attacks.
method UM-GNN uses epistemic uncertainties from message passing to build a surrogate predictor.
result UM-GNN achieves significantly improved robustness against poisoning attacks.
TF-GNN simplifies graph neural networks in TensorFlow.
problem Handling rich heterogeneous graph data in machine learning.
method A scalable library with a Keras message passing API.
result Enables low-code solutions for broader developers.
Paper tackles fairness issues in GNNs by proposing ELEGANT for certification.
problem Fairness issues in GNN predictions due to graph data perturbations.
method Proposes ELEGANT framework for certifying fairness of any GNN without assumptions or re-training.
result The fairness of any GNN backbone is impossible to be corrupted under certain perturbation budgets.
Simplified NAS for GNN architectures improves efficiency and expressiveness.
problem Efficient and effective discovery of optimal GNN architectures.
method SNAG framework with a novel search space and reinforcement learning.
result SNAG framework outperforms human-designed and existing NAS methods.
A new method for training GNNs without a teacher model.
problem Training over-parameterized GNN models is difficult and inefficient.
method GNN Self-Distillation (GNN-SD) with NDR and ADR.
result Improves GNN performance with less training cost and better generalization.
GNNs generalize CNNs for graph data, showing equivariance and stability.
problem Processing signals on graphs.
method Graph convolutional filters, nonlinearities, stacked layers.
result GNNs converge to graphon neural networks under graph convergence.
Researchers explore statistical perspectives to understand GNN generalization.
problem Limited mathematical understanding of GNN performance.
method Three broad frameworks: learning theory, asymptotics, and random graph models.
result Various theoretical results and open questions identified.
Tail-GNNs improve protein function prediction using relational reinforcement.
problem Predicting hierarchical protein functions from sequence data.
method Combining Tail-GNNs with dilated convolutional networks for multi-task learning.
result Significant improvement in F_1 score for protein function prediction.
GraphNorm accelerates GNN training by adapting InstanceNorm, improving convergence and generalization.
problem Improving convergence and generalization of Graph Neural Networks (GNNs).
method Adapting InstanceNorm to GNNs, proposing GraphNorm with a learnable shift.
result GNNs with GraphNorm converge faster and achieve better performance on benchmarks.
Boost GNNs for node classification by incorporating label dependencies.
problem Current GNNs lack expressiveness and fail to capture label dependencies.
method Proposes a collective learning framework combining collective classification and self-supervised learning.
result Consistent, significant improvement in node classification accuracy across various GNNs.
SGQuant reduces GNN memory usage without significant accuracy loss.
problem High memory consumption in GNNs limits their applicability on memory-constrained devices.
method Proposes a specialized GNN quantization scheme (SGQuant) with a quantization algorithm, fine-tuning scheme, and multi-granularity strategy.
result SGQuant reduces GNN memory footprint from 4.25x to 31.9x with minimal accuracy loss.
Alt-GNNs improve travel mode choice modeling by integrating graph neural networks with GEV models.
problem Capturing alternative dependence in discrete choice models with predefined, symmetric, and uniform dependence.
method Introducing Alternative Graph Neural Networks (Alt-GNNs) that embed alternative dependence within a unified framework.
result Alt-GNNs significantly improve predictive performance over benchmark models in travel mode choice datasets.
Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture. It is because the performance of a GNN architecture is significantly affected b…
We address two fundamental questions about graph neural networks (GNNs). First, we prove that several important graph properties cannot be computed by GNNs that rely entirely on local information. Such GNNs include the standard message passing models, and more powerful spatial variants that exploit local graph structur…
Sketch-GNN reduces GNN training time and memory usage to sublinear scales.
problem Training GNNs on large graphs is computationally expensive and memory-intensive.
method Develops a sketch-based algorithm that trains GNNs on compact sketches of graph adjacency and node embeddings.
result Training time and memory usage grow sublinearly with respect to graph size.
Enhances GNNs for causal relationship learning.
problem Lack of robust causal modeling in GNNs.
method Synthesized dataset with known causal relationships, lightweight GNN module.
result Empirically validated GNN module improves causal learning.
DistShap parallelizes GNN explanation for large graphs.
problem Computational expense in attributing GNN predictions to specific edges or features.
method Distributed Shapley values across multiple GPUs for scalable GNN explanations.
result DistShap outperforms existing methods and scales to models with millions of features.
The paper improves GNN generalization theory by considering graph manifolds.
problem Improper GNN generalization bounds ignoring graph structures.
method Taking a manifold perspective, the paper establishes GNN generalization theory.
result GNN generalization bounds decrease linearly with graph size and spectral continuity.
Advanced GNNs improve molecular generation models.
problem Generating complete graphs with multiple nodes and edges based on labels.
method Replaced standard GNNs with more expressive GNNs in autoregressive and one-shot generation models.
result Advanced GNNs can improve performance of graph generative models, but expressiveness is not a necessity.
New p-Laplacian GNN model tackles heterophilic graphs by improving node classification.
problem Heterophilic graphs where node labels differ, leading to poor GNN performance.
method Proposes p-Laplacian GNN model with a new message passing mechanism derived from discrete regularization. result Significantly outperforms state-of-the-art GNNs on heterophilic benchmarks.
Graph neural networks (GNNs) have received much attention recently because of their excellent performance on graph-based tasks. However, existing research on GNNs focuses on designing more effective models without considering much about the quality of the input data. In this paper, we propose self-enhanced GNN (SEG), w…
A new aggregation strategy improves GNN performance and learning dynamics.
problem Improving expressivity and learning dynamics of GNNs.
method Proposes a variance-preserving aggregation function (VPA) for GNNs.
result VPA leads to increased predictive performance and improved learning dynamics.
TOGL adds topological info to GNNs, improving graph and node classification.
problem Graph neural networks lack substructure awareness, especially cycles.
method Integrates global topological information using persistent homology.
result Improves predictive performance for graph and node classification.
Policy-GNN optimizes GNN aggregation for diverse node iterations.
problem Optimizing GNN performance by varying aggregation iterations for different nodes.
method Policy-GNN uses a meta-policy framework with deep reinforcement learning to adaptively determine the number of aggregations for each node.
result Policy-GNN significantly outperforms state-of-the-art alternatives on real-world datasets.
TuneUp improves GNN training by focusing on hard-to-learn nodes.
problem Sub-optimal training of GNNs on all nodes equally.
method Two-stage training: base GNN + tail node improvement.
result Significant improvement in tail node prediction performance.
Simpler GNNs with low-rank non-parametric aggregators perform well on graph benchmarks.
problem Over-engineering in GNN architectures for common semi-supervised node classification datasets.
method Replacing feature aggregation with a non-parametric learner to streamline GNN design.
result Non-parametric regression is effective for semi-supervised learning on sparse, directed networks.
ER-GNN uses experience replay to prevent GNNs from forgetting previous tasks.
problem Catastrophic forgetting in GNNs when learning multiple tasks sequentially.
method Experience Replay framework to store and replay knowledge from previous tasks.
result ER-GNN effectively mitigates catastrophic forgetting in GNNs.
RoCP-GNN improves GNNs' robustness in graph node classification.
problem Uncertainty in GNN predictions for graph data.
method Integrates conformal prediction into GNN training for robust prediction sets.
result GNN models with size loss improve performance in node classification.
RR-GNN improves GNN prediction intervals by accounting for graph heteroscedasticity and structural biases.
problem Uncertainty quantification in GNNs for high-stakes domains.
method Graph-Structured Mondrian CP, Residual-Adaptive Nonconformity Scores, Cross-Training Protocol.
result Improved efficiency and no loss of coverage compared to CP baselines.
VQ-GNN scales GNNs to large graphs using vector quantization.
problem Scaling GNNs to large graphs with stable performance and speed.
method VQ-GNN uses vector quantization to preserve all messages passed to a mini-batch of nodes, avoiding the 'neighbor explosion' problem.
result VQ-GNN achieves competitive performance on large-graph node classification and link prediction benchmarks.
Poly-GNNs achieve similar performance regardless of depth, highlighting graph noise's dominance.
problem Performance of poly-GNNs in semi-supervised node classification.
method Analysis of poly-GNNs under a contextual stochastic block model (CSBM).
result For a sufficiently large graph, depth k>1 poly-GNNs exhibit the same rate of separation as depth k=1 counterparts. Wide and Deep GNN learns from distributed graphs and retrain online.
problem Decentralized graph support changes over time, causing mismatch between training and testing graphs.
method Wide and Deep GNN architecture with distributed online learning.
result Convergence guarantees for online retraining of the wide part of the GNN.
Graph neural networks struggle to propagate long-range information, causing over-squashing.
problem Graph neural networks struggle to propagate long-range information.
method Identified over-squashing as the bottleneck in GNNs, demonstrated on various models.
result Breaking the bottleneck improves GNNs' performance on long-range problems.
Unified framework sparsifies GNNs for faster inference on large graphs.
problem Space and computational bottlenecks in GNNs due to graph size and connectivity.
method Unified GNN sparsification (UGS) framework that prunes graph adjacency matrix and model weights.
result Graph lottery tickets (GLTs) can be trained in isolation to match full model performance.