Improved graph attention model for noisy graphs.
problem Understanding and improving graph attention in noisy graphs.
method Proposes SuperGAT, a self-supervised graph attention network.
result SuperGAT learns more expressive attention by encoding edges.
New model improves graph attention for relational data.
problem Improving graph attention models for relational data.
method Relational Graph Attention Networks (R-GAT) extending non-relational graph attention to relational data.
result R-GAT performs worse than expected, but some configurations marginally improve molecular property modeling.
CoulGAT interprets GAT models by analyzing node interactions.
problem Understanding and interpreting the complex interactions within graph attention networks.
method Developed a CoulGAT framework to analyze and interpret GAT model layers and datasets.
result Extracted node-node and node-feature interactions to define a standard model for graph structure.
Graph neural networks benefit from attention under specific conditions.
problem Understanding and improving the effectiveness of attention in graph neural networks.
method Designing controlled graph reasoning tasks, analyzing performance under various conditions, proposing weakly-supervised training.
result Attention can provide significant gains in performance under certain conditions, but its effect is often negligible or harmful.
Study compares deep learning models for traffic forecasting, highlighting graph elements' impact.
problem Challenges in forecasting spatial-temporal traffic patterns.
method In-depth comparative study of four deep neural network models with different basic elements.
result Graph attention improves long-term predictions in traffic forecasting models.
Graph attention improves node classification by distinguishing important edges.
problem Node classification in graph-based learning models.
method Theoretical analysis of graph attention networks for node classification.
result Graph attention can perfectly classify nodes in an 'easy' regime but fails in a 'hard' regime.
New graph attention operators improve performance and reduce computational costs.
problem Excessive computational resources in graph attention operators.
method Proposed hGAO and cGAO using hard and channel-wise attention mechanisms.
result Improved performance and computational savings with new operators.
Improved robustness of GAT models for semi-supervised learning.
problem Vulnerability of GAT models to rogue nodes.
method Proposed regularization strategies to improve GAT models' robustness.
result Performance improvements on semi-supervised learning using robust GAT models.
This paper explains GNNs using graph signal denoising.
problem Understanding how GNNs work for node representation learning.
method Spectral graph convolutional networks and graph attention networks are analyzed from the perspective of graph signal denoising.
result GNNs implicitly solve graph signal denoising problems.
Graph attention is not always beneficial; conditions for perfect node classification are identified.
problem Understanding when graph attention mechanisms improve node classification performance.
method Theoretical analysis using Contextual Stochastic Block Models (CSBMs).
result Graph attention mechanisms are more effective when structure noise exceeds feature noise, and simpler graph convolution operations are better when feature noise predominates.
HopGAT improves node classification in sparsely labeled graphs by learning from distant neighbors.
problem Classifying nodes in sparsely labeled graphs with limited labeled data.
method Hop-aware supervision mechanism and simulated annealing learning strategy.
result The model achieves high accuracy even with 40% labeled data, reducing performance loss to 3.9%.
Dual-attention GCN improves text classification by adapting to textual complexity.
problem Challenges in learning discriminative features from texts due to graph variants.
method Proposes a dual-attention GCN with connection-attention and hop-attention mechanisms.
result Achieves state-of-the-art performance on text classification tasks.
Graph attention networks improve performance on heterogeneous graphs.
problem Complex performance of GNNs on heterogeneous graphs.
method Integrating positional encodings into graph attention networks.
result Graph attention networks excel in node classification and link prediction.
A novel hyperbolic graph attention network for non-Euclidean graph data.
problem Non-Euclidean graph data requires specialized models to capture its unique properties.
method Employed gyrovector spaces to transform features and hyperbolic proximity attention mechanism for aggregation. Novel acceleration strategy using logarithmic and exponential mappings.
result Demonstrated superior performance on real-world datasets compared to state-of-the-art methods.
Paper proposes a new unsupervised clustering method using attention models.
problem Unsupervised community detection on graphs.
method Optimizes soft modularity loss on Bethe Hessian embeddings.
result Model performs competitively with classical and GNN methods.
Graph Attention Networks improve image classification with superpixels.
problem Classifying images with irregular shapes and edges.
method Transform images into superpixel graphs, then apply GATs.
result GATs outperform other GNN models in image classification.
CPA models improve GNNs by preserving node cardinality.
problem Limited understanding of attention-based GNNs' discriminative power.
method Theoretical analysis and CPA models to preserve cardinality information.
result CPA models can improve GNNs' performance in node and graph classification.
Proposes a novel node embedding framework for graphs using Fisher Information.
problem Lack of theoretical understanding of attention-based GNNs.
method Uses hierarchical kernels and Fisher Information to learn node embeddings.
result Proposed method outperforms existing GNNs on node classification benchmarks.
Lipschitz normalization boosts deep attention models, especially for graph neural networks.
problem Gradient explosion in deep graph attention networks leads to poor performance.
method Enforcing Lipschitz continuity by normalizing attention scores.
result Deep GAT models with LipschitzNorm achieve state-of-the-art results for tasks with long-range dependencies.
Graph attention network improves MLTC by capturing label dependencies.
problem Ignoring label dependencies in MLTC tasks.
method Graph attention network model that captures label dependencies.
result The model achieves similar or better performance than state-of-the-art models.
A new graph pooling method using self-attention improves graph classification performance.
problem Challenges in applying downsampling to graphs in graph neural networks.
method Proposes a self-attention-based graph pooling method.
result Our method achieves superior graph classification performance on benchmark datasets.
Proposes a model for multi-agent reinforcement learning with hierarchical graph attention network.
problem Limited transferability of trained policies to new multi-agent tasks.
method Uses hierarchical graph attention network for representation learning and multi-agent actor-critic for policy learning.
result Demonstrates superior performance in mixed cooperative and competitive tasks compared to existing methods.
Proposes CGA model for logical queries over KGs.
problem Handling logical queries over incomplete KGs with unequal query path contributions.
method Multi-head graph attention with initial neighborhood aggregation for center node prediction.
result CGA model outperforms baselines on DB18, WikiGeo19, and Bio datasets.
Graph Attention Networks predict disease state from single-cell data.
problem Predicting disease state from single-cell data.
method Graph Attention Networks (GAT) for learning from both features and graph structures.
result Achieved 92% accuracy in predicting MS from single-cell data.
Efficient graph generation with GRAN using attention and sampling.
problem Generating high-quality graphs efficiently.
method Graph Recurrent Attention Networks (GRAN) with attention mechanisms and sampling.
result State-of-the-art time efficiency and sample quality on benchmarks.
FastGAT reduces GNN computation time by 10x using graph sparsification.
problem High computational burden in attention-based GNNs.
method Spectral sparsification to generate optimal graph pruning.
result Per-epoch time is almost linear in graph nodes, reducing computational time by up to 10x.
Attention-based GNNs can't prevent oversmoothing, leading to homogeneous node representations.
problem The issue of oversmoothing in attention-based GNNs.
method Viewed attention-based GNNs as nonlinear time-varying dynamical systems and used tools from the theory of products of inhomogeneous matrices and the joint spectral radius.
result Graph attention mechanism cannot prevent oversmoothing and loses expressive power exponentially.
New interpretation of attention in Transformers and Graph Attention Networks.
problem Understanding and improving attention mechanisms in deep learning models.
method Decomposed attention into a kernel and a normalization term; generalized the kernel function and norm.
result Generalized attention leads to better performance on various tasks.
SpGAT learns graph representations using spectral attention for efficiency.
problem Efficiently capturing global graph patterns with minimal parameters.
method Introduces Spectral Graph Attention Network (SpGAT) using spectral domain attention mechanisms and a fast Chebychev approximation.
result SpGAT achieves better global pattern recognition with fewer parameters compared to GAT.
NGAT predicts long-term stock trends using graph attention networks.
problem Lack of effective corporate relationship graph comparison methods and model complexity in stock prediction.
method Developed a Node-level Graph Attention Network (NGAT) for corporate relationship graphs.
result Demonstrated the effectiveness of NGAT across two datasets.
GACAN combines multi-granularity time series for traffic forecasting.
problem High dynamics and complex spatial-temporal dependency of road networks in traffic forecasting.
method Graph Attention-Convolution-Attention Networks (GACAN) with Att-Conv-Att (ACA) block.
result GACAN outperforms state-of-the-art baselines in traffic forecasting.
New hypergraph operators improve graph neural networks for higher-order relationships.
problem Learning deep embeddings on high-order graph-structured data.
method Introducing hypergraph convolution and hypergraph attention operators.
result Extensive experimental results show the effectiveness of hypergraph operators.
GRAM generates scalable graphs with a novel attention mechanism.
problem Scalability in graph generation for large datasets.
method GRAM uses a graph attention mechanism to generate scalable graphs.
result GRAM outperforms baseline methods in scalability and quality.
A new method reduces memory requirements for Graph Transformers by sparsely training a network.
problem Quadratic memory complexity in Graph Transformers limits their scalability to large graphs.
method Spexphormer: trains a narrow network on augmented graph, then uses only active connections in a wider network.
result Spexphormer achieves good performance with drastically reduced memory requirements.
RoGAT enhances GAT robustness against adversarial attacks.
problem Vulnerability of GAT to adversarial attacks.
method Dynamic adjustment of edge weights and features, with an extra attention score.
result RoGAT outperforms other defensive methods in robustness tests.
Graph convolutional network (GCN) is generalization of convolutional neural network (CNN) to work with arbitrarily structured graphs. A binary adjacency matrix is commonly used in training a GCN. Recently, the attention mechanism allows the network to learn a dynamic and adaptive aggregation of the neighborhood. We pro…
GAT-AGNN learns stock trends using graph and attention mechanisms.
problem Predicting dynamic stock trends in a complex market.
method Sequential graph structure with attention mechanisms.
result GAT-AGNN outperforms state-of-the-art methods in stock trend prediction.
DAGCN improves graph classification by learning neighbor importance and pooling.
problem Loss of early-stage information and loss of node characteristics in GCNs.
method Dual attention graph convolution and self-attention pooling.
result DAGCN outperforms state-of-the-art methods in graph classification.
TSAM predicts directed temporal links using GCN and self-attention.
problem Predicting links in directed temporal networks.
method GCN, self-attention mechanism, autoencoder architecture, graph attentional layers, graph convolutional layers, graph recurrent unit layer.
result TSAM outperforms benchmarks on four realistic networks.
GAT-RWOS uses graph attention to improve imbalanced data classification.
problem Imbalanced data leads to biased models favoring majority classes.
method Combines GATs and random walks to generate synthetic minority samples.
result Improves classification performance on imbalanced datasets.
SGATs learn sparse attention coefficients to improve graph learning tasks on large, noisy graphs.
problem Overfitting and noisy edges in GNNs on large, noisy graphs.
method Sparse Graph Attention Networks (SGATs) learn sparse attention coefficients under L0-norm regularization. result SGATs can remove 50%-80% edges from large graphs while maintaining similar classification accuracies.
Graph embedding methods represent nodes in a continuous vector space, preserving information from the graph (e.g. by sampling random walks). There are many hyper-parameters to these methods (such as random walk length) which have to be manually tuned for every graph. In this paper, we replace random walk hyper-paramete…
GISST interprets GNNs by combining attention and sparsity for graph structure and node feature importance.
problem Lack of joint consideration of graph structure and node features in GNN interpretation.
method Model-agnostic framework using attention mechanism and sparsity regularization.
result GISST achieves superior node feature and edge explanation precision in synthetic and real-world datasets.
CoMGNN models heterogeneous graphs with evolving nodes and edges.
problem Modeling complex, evolving graphs with diverse information.
method Meta graph attention on co-evolving heterogeneous graphs.
result Significant improvement over state-of-the-art methods.
Novel GNN model tackles few-shot learning with improved performance.
problem Few-shot learning with GNN suffers from over-fitting and over-smoothing.
method Proposes Attentive GNN with triple-attention mechanism.
result Improves GNN performance for few-shot learning tasks.
Transformer learns graph structure better with subgraph info.
problem Transformer struggles with structural similarity in graph learning.
method Structure-Aware Transformer with subgraph attention.
result Improves graph prediction benchmarks significantly.
CaGAT learns context-aware edge representations for graph data.
problem Ignoring edge representation in GNNs.
method Unified Context-aware Adaptive Graph Attention Network (CaGAT) that learns both node and edge representations.
result CaGAT improves performance on semi-supervised learning tasks.
CLEAR learns causal graphs from attention in recommender systems to explain user behavior.
problem Understanding why specific recommendations are made in recommender systems.
method CLEAR learns session-specific causal graphs from attention in pre-trained neural recommenders, addressing latent confounders.
result CLEAR provides counterfactual explanations that are shorter and more effective than naive methods.