TGR rewires temporal graphs to improve TGNN performance.
problem Temporal graphs in evolving networks can suffer from under-reaching and over-squashing issues.
method TGR uses expander graph propagation to create message-passing highways between temporally distant nodes.
result TGR achieves state-of-the-art results on temporal graph benchmarks.
Graph Cascades rewire graphs to improve structure-aware learning.
problem Improving graph neural networks and transformers for structure-aware learning.
method Graph Cascades uses contagion-based diffusion processes to construct an auxiliary graph with reinforced edges.
result Graph Cascades improves node-classification benchmarks across various graph types.
Paper proposes JDR to denoise graph features and rewire graphs for better node classification.
problem Jointly denoise noisy graph features and rewire graphs for improved node classification.
method Align leading spectral spaces of graph and feature matrices to solve non-convex optimization problem.
result JDR consistently outperforms existing methods on various node classification tasks.
Rewiring GNNs to optimize community and feature alignment improves their performance.
problem Improving GNNs' performance by addressing over-squashing and generalization issues.
method Three rewiring strategies: ComMa, FeaSt, and ComFy, targeting community structure, node labels, and their alignment.
result Rewiring strategies enhance GNNs' performance by optimizing label-community alignment.
DRew dynamically rewires message passing to improve long-range tasks.
problem Over-squashing in MPNNs due to local message passing.
method Layer-dependent rewiring and delay mechanism for gradual densification.
result DRew outperforms graph Transformers and multi-hop MPNNs on long-range tasks.
Rewiring networks using discrete geometry improves GNN training accuracy and reduces runtime.
problem Inefficient information propagation between distant nodes in graph neural networks.
method Discrete analogues of classical geometric curvature to model and rewire networks.
result Classical geometric notions achieve state-of-the-art GNN training accuracy and significantly reduce runtime.
Due to the dynamic nature of biological systems, biological networks underlying temporal process such as the development of {\it Drosophila melanogaster} can exhibit significant topological changes to facilitate dynamic regulatory functions. Thus it is essential to develop methodologies that capture the temporal evolut…
We propose a family of statistical models for social network evolution over time, which represents an extension of Exponential Random Graph Models (ERGMs). Many of the methods for ERGMs are readily adapted for these models, including maximum likelihood estimation algorithms. We discuss models of this type and their pro…
Graph Neural Networks (GNNs) have boosted the performance of many graph related tasks such as node classification and graph classification. Recent researches show that graph neural networks are vulnerable to adversarial attacks, which deliberately add carefully created unnoticeable perturbation to the graph structure. …
Graph rewiring method alleviates over-squashing in GNNs.
problem Over-squashing and bottlenecks in graph neural networks.
method Curvature-based graph rewiring method.
result Negatively curved edges cause over-squashing in GNNs.
FoSR adds edges to graphs to prevent oversquashing and oversmoothing in GNNs.
problem Oversquashing and oversmoothing in graph neural networks (GNNs).
method First-order spectral rewiring to add edges based on spectral expansion, combined with a relational architecture.
result Our algorithm outperforms existing graph rewiring methods in graph classification tasks.
New method uses curvature to improve graph neural networks.
problem Graph Neural Networks struggle with over-smoothing and over-squashing.
method Augmented Forman-Ricci curvature (AFRC) for scalable rewiring.
result AFRC effectively mitigates over-smoothing and over-squashing.
This work analyzes the stability of graph filters under large perturbations.
problem Stability of graph filters under large edge rewires.
method Proves a bound on stability using frequency response and community structure.
result Graph filter stability depends on perturbation to community structure.
Paper proposes LCP for structural encodings, outperforming existing methods.
problem Improving Graph Neural Networks performance through effective structural encodings.
method Geometric perspective, Local Curvature Profiles (LCP) for structural encodings, combining with global positional encodings, comparing with rewiring techniques.
result LCP significantly outperforms existing structural encodings and combining LCP with global positional encodings improves performance.
This paper improves GNN efficiency for large-scale graph applications.
problem High memory usage and computational costs in large-scale graph applications.
method Sparsification techniques from Network Science and Machine Learning.
result Adaptive rewiring enhances GNN performance and scalability.
Graphs can be smoothed or squashed too, study finds.
problem Graph Neural Networks struggle with over-smoothing and over-squashing issues.
method Unified framework using Ollivier-Ricci curvature to address both issues.
result Over-smoothing and over-squashing linked to positive and negative graph curvature respectively.
This comment reexamines Simard et al.'s work in [D. Simard, L. Nadeau, H. Kroger, Phys. Lett. A 336 (2005) 8-15]. We found that Simard et al. calculated mistakenly the local connectivity lengths Dlocal of networks. The right results of Dlocal are presented and the supervised learning performance of feedforward neural n…
Stochastic networks are a plausible representation of the relational information among entities in dynamic systems such as living cells or social communities. While there is a rich literature in estimating a static or temporally invariant network from observation data, little has been done toward estimating time-varyin…
MPNNs struggle with class-bottlenecks and heterophily, leading to performance limitations.
problem Performance limitations of MPNNs under heterophily and structural bottlenecks.
method A statistical framework decomposing model performance into SNR components and proving bounds on sensitivity.
result Optimal graph structures for maximizing higher-order homophily are disjoint unions of single-class and two-class-bipartite clusters.
New Riemannian GNNs reduce over-squashing in graphs with negative curvature.
problem Over-squashing in Riemannian graph neural networks.
method Generalization of Hyperbolic GNNs to Riemannian manifolds of variable curvature.
result Bounds on sensitivity of node features in Riemannian GNNs as layers increase.
Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently for sparse networks. Several methods exist for pruning connections of a neural network after it was trained without conne…
This paper examines properties of feedforward graphs to improve neural network performance.
problem The choice of computational graph can significantly impact neural network performance.
method The paper introduces two measures: fidelity and mixing time, and evaluates popular graphs using these measures.
result Popular graphs are evaluated based on fidelity and mixing time, revealing their performance implications.
TG-GAN models dynamic graph evolution for continuous-time temporal graphs.
problem Challenges in modeling dynamic temporal graphs, especially in continuous time.
method Temporal Graph Generative Adversarial Network (TG-GAN) that models truncated edge sequences, time budgets, and node attributes.
result TG-GAN significantly outperforms existing methods in efficiency and effectiveness.
Novel TRI-GNN framework improves graph classification robustness.
problem Graph neural networks suffer from over-smoothing and vulnerability to graph perturbations.
method Integrates higher-order graph information via persistent homology and local graph structure learning.
result TRI-GNN outperforms state-of-the-art baselines on node classification tasks.
CT improves neural network performance on cell complex data.
problem Improving predictive performance of neural networks on complex data.
method Introducing the Cellular Transformer (CT) that generalizes graph-based transformers to cell complexes.
result CT achieves state-of-the-art performance on cell complex datasets without complex enhancements.
Framework for dynamic node embeddings from graph streams.
problem Temporal prediction-based applications using graph stream data.
method ε-graph time-series representation, temporal reachability graphs, weighted temporal summary graphs.
result Dynamic embedding methods achieve better predictive performance.
Combines CNN and LSTM for spatio-temporal graph networks.
problem Improving spatio-temporal feature extraction.
method Proposes a new architecture combining CNN and LSTM temporal blocks.
result Empirical comparison shows our model outperforms existing models.
New graph kernels capture spatio-temporal interactions.
problem Lack of justified spatio-temporal graph kernels for graph problems.
method Derive graph kernels via SPDEs for spatio-temporal modelling.
result Non-separable spatio-temporal graph kernels outperform existing ones.
MTRGL learns temporal correlations from multi-modal data for improved pair trading.
problem Discerning temporal correlations among financial entities.
method Combines time series data and discrete features into a temporal graph, using a memory-based temporal graph neural network.
result MTRGL outperforms traditional methods in temporal graph link prediction and pair trading.
Cellina uses supervised disentanglement to predict cell behavior in tissues.
problem Querying counterfactuals on tissue graphs
method Cellina framework using supervised disentanglement
result Outperforms spatially-informed and non-spatial competitors
TGAT learns node embeddings for evolving graphs, capturing both static and temporal features.
problem Learning node embeddings for dynamic graphs with evolving topological structures and temporal patterns.
method Temporal Graph Attention (TGAT) layer using self-attention and functional time encoding.
result TGAT model can inductively infer node embeddings for new and observed nodes as the graph evolves.
MPNNs over-squash distant node information, study shows.
problem Over-squashing in MPNNs where node features ignore distant nodes.
method Theoretical analysis of MPNNs' over-squashing, focusing on width, depth, and graph topology.
result Width mitigates over-squashing but makes network more sensitive, depth doesn't help, graph topology is key.
The spatio-temporal graph learning is becoming an increasingly important object of graph study. Many application domains involve highly dynamic graphs where temporal information is crucial, e.g. traffic networks and financial transaction graphs. Despite the constant progress made on learning structured data, there is s…
HYPA-DBGNN detects anomalous sequential patterns in temporal graphs.
problem Modeling temporal patterns in dynamic graphs, especially considering deviations from random shuffling.
method Two-step approach combining null model inference and neural message passing.
result HYPA-DBGNN outperforms baseline methods in static node classification tasks.
Within many real-world networks the links between pairs of nodes change over time. Thus, there has been a recent boom in studying temporal graphs. Recognizing patterns in temporal graphs requires a proximity measure to compare different temporal graphs. To this end, we propose to study dynamic time warping on temporal …
GTEA learns node representations in temporal interaction graphs.
problem Inductive representation learning on temporal interaction graphs.
method Integrates sequence model with time encoder and self-attention scheme for edge and node embeddings.
result GTEA learns comprehensive node representations capturing temporal and structural characteristics.
New method clusters evolving networks using spatio-temporal graph Laplacian.
problem Clustering communities in time-varying graphs.
method Extends spectral clustering to dynamic graphs using CCA and spatio-temporal graph Laplacian.
result The spatio-temporal graph Laplacian clearly interprets cluster evolution over time.
A new method for embedding temporal relationships in graphs.
problem Limited performance of existing time-aware graph embedding methods.
method Integrates temporal smoothness and task-oriented negative sampling.
result Improves performance in various tasks, especially entity/relationship/temporal scoping prediction.
ECGs improve GNNs for non-homophilic data.
problem Improving GNNs for datasets where nodes are not likely to belong to the same class.
method ECGs rewire GNNs' computation graph to connect nodes likely in the same class using weaker classifiers.
result ECGs improve GNN performance on non-homophilic datasets.
In this work, we present a method for node embedding in temporal graphs. We propose an algorithm that learns the evolution of a temporal graph's nodes and edges over time and incorporates this dynamics in a temporal node embedding framework for different graph prediction tasks. We present a joint loss function that cre…
We model GitHub interactions as a temporal knowledge graph for software engineering questions.
problem Insufficient performance of existing temporal models on extrapolated queries and time prediction.
method Introduced an extension to current temporal models using relative temporal information.
result Improved performance on extrapolated queries and time prediction.
IMPaCT improves node classification in chronological split temporal graphs.
problem Domain adaptation challenges in graph data due to chronological splits.
method IMPaCT proposes a method to impose invariant properties based on realistic assumptions derived from temporal graph structures.
result IMPaCT achieves a 3.8% performance improvement over current SOTA method on the ogbn-mag graph dataset.
Proposes a method to forecast spatial-temporal data with limited training data.
problem Forecasting with nodes having no temporal training data.
method Temporal data augmentation and spatial graph topology learning.
result Improves forecasting performance on nodes without training data.
Spatio-temporal graphs such as traffic networks or gene regulatory systems present challenges for the existing deep learning methods due to the complexity of structural changes over time. To address these issues, we introduce Spatio-Temporal Deep Graph Infomax (STDGI)---a fully unsupervised node representation learning…
Graph Neural Networks improve volatility prediction in financial markets.
problem Traditional models struggle with complex, non-linear interdependencies in financial markets.
method Temporal Graph Attention Network (Temporal GAT) combines GCNs and GATs to capture dynamic graph structures.
result Temporal GAT outperforms traditional GARCH models in volatility forecasting, especially for short- to mid-term predictions.
Many real-world graphs or networks are temporal, e.g., in a social network persons only interact at specific points in time. This information directs dissemination processes on the network, such as the spread of rumors, fake news, or diseases. However, the current state-of-the-art methods for supervised graph classific…
DGRCL integrates dynamic and static graph relations for financial market prediction.
problem Capturing the evolving nature of stock markets while considering both temporal changes and static relational structures.
method Dynamic Graph Representation with Contrastive Learning (DGRCL) framework, including Embedding Enhancement (EE) and Contrastive Constrained Training (CCT) modules.
result DGRCL significantly outperforms state-of-the-art TGL baselines on NASDAQ and NYSE datasets.
A new method detects financial fraud using graph transformers.
problem Detecting fraudulent transactions in financial data.
method Spatial-Temporal-Aware Graph Transformer (STA-GT) integrating GNNs and transformers.
result STA-GT outperforms general GNN models on financial fraud detection.