Graph Posterior Network improves uncertainty estimation for node classification in interdependent graphs.
problem Uncertainty quantification for non-independent node-level predictions in graphs.
method Derives axioms for expected predictive uncertainty, proposes Graph Posterior Network (GPN) which performs Bayesian posterior updates.
result GPN outperforms existing approaches for uncertainty estimation in semi-supervised node classification.
Proposes active learning for meta-learning in graph node response prediction.
problem Difficulty in improving performance with meta-learning due to unbalanced observations.
method Combines graph convolutional neural networks and reinforcement learning for both prediction and node selection.
result Can predict responses and select nodes even for unseen response variables.
This paper tackles graph translation challenges by predicting both node and edge attributes simultaneously.
problem Challenges in predicting both node and edge attributes in graph translation, especially in interactive, iterative, and asynchronous processes.
method Developed a novel framework integrating both node and edge translations seamlessly, using spectral graph regularization to maintain consistency.
result Demonstrated the effectiveness of the proposed method on both synthetic and real-world application data.
We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these functions reflect node features, then they are related through the graph structure.…
SPARC tackles cold-start nodes in graphs by using spectral embeddings.
problem Cold-start nodes in graphs lacking initial connections.
method Introduces SPARC, a framework utilizing spectral embeddings to predict on cold-start nodes.
result SPARC outperforms existing models on cold-start nodes across tasks.
This paper learns graph node representations using global context prediction.
problem Efficiently learning useful node representations from unlabeled graph data.
method Randomly selects node pairs, trains a neural net to predict contextual positions.
result Our approach outperforms many unsupervised methods and sometimes supervised ones.
GEN tackles few-shot out-of-graph link prediction in evolving multi-relational graphs.
problem Predicting links between unseen nodes in evolving multi-relational graphs with few edges per node.
method Transductive meta-learning framework (GEN) for inductive and transductive inference.
result GEN significantly outperforms relevant baselines for out-of-graph link prediction tasks.
Learning node embeddings that capture a node's position within the broader graph structure is crucial for many prediction tasks on graphs. However, existing Graph Neural Network (GNN) architectures have limited power in capturing the position/location of a given node with respect to all other nodes of the graph. Here w…
Graph attention networks improve performance on heterogeneous graphs.
problem Complex performance of GNNs on heterogeneous graphs.
method Integrating positional encodings into graph attention networks.
result Graph attention networks excel in node classification and link prediction.
PanRep learns universal node embeddings for heterogeneous graphs.
problem Learning universal node embeddings for heterogeneous graphs.
method Graph Neural Network (GNN) model with four decoders capturing different properties.
result PanRep outperforms unsupervised and supervised methods in node classification and link prediction.
Kernel and linear regression have been recently explored in the prediction of graph signals as the output, given arbitrary input signals that are agnostic to the graph. In many real-world problems, the graph expands over time as new nodes get introduced. Keeping this premise in mind, we propose a method to recursively …
This work investigates how GCNs should handle local structure discrepancies in testing nodes.
problem GCNs assume homophily but real graphs often have discrepancies in local structure.
method Using causal graph analysis, the study intervenes the graph structure to assess the local structure's impact on predictions.
result The method effectively enhances GCN predictions by eliminating local structure discrepancies.
We examine two fundamental tasks associated with graph representation learning: link prediction and semi-supervised node classification. We present a novel autoencoder architecture capable of learning a joint representation of both local graph structure and available node features for the multi-task learning of link pr…
Graph auto-encoder predicts unobserved node features from biological networks and omics data.
problem Integrating biological networks and continuous node features for better prediction.
method Graph neural networks and feature auto-encoders trained on feature reconstruction.
result Graph feature auto-encoder outperforms auto-encoders trained on graph reconstruction for predicting unobserved node features.
Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static relationships. We propose the Graph Learning Network (GLN), a simple yet effective p…
In this work, we present a method for node embedding in temporal graphs. We propose an algorithm that learns the evolution of a temporal graph's nodes and edges over time and incorporates this dynamics in a temporal node embedding framework for different graph prediction tasks. We present a joint loss function that cre…
DEAL model predicts links for new nodes with only attribute info.
problem Predicting links for new nodes with only attribute info.
method DEAL model with two encoders and alignment mechanism.
result DEAL significantly outperforms existing methods on inductive link prediction.
Improves GNN prediction sets with conformal prediction for node classification.
problem Lack of predictive uncertainty for GNN models.
method Adapted conformal prediction for graph data, weighting scores based on graph structure.
result Better calibrated and tighter prediction sets than naive conformal prediction.
GG-SAGE predicts links in directed graphs with attributes, outperforming existing methods.
problem Predicting links in directed graphs with node attributes.
method Gravity-GraphSAGE, a modified GraphSAGE model with a gravity-inspired decoder.
result GG-SAGE outperforms state-of-the-art GDL link prediction techniques.
Proposes a method to quantify uncertainty in graph neural networks for node classification.
problem Uncertainty in graph neural networks for node classification.
method Bayesian uncertainty propagation (BUP) method embedding GNNs in a Bayesian framework.
result Demonstrates superior performance of the proposed method on benchmark datasets.
CopulaGNN integrates graph representational and correlational roles for better node-level predictions.
problem Graphs encode diverse roles in node-level prediction tasks, but GNNs struggle with correlational information.
method Copula theory to describe multivariate dependence, integrating representational and correlational graph information.
result CopulaGNN improves GNN performance on regression tasks by leveraging both types of graph information.
DE improves GNNs by distinguishing graph substructures, enhancing accuracy.
problem Limited expressive power of GNNs in representing graph substructures.
method Introduces Distance Encoding (DE) to assist GNNs in distinguishing graph substructures.
result DE distinguishes graph substructures that traditional GNNs cannot, improving accuracy.
Graph InfoClust learns node representations by capturing cluster-level information, improving graph mining tasks.
problem Leveraging cluster-level node information for unsupervised graph representation learning.
method Graph InfoClust (GIC) uses a differentiable K-means method to compute clusters and jointly optimizes mutual information between nodes of the same cluster.
result GIC outperforms state-of-the-art methods in various downstream tasks with a 0.9% to 6.1% gain.
Framework learns dynamic graph attributes and links co-evolution.
problem Forecasting change of node attributes and link formation in dynamic graphs.
method CoEvoGNN framework with temporal self-attention and joint optimization.
result Framework outperforms baselines on predicting unseen graph snapshots.
Embedding graph nodes into a vector space can allow the use of machine learning to e.g. predict node classes, but the study of node embedding algorithms is immature compared to the natural language processing field because of a diverse nature of graphs. We examine the performance of node embedding algorithms with respe…
Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods. In particular, graph AE and VAE were successfully leveraged to tackle the challenging link prediction problem, aiming at figuring out whether some pairs of nodes from a graph are connected by unobserved edges…
Persona2vec learns multiple node roles in graphs.
problem Graphs often have nodes with multiple overlapping roles.
method Persona2vec learns multiple node representations based on structural contexts.
result Persona2vec outperforms state-of-the-art models in link prediction.
RoCP-GNN improves GNNs' robustness in graph node classification.
problem Uncertainty in GNN predictions for graph data.
method Integrates conformal prediction into GNN training for robust prediction sets.
result GNN models with size loss improve performance in node classification.
We develop the Latent Multi-group Membership Graph (LMMG) model, a model of networks with rich node feature structure. In the LMMG model, each node belongs to multiple groups and each latent group models the occurrence of links as well as the node feature structure. The LMMG can be used to summarize the network structu…
New method detects novel node categories in graphs with distribution shifts.
problem Detecting novel node categories in graphs with distribution shifts.
method Recall-Constrained Optimization with Selective Link Prediction (RECO-SLIP).
result RECO-SLIP outperforms existing methods in detecting novel node categories.
TuneUp improves GNN training by focusing on hard-to-learn nodes.
problem Sub-optimal training of GNNs on all nodes equally.
method Two-stage training: base GNN + tail node improvement.
result Significant improvement in tail node prediction performance.
Graph transformers outperform graph convolutions by preserving community information.
problem Understanding why graph transformers perform well in node-level prediction tasks.
method Analyzing the Gaussian process limits of graph transformers with infinite width and infinite heads.
result Graph transformers maintain discriminative node representations even in deep layers, preventing oversmoothing.
Proposes a novel approach using vector cross product to preserve directional edges in directed graphs.
problem Preserving directional edges in directed graphs for tasks like link prediction and node recommendation.
method Integrates the non-commutative property of vector cross product into a Siamese neural network to learn N-dimensional embeddings.
result Low-dimensional embeddings effectively preserve directional properties and outperform state-of-the-art methods.
Learning latent representations of nodes in graphs is an important and ubiquitous task with widespread applications such as link prediction, node classification, and graph visualization. Previous methods on graph representation learning mainly focus on static graphs, however, many real-world graphs are dynamic and evol…
CatGCN improves GCNs by modeling feature interactions for categorical node features.
problem Suboptimal initial node representations in GCNs due to lack of feature interaction modeling.
method Integrates explicit interaction modeling (local and global) into initial node representation learning for categorical node features.
result CatGCN enhances initial node representations through feature interaction modeling, leading to improved model performance.
The study analyzes and benchmarks graph conformal prediction methods.
problem Uncertainty quantification in graph node classification.
method Analysis and scaling of existing graph conformal prediction methods.
result Justified recommendations for future graph conformal prediction research.
The accurate and interpretable prediction of future events in time-series data often requires the capturing of representative patterns (or referred to as states) underpinning the observed data. To this end, most existing studies focus on the representation and recognition of states, but ignore the changing transitional…
RR-GNN improves GNN prediction intervals by accounting for graph heteroscedasticity and structural biases.
problem Uncertainty quantification in GNNs for high-stakes domains.
method Graph-Structured Mondrian CP, Residual-Adaptive Nonconformity Scores, Cross-Training Protocol.
result Improved efficiency and no loss of coverage compared to CP baselines.
We investigate the problem of sequentially predicting the binary labels on the nodes of an arbitrary weighted graph. We show that, under a suitable parametrization of the problem, the optimal number of prediction mistakes can be characterized (up to logarithmic factors) by the cutsize of a random spanning tree of the g…
GOAT learns multiple node representations from graph structure alone.
problem Context-free graph representation learning limits model performance.
method Inspired by gossip and mutual attention, GOAT learns multiple node representations.
result GOAT outperforms 12 SOTA baselines on link prediction and clustering tasks.
We propose a novel approach for learning node representations in directed graphs, which maintains separate views or embedding spaces for the two distinct node roles induced by the directionality of the edges. We argue that the previous approaches either fail to encode the edge directionality or their encodings cannot b…
Graph embedding has recently gained momentum in the research community, in particular after the introduction of random walk and neural network based approaches. However, most of the embedding approaches focus on representing the local neighborhood of nodes and fail to capture the global graph structure, i.e. to retain …
Study on predicting graph labels at nodes using local averaging and distance estimation.
problem Predicting graph labels at nodes given observations at other nodes.
method Local averaging and distance estimation methods for graph regression.
result Alternative methods can achieve standard nonparametric rates even when graph neighborhoods are too large or small.
In this work, we study semi-supervised multi-label node classification problem in attributed graphs. Classic solutions to multi-label node classification follow two steps, first learn node embedding and then build a node classifier on the learned embedding. To improve the discriminating power of the node embedding, we …
Graph embedding is an important approach for graph analysis tasks such as node classification and link prediction. The goal of graph embedding is to find a low dimensional representation of graph nodes that preserves the graph information. Recent methods like Graph Convolutional Network (GCN) try to consider node attri…
Proposes a hybrid model for stock market report classification using graph neural networks.
problem Lack of unified node embeddings for heterogeneous graphs in text datasets.
method Transductive hybrid approach combining unsupervised node representation learning and supervised node classification/edge prediction.
result Demonstrates the model's ability to classify stock market technical analysis reports.
RR-GCN uses random transformations instead of learned weights for node embeddings.
problem Learning node embeddings in KGs.
method Random Relational Graph Convolutional Network (RR-GCN) with untrained parameters.
result RR-GCN can compete with fully trained R-GCNs in node classification and link prediction.
New graph embedding method improves link prediction and node classification.
problem Improving graph embedding methods for better node representation.
method Spectral-biased random walks with neighborhood similarity bias.
result Significantly improves link prediction and node classification.