Graph data augmentation improves GNN performance in node classification.
problem Improving generalizability of graph neural networks (GNNs) in semi-supervised node classification.
method Introduces GAug framework for graph data augmentation using neural edge predictors.
result GAug framework improves GNN-based node classification performance across various architectures and datasets.
Augments graph node features to improve GNN performance.
problem Improving graph neural networks' performance on large-scale datasets.
method Iteratively augments node features with gradient-based adversarial perturbations.
result Boosts model performance in node classification, link prediction, and graph classification tasks.
The paper explains how data augmentation improves semi-supervised learning efficiency.
problem Improving accuracy from a small fraction of labeled data.
method Data augmentation induces a similarity graph, which is graph-Laplacian-regularized for downstream learning.
result A fast transductive rate of O(1/nL) is achieved, reducing the number of labels needed. Graph Neural Networks struggle with generalization, especially OOD data; GRATIN solves this with Gaussian Mixture Model-based augmentation.
problem Graph Neural Networks struggle with generalization, particularly to unseen or out-of-distribution data.
method Theoretical framework using Rademacher complexity to compute a regret bound on generalization error. GRATIN algorithm leveraging Gaussian Mixture Models for efficient data augmentation.
result GRATIN outperforms existing augmentation techniques in terms of generalization and offers improved time complexity.
Enhances graph classification models on small datasets.
problem Over-fitting and undergeneralization on small-scale benchmark datasets.
method Data augmentation via graph structure transformation and model evolution framework.
result Average improvement of 3 - 13% accuracy on graph classification tasks.
Two CSSL-based methods improve graph classification with limited labeled data.
problem Limited labeled data for graph classification leads to overfitting.
method Contrastive self-supervised learning (CSSL) for graph encoders pretraining and regularization.
result CSSL methods reduce overfitting and improve graph classification accuracy.
Introduces data augmentation for graph convolutional networks, proposing Monte Carlo Graph Learning.
problem Lack of transparency in graph convolutional networks.
method Data augmentation through graph structure, training traditional classifiers on expanded training set.
result MCGL shows better tolerance to graph structure noise than GCN on noisy graphs.
PiNGDA learns beneficial noise for graph augmentation stability.
problem Challenges in generating effective and stable graph augmentations.
method PiNGDA uses positive-incentive noise to scientifically analyze and generate beneficial graph augmentations.
result PiNGDA improves GCL performance by learning beneficial noise on graph topology and attributes.
Generative model for creating graphs with new communities.
problem Generating graphs with a new community structure.
method Fit Gaussian mixture model to latent space data and add new clusters based on MDL principle.
result Empirically demonstrated effectiveness of GCA for generating graphs with new community structures.
Recently, data augmentation in the semi-supervised regime, where unlabeled data vastly outnumbers labeled data, has received a considerable attention. In this paper, we describe an efficient technique for this task, exploiting a recent framework we proposed for missing data imputation called graph imputation neural net…
Enhances graph neural networks by creating virtual data examples.
problem Lack of examples to identify optimal graph rationales in graph applications.
method Introduces environment replacement to create virtual data examples and proposes a framework for rationale-environment separation and representation learning.
result Demonstrates the effectiveness and efficiency of the augmentation-based graph rationalization framework on molecular and polymer datasets.
GALA framework learns invariant graph representations via environment augmentation with minimal assumptions.
problem Learning invariant graph representations from different environments without additional assumptions.
method Developed GALA framework with minimal assumptions of variation sufficiency and consistency. Uses an assistant model to differentiate graph environment changes.
result Extracting maximally invariant subgraphs to proxy predictions identifies underlying invariant subgraphs for successful out-of-distribution generalization.
GraphACL learns graph representations without augmentation or homophily assumptions.
problem Learning graph representations on heterophilic graphs (nodes with different labels and features).
method Asymmetric Contrastive Learning for Graphs (GraphACL) considers an asymmetric view of neighboring nodes.
result GraphACL significantly outperforms state-of-the-art methods on both homophilic and heterophilic graphs.
Graph Random Neural Network improves semi-supervised learning on graphs.
problem Over-smoothing, non-robustness, and weak-generalization in GNNs with few labeled nodes.
method Random propagation strategy and consistency regularization.
result Significantly outperforms state-of-the-art GNN baselines on semi-supervised node classification.
Edge augmentation connects disconnected graphs by elevating eigenvalues.
problem Connecting disconnected subgraphs in graphs with zero eigenvalues.
method Elevating zero eigenvalues of graph's spectrum to connect subgraphs.
result The algorithm consistently connects graph components, achieving >50% inter-community edges.
Mixes higher-order simplicial complexes for data augmentation.
problem Lack of labeled data for complex systems with multiway interactions.
method Proposes mixup mechanisms for simplicial complexes, including linear and nonlinear mixup, and a convex clustering mixup.
result Synthetic simplicial complexes interpolate between existing data based on homomorphism densities.
A new framework for systematic graph neural network data augmentation.
problem Diversity and difficulty in choosing graph neural network data augmentation techniques.
method Comprehensive framework capturing all previous RDAs, formal universality proof, automatic training method.
result Improved state of the art through new RDAs and impartial comparison.
iGCL preserves graph semantics in latent space augmentations.
problem Manual tuning of augmentation ratios and unexpected graph changes.
method iGCL uses a Variational Graph Auto-Encoder to learn augmentations in the latent space, optimizing an upper bound for contrastive loss.
result iGCL achieves state-of-the-art performance on graph-level and node-level tasks.
ODVICE augments EHR cohorts using ontology to improve analysis robustness.
problem Limited records in cohorts for rare diseases hamper robust analysis.
method Ontology-driven Monte-Carlo graph spanning algorithm for data augmentation.
result ODVICE augmented cohorts show ~30% improvement in AUC over non-augmented datasets.
Unified framework models graph data as a mixture of graphons using graph moments.
problem Graph datasets often mix from multiple underlying distributions.
method Model graph data as a mixture of graphons, using graph moments to cluster graphs.
result Graphs from similar graphons exhibit similar motif densities, enabling principled estimation of graphon mixture components.
Graph contrastive learning reveals unique inductive biases.
problem Understanding and optimizing graph contrastive learning methods.
method Systematic study of various GCL methods and their properties.
result GCL methods can work without positive or negative samples, and data augmentations have less impact.
Deep multi-task learning attracts much attention in recent years as it achieves good performance in many applications. Feature learning is important to deep multi-task learning for sharing common information among tasks. In this paper, we propose a Hierarchical Graph Neural Network (HGNN) to learn augmented features fo…
SIGL learns scalable graphons from graphs.
problem Estimating graphons from graphs of varying sizes.
method Combines INRs and GNNs for scalable graphon estimation.
result SIGL learns consistent graphons at arbitrary resolutions.
Much of the recent work on learning molecular representations has been based on Graph Convolution Networks (GCN). These models rely on local aggregation operations and can therefore miss higher-order graph properties. To remedy this, we propose Path-Augmented Graph Transformer Networks (PAGTN) that are explicitly built…
Proves accuracy guarantees for self-supervised learning with correlated positive pairs.
problem Lack of theoretical guarantees for self-supervised learning with correlated positive pairs.
method Novel augmentation graph concept and spectral decomposition loss.
result Provably accurate features under linear probe evaluation.
We propose an AdaPtive Noise Augmentation (PANDA) technique to regularize the estimation and construction of undirected graphical models. PANDA iteratively optimizes the objective function given the noise augmented data until convergence to achieve regularization on model parameters. The augmented noises can be designe…
In this article, associated to a (bordered) Legendrian graph, we study and show the equivalence between two categorical Legendrian isotopy invariants: the augmentation category, a unital A∞-category, which lifts the set of augmentations of the associated Chekanov-Eliashberg DGA, and a DG category of construct…
RIA method improves OoD generalization for covariate shift.
problem Improving out-of-distribution generalization under covariate shift.
method Adversarial label invariant graph data augmentations for OoD generalization.
result RIA method achieves high accuracy compared to OoD baselines.
Proposes a method to use causal graph knowledge for better predictive modeling.
problem Lack of effective ways to incorporate causal graph knowledge into predictive models.
method Model-agnostic data augmentation method exploiting CI relations encoded in causal graphs.
result Improves prediction accuracy, especially in small-data scenarios.
We propose an extension of Convolutional Neural Networks (CNNs) to graph-structured data, including strided convolutions and data augmentation on graphs. Our method matches the accuracy of state-of-the-art CNNs when applied on images, without any prior about their 2D regular structure. On fMRI data, we obtain a signifi…
Computer-aided breast cancer diagnosis in mammography is limited by inadequate data and the similarity between benign and cancerous masses. To address this, we propose a signed graph regularized deep neural network with adversarial augmentation, named \textsc{DiagNet}. Firstly, we use adversarial learning to generate p…
In this article, associated to a (bordered) Legendrian graph, we study and show the equivalence between two Legendrian isotopy invariants: augmentation number via point-counting over a finite field, for the augmentation variety of the associated Chekanov-Eliashberg differential graded algebra, and ruling polynomial via…
We propose to generalize the volume conjecture to knotted trivalent graphs and we prove the conjecture for all augmented knotted trivalent graphs. As a corollary we find that for any link L there is a link containing L for which the volume conjecture holds.
This study compares GNNs and GA-MLPs, finding GA-MLPs can distinguish graphs but not count walks.
problem Comparing expressive power and graph isomorphism testing capabilities of GNNs and GA-MLPs.
method GA-MLPs augment node features with multi-hop operators and apply MLPs node-wise; GNNs are compared as a baseline.
result GA-MLPs can distinguish almost all non-isomorphic graphs but cannot count attributed walks, unlike GNNs.
ELCO enhances graph generation by adding new nodes and edges.
problem Improving graph-based semi-supervised learning performance.
method ELCO simulates graph signal generation to add new nodes and edges.
result ELCO significantly boosts model performance on various datasets.
We study the fibration of augmented link complements. Given the diagram of an augmented link we associate a spanning surface and a graph. We then show that this surface is a fiber for the link complement if and only if the associated graph is a tree. We further show that fibration is preserved under Dehn filling on cer…
BGRL learns graph representations without costly negative examples.
problem Efficient representation learning on large graphs without labels.
method Bootstrapped Graph Latents (BGRL) learns by predicting augmentations.
result BGRL achieves state-of-the-art performance with 2-10x memory savings.
Recent progress in deep learning is revolutionizing the healthcare domain including providing solutions to medication recommendations, especially recommending medication combination for patients with complex health conditions. Existing approaches either do not customize based on patient health history, or ignore existi…
AGML model improves indoor localization with sparse fingerprints using meta-learning and graph neural networks.
problem Maintaining high localization accuracy with extremely sparse fingerprints.
method Attentional Graph Neural Network (AGNN) and meta-learning framework with data augmentation strategies.
result AGML model consistently outperforms baseline methods across various metrics.
This paper examines how labeling error affects contrastive learning and proposes data dimensionality reduction methods to mitigate its impact.
problem The impact of labeling error on the performance of contrastive learning.
method Data dimensionality reduction methods (e.g., SVD) are applied to reduce false positive samples and improve downstream classification accuracy.
result Data dimensionality reduction methods can mitigate the negative impacts of labeling error on downstream classification performance.
Knowledge graph embeddings rank among the most successful methods for link prediction in knowledge graphs, i.e., the task of completing an incomplete collection of relational facts. A downside of these models is their strong sensitivity to model hyperparameters, in particular regularizers, which have to be extensively …
Proposes a method to forecast spatial-temporal data with limited training data.
problem Forecasting with nodes having no temporal training data.
method Temporal data augmentation and spatial graph topology learning.
result Improves forecasting performance on nodes without training data.
Augments GNNs with diversification to preserve node identity.
problem Current GNNs filter node information, potentially losing node identity.
method Integrates diversification operators with aggregation to enrich node representations.
result Significant performance boost on 9 node classification tasks.
GraphDINO learns neuronal morphologies from unlabeled data.
problem Unsupervised learning of neuronal morphologies from unlabeled data.
method Transformer-based approach with novel attention mechanism and data augmentation.
result GraphDINO yields morphological clusterings on par with expert classification.
This work analyzes the role of data augmentation in self-supervised learning using RKHS approximation and regression.
problem Limited theoretical understanding of the role of data augmentation in self-supervised learning.
method Geometric characterization of the target function given by augmentation, proving generalization bounds.
result Two generalization bounds are derived, one free of model complexity, the other specific to near-optimal encoders.
TOGL adds topological info to GNNs, improving graph and node classification.
problem Graph neural networks lack substructure awareness, especially cycles.
method Integrates global topological information using persistent homology.
result Improves predictive performance for graph and node classification.
This paper improves GNNs' generalization by adding a Low-Rank Global Attention module.
problem Improving the generalization power of Graph Neural Networks (GNNs).
method Incorporating a Low-Rank Global Attention (LRGA) module into GNNs.
result Augmenting GNNs with LRGA aligns them with a powerful graph isomorphism test, 2-Folklore Weisfeiler-Lehman (2-FWL).
Graph neural networks (GNNs) are an emerging model for learning graph embeddings and making predictions on graph structured data. However, robustness of graph neural networks is not yet well-understood. In this work, we focus on node structural identity predictions, where a representative GNN model is able to achieve n…