A new online learning algorithm for graph-structured sparsity.
problem Efficiently handling graph-structured sparsity constraints in online learning settings.
method Proposes extsc{GraphDA} algorithm that projects gradients and variables onto subspaces.
result Improves classification performance and captures graph-structured features effectively.
Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity information is very specific, e.g., convex sparsity-inducing norms or ℓ 0 \ell^0 ℓ 0 -n…
Sparsity-constrained optimization is an important and challenging problem that has wide applicability in data mining, machine learning, and statistics. In this paper, we focus on sparsity-constrained optimization in cases where the cost function is a general nonlinear function and, in particular, the sparsity constrain…
GISST interprets GNNs by combining attention and sparsity for graph structure and node feature importance.
problem Lack of joint consideration of graph structure and node features in GNN interpretation.
method Model-agnostic framework using attention mechanism and sparsity regularization.
result GISST achieves superior node feature and edge explanation precision in synthetic and real-world datasets.
Proposes DIAL-GNN for joint graph structure and embedding learning.
problem Joint learning of graph structure and embeddings.
method Adapted graph regularization, iterative method for graph structure learning.
result Consistently outperforms state-of-the-art baselines in downstream tasks and computational time.
Estimates change-points and graph structures in a time-varying Ising model.
problem Detecting and understanding changes in a time-varying Ising model.
method Maximizing a penalized conditional log-likelihood to estimate neighborhood of each node, enforcing sparsity and piece-wise constant graph structures.
result First change-points consistency theorems for unknown number of change-points in time-varying Ising model.
Generates correlation matrices with specific graph structures using convex optimization.
problem Creating theoretical correlation matrices with prescribed graph structures.
method Convex optimization framework projecting an initial matrix onto an elliptope with positive semidefiniteness constraint.
result The approach offers greater flexibility in generating correlation matrices with controlled mean of off-diagonal entries.
Algorithm learns non-Gaussian graphical models via Hessian scores and triangular transport.
problem Learning graph structure from non-Gaussian data.
method Score based on integrated Hessian information, coupled with triangular transport map.
result Algorithm successfully recovers graph structure for non-Gaussian data.
We propose a Bayesian approximate inference method for learning the dependence structure of a Gaussian graphical model. Using pseudo-likelihood, we derive an analytical expression to approximate the marginal likelihood for an arbitrary graph structure without invoking any assumptions about decomposability. The majority…
Paper uses graph structure to improve Wikipedia classification.
problem Classifying Wikipedia into a fine-grained named entity hierarchy.
method Explores graph descriptors and weighted models for feature vectors.
result Graph information reduces sparsity and improves classification.
We analyze the necessary number of samples for sparse vector recovery in a noisy linear prediction setup. This model includes problems such as linear regression and classification. We focus on structured graph models. In particular, we prove that sufficient number of samples for the weighted graph model proposed by Heg…
BetaExplainer improves GNN interpretability by masking unimportant edges.
problem Interpreting GNNs' predictions is difficult due to black-box behavior and lack of uncertainty quantification.
method BetaExplainer uses a sparsity-inducing prior to mask unimportant edges during training.
result BetaExplainer provides uncertainty in edge importance and improves predictive accuracy on challenging datasets.
Efficient method certifies robustness of discrete data models, especially graphs.
problem Certifying robustness of discrete data models, especially graphs, is difficult.
method Randomized smoothing framework, sparsity-aware, model-agnostic, tight and efficient.
result Proposes a scalable method for certifying robustness of discrete data models, especially graphs.
New model captures time series dependence across and within blocks.
problem Complex multivariate time series dependence structures.
method Time series Gaussian chain graph models with directed and undirected edges.
result Consistent recovery of time series chain graph structure.
A new model learns graph structures from data.
problem Learning graph topologies from data.
method Proposes a learning to optimise (L2O) approach to learn graph structures from node data.
result The proposed model learns graph structures more efficiently than classic iterative algorithms.
Flexible Cox model for time-dependent covariates with complex sparsity patterns.
problem Lack of flexibility in enforcing specific sparsity patterns in time-dependent Cox models.
method Proposes a flexible framework for variable selection in time-dependent Cox models, accommodating complex selection rules.
result Achieves accurate estimation with low false alarm rates for complex covariate structures.
PGNs dynamically infer and use graph structures to improve model generalization.
problem Static graph structures inferred by machine learning practitioners are often suboptimal for tasks.
method PGNs augment graphs with dynamically inferred pointers for improved model generalization.
result PGNs outperform unrestricted GNNs and Deep Sets on dynamic graph connectivity tasks.
T-LoHo model detects structured sparsity and smoothness on graph data.
problem Detecting structured sparsity and smoothness in graph-structured data.
method Tree-based Low-rank Horseshoe (T-LoHo) prior for multivariate parameters.
result Improves anomaly detection on road networks compared to other methods.
New model handles complex non-linear relationships with hidden graph structures.
problem Modeling non-linear relationships with hidden graph-structured interactions.
method Block-diagonal localized mixture of polynomial experts (BLoMPE) regression model with penalized maximum likelihood selection criterion.
result Strong theoretical guarantee for finite-sample oracle inequality.
CFRecs uses counterfactual reasoning to improve graph-based recommendations in real estate.
problem Improving model interpretability and actionable insights in graph-based recommender systems.
method A two-stage architecture combining GNN and Graph-VAE to propose minimal yet impactful changes in graph structure and node attributes.
result Demonstrates effectiveness in delivering actionable recommendations for home buyers and sellers.
A new causal discovery method, Structural Agnostic Modeling (SAM), is presented in this paper. Leveraging both conditional independencies and distributional asymmetries, SAM aims to find the underlying causal structure from observational data. The approach is based on a game between different players estimating each va…
Bayesian neural networks learn graph structure with interpretable parameters.
problem Learning graph structure from nodal observations in data with uncertainty.
method Introduces novel iterations with independently interpretable parameters and Bayesian neural networks.
result Bayesian neural networks provide well-calibrated uncertainty quantification on graph structure.
A new algorithm estimates sparse gradients on graphs with improved risk bounds.
problem Estimating sparse gradients on graph-structured data.
method Tree-Projected Gradient Descent algorithm for gradient-sparse parameters.
result Achieves risk bound of s ∗ n log ( 1 + p s ∗ ) \frac{s^*}{n} \log (1+\frac{p}{s^*}) n s ∗ log ( 1 + s ∗ p ) . Proposes a robust 3D classification method for sparse point clouds.
problem Invariance to rotation, positional shift, scaling, and robustness to point sparsity in point cloud classification.
method Introduces a graph-based feature learning approach with an end-to-end neural network.
result Significantly improves 3D object classification and retrieval tasks with sparse point clouds.
Genome-wide association studies (GWA studies or GWAS) investigate the relationships between genetic variants such as single-nucleotide polymorphisms (SNPs) and individual traits. Recently, incorporating biological priors together with machine learning methods in GWA studies has attracted increasing attention. However, …
Eigen-GNN enhances GNNs by preserving graph structures.
problem Existing shallow GNNs fail to effectively preserve graph structures.
method Integrates eigenspace of graph structures into GNNs as a dimensionality reduction module.
result Eigen-GNN boosts GNNs' ability to preserve graph structures without increasing depth.
The paper tackles sparse model fitting in distributed machine learning with graph-structured data.
problem Sparse model fitting across a distributed collection of heterogeneous data sets.
method Basis Pursuit Denoising with a total variation penalty, using ADMM for distributed methods.
result Recovery is successful with fewer samples than solving problems independently, or using methods with large overlap in signal supports.
Graph attention auto-encoder reconstructs graph structure and attributes.
problem Lack of methods to reconstruct graph structure and node attributes in graph auto-encoders.
method Stacked encoder/decoder layers with self-attention mechanisms, regularized node representations to reconstruct graph structure.
result Competitive performance on node classification benchmarks, including inductive learning.
This work identifies and mitigates topological bias in HGNNs using meta-weighting and debiasing.
problem Topological bias in HGNNs affects model performance on specific nodes.
method Meta-weighting adjacency matrix, PageRank projection, debiasing structure.
result The debiasing structure improves HGNNs' performance and debiasing.
Investigates how neural network graph structure impacts predictive performance.
problem Lack of understanding between neural network graph structure and predictive performance.
method Developed relational graph representation to analyze neural networks, identifying a 'sweet spot' for improved performance.
result Identified a 'sweet spot' in relational graph structure that significantly improves neural network predictive performance.
The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under the assumption that data is drawn identically from a generating distribution. Introducing sparsity a…
This paper improves GNN robustness by aligning feature and adjacency matrix learning.
problem Improving robustness of graph neural networks (GNN) in noisy graph data.
method Proposes a novel regularized GSL approach that aligns feature information and graph information, incorporating sparse dimensional reduction.
result Demonstrates superior performance in noisy graph structures compared to competitive baselines.
Two new methods improve graph embedding without needing a complete graph structure.
problem Graph autoencoders' performance depends on the adjacency matrix quality.
method BAGE and VBAGE: unsupervised graph embedding via adaptive graph learning.
result The methods expand GAEs' applicability to datasets without graph structure.
We present GraphTSNE, a novel visualization technique for graph-structured data based on t-SNE. The growing interest in graph-structured data increases the importance of gaining human insight into such datasets by means of visualization. Among the most popular visualization techniques, classical t-SNE is not suitable o…
Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph structure. However, for most real data, the graph structures varies in both size and con…
Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs or learn task-driven adaptive graphs. In this paper, we propose Graph Learning Ne…
IDGL learns better graph structure and embeddings iteratively.
problem Improving graph neural network node embeddings and graph structure.
method Iterative Deep Graph Learning framework that dynamically stops when graph structure optimizes for downstream tasks.
result IDGL consistently outperforms state-of-the-art baselines on nine benchmarks.
Processes such as disease propagation and information diffusion often spread over some latent network structure which must be learned from observation. Given a set of unlabeled training examples representing occurrences of an event type of interest (e.g., a disease outbreak), our goal is to learn a graph structure that…
Estimates manifold dimension using local graph structure.
problem Estimating the intrinsic dimension of manifolds from data.
method Regression on local PCA coordinates, focusing on local graph structure.
result Proposed QE and TLS estimators outperform existing methods.
GraphSTONE uses topic models to capture graph structures, improving GCN performance.
problem GCNs focus too much on node features and not enough on graph structures.
method GraphSTONE employs topic models of graphs to capture structural topics, which guide the aggregation of node features.
result GraphSTONE outperforms GCNs in performance, efficiency, and interpretability.
GraphITE estimates individual effects of graph-structured treatments.
problem Estimating individual effects of complex treatment structures.
method Graph neural networks and Hilbert-Schmidt Independence Criterion regularization.
result GraphITE outperforms baselines in estimating treatment effects for large numbers of treatments.
Graph Structured Prediction Energy Networks model correlations for joint inference.
problem Joint inference over multiple variables with high-order correlations.
method Energy Networks for modeling explicit local and implicit higher-order correlations.
result Tractable inference with explicit modeling of correlations.
Method learns graph structure for multi-task learning, revealing interpretable relationships.
problem Learning relationships among tasks in multi-task learning.
method Simultaneously learns graph structure and model parameters, optimizing the graph structure with the model parameters.
result Reduces generalization error and reveals interpretable sparse graph among tasks.
IGML learns discriminative metrics for graph classification.
problem Defining an appropriate distance metric for graph data.
method Supervised distance metric learning in a subgraph-based feature space with sparsity-inducing penalty.
result IGML identifies important subgraphs for graph classification.
New algorithms for causal bandits without knowing the graph structure.
problem Causal bandit problems with unknown graph structure.
method Developed novel causal bandit algorithms for causal trees, forests, and general graphs without prior knowledge of the causal graph.
result Regret guarantees significantly improved over standard MAB algorithms under mild conditions.
This paper introduces Haar convolution for GNNs to reduce computational cost.
problem High computational cost in GNNs for large graph sizes.
method Introduces Haar basis for graph convolution and Fast Haar Transforms.
result State-of-the-art results on graph-based regression and node classification tasks.
Proposes a method for coarse graph alignment using sparse partial least squares.
problem Aligning graphs with community structures when there's no natural one-to-one mapping.
method Sparse partial least squares method incorporating observed graph structures and imposing sparsity.
result Demonstrates effectiveness in simulations.
New algorithm reduces regret in combinatorial causal bandits without graph structure.
problem Minimizing regret in combinatorial causal bandits without graph structure.
method Design of algorithms for binary general causal models and BGLMs without graph skeleton.
result Achieves O ( T ln T ) O(\sqrt{T}\ln T) O ( T ln T ) expected regret for causal models and O ( T 2 3 ln T ) O(T^{\frac{2}{3}}\ln T) O ( T 3 2 ln T ) for BGLMs.