Privacy attacks reveal hidden information in network embeddings after node removal.
problem Privacy concerns in network embeddings after node deletion.
method Analyzed network embeddings and developed an attack to recover removed node information.
result Significant information about removed node's neighbors can be retrieved from remaining embeddings.
An important problem in networked systems is detection and removal of suspected malicious nodes. A crucial consideration in such settings is the uncertainty endemic in detection, coupled with considerations of network connectivity, which impose indirect costs from mistakely removing benign nodes as well as failing to r…
Semi-supervised model removes noisy content from webpages.
problem Extracting relevant content from webpages with ads and noise.
method Graph representation of webpage, semi-supervised learning with Gaussian Random Fields.
result Preliminary results show successful extraction of relevant content.
Proposes a method to improve graph embedding by removing least frequent nodes.
problem Capturing global graph structure in random walk-based embeddings.
method Extends random walk-based graph embedding by removing least frequent nodes.
result Improves predictive performance slightly, if at all.
Efficient algorithm removes redundant nodes and obsolete samples in machine learning.
problem Pruning redundant nodes and removing obsolete training samples in machine learning.
method Deduced decremented learning algorithms from incremental learning algorithms, using inverse Cholesterol factor and unitary transformation.
result Proposed decremented learning algorithms efficiently prune redundant nodes and remove obsolete training samples.
DaRE forests enable efficient data deletion from random forests.
problem Efficiently removing data from machine learning models.
method Random Forests with data deletion enabled (DaRE).
result Data deletion from DaRE models is orders of magnitude faster than retraining.
We present a deep neural-network model for lifelong learning inspired by several forms of neuroplasticity. The neural network develops continuously in response to signals from the environment. In the beginning, the network is a blank slate with no nodes at all. It develops according to four rules: (i) expansion, which …
Proposes DeGLIF to denoise graph data for label noise robustness.
problem Label noise in graph data makes node classification challenging.
method Uses leave-one-out influence function to denoise graph data.
result DeGLIF improves accuracy in node classification on noisy datasets.
IFH models graph generation with adjustable sequentiality.
problem Designing flexible graph generation models between one-shot and sequential approaches.
method Based on DDPM, IFH uses a node removal process to generate graphs with adjustable sequentiality.
result IFH models improve graph generation quality and efficiency compared to current methods.
A recently proposed clustering method, called the Nearest Descent (ND), can organize the whole dataset into a sparsely connected graph, called the In-tree. This ND-based Intree structure proves able to reveal the clustering structure underlying the dataset, except one imperfect place, that is, there are some undesired …
EHNA learns node embeddings from historical network neighborhoods.
problem Capturing temporal information in evolving networks.
method Temporal random walk and deep learning model with attention mechanism.
result EHNA outperforms existing methods in network reconstruction and link prediction tasks.
New maxfaces with catenoid or planar ends constructed using node-opening technique.
problem Lack of examples of maxfaces with catenoid or planar ends.
method Adapted node-opening technique to construct maxfaces of high genus.
result Singularities on constructed maxfaces form curves around the waists of the necks, with most singularities being cuspidal edges and the rest swallowtails.
Are Graph Neural Networks (GNNs) fair? In many real world graphs, the formation of edges is related to certain node attributes (e.g. gender, community, reputation). In this case, standard GNNs using these edges will be biased by this information, as it is encoded in the structure of the adjacency matrix itself. In this…
Two new inverse-free ELM algorithms for incremental and decremental learning are proposed.
problem Efficiently updating and removing multiple hidden nodes in ELM.
method Improved inverse-free recursive algorithms for Tikhonov regularization.
result Inverse-free algorithms for ELM with multiple hidden nodes and redundant nodes.
In graph neural networks (GNNs), pooling operators compute local summaries of input graphs to capture their global properties, and they are fundamental for building deep GNNs that learn hierarchical representations. In this work, we propose the Node Decimation Pooling (NDP), a pooling operator for GNNs that generates c…
Enhances GNNs by improving input data quality from topology and labels.
problem Poor quality of graph data limits GNN performance.
method Improves graph data quality using model outputs for better semi-supervised node classification.
result SEG consistently improves GNN performance across various datasets.
Augments graph node features to improve GNN performance.
problem Improving graph neural networks' performance on large-scale datasets.
method Iteratively augments node features with gradient-based adversarial perturbations.
result Boosts model performance in node classification, link prediction, and graph classification tasks.
Graph representation learning, aiming to learn low-dimensional representations which capture the geometric dependencies between nodes in the original graph, has gained increasing popularity in a variety of graph analysis tasks, including node classification and link prediction. Existing representation learning methods …
Unsupervised node embedding methods (e.g., DeepWalk, LINE, and node2vec) have attracted growing interests given their simplicity and effectiveness. However, although these methods have been proved effective in a variety of applications, none of the existing work has analyzed the robustness of them. This could be very r…
APGE protects graph node representations from inference attacks.
problem Privacy leakage in graph embedding methods.
method Adversarial training framework with disentangling and purging mechanisms.
result APGE preserves structural and utility attributes while concealing private information.
This work shows dimension regularization can replace skip-gram negative sampling for graph embeddings, improving efficiency and performance.
problem Efficiently enforcing dissimilarity among node embeddings in graph learning.
method Dimension regularization as an alternative to skip-gram negative sampling.
result Dimension regularization is a more efficient approach to enforcing dissimilarity in graph embeddings.
This study assesses how economic shocks affect the efficiency and robustness of international pesticide trade networks.
problem Economic shocks impact the efficiency and robustness of international pesticide trade networks.
method Simulations were used to quantify efficiency and robustness under different economic shocks. Three strategies were tested: descending, random, and ascending node removal.
result The international pesticide trade networks became more efficient and robust except for clustering coefficient. Import-oriented economies were more vulnerable to shocks.
SGATs learn sparse attention coefficients to improve graph learning tasks on large, noisy graphs.
problem Overfitting and noisy edges in GNNs on large, noisy graphs.
method Sparse Graph Attention Networks (SGATs) learn sparse attention coefficients under L0-norm regularization. result SGATs can remove 50%-80% edges from large graphs while maintaining similar classification accuracies.
New algorithm reduces high-probability regret for time-varying feedback graphs.
problem High-probability regret bounds for adversarial bandits with time-varying feedback graphs.
method Online mirror descent framework with innovative techniques for pessimistic loss estimators.
result Achieves optimal high-probability regret bound for general and weakly observable graphs.
New algorithm updates eigenvectors of evolving graphs efficiently.
problem Updating eigenvectors of dynamic graphs.
method Subspace projection based on Rayleigh-Ritz projections.
result Strong performance in eigenvector approximation and downstream tasks.
In this study we consider relations between companies in Poland taking into account common branches they belong to. It is clear that companies belonging to the same branch compete for similar customers, so the market induces correlations between them. On the other hand two branches can be related by companies acting in…
Paper tackles over-smoothing in deep GCNs, proposing DropEdge to improve performance.
problem Over-smoothing reduces expressivity in deep GCNs, especially affecting node classification.
method Theoretical analysis of GCN behavior with depth, proposing DropEdge to alleviate over-smoothing.
result DropEdge improves performance on various GCNs, shallow and deep.
New measure EC assesses node contributions in nonlinear, time-varying systems.
problem Existing node contribution measures assume linear, time-invariant dynamics, failing for complex, real-world systems.
method Defined 'emergent contribution (EC)' as a dynamical leverage measure from Jacobians of differentiable models.
result EC diverges from average controllability under persistent regime switching and sign reversal, identifying limits of local linearization.
Gaussian Graphical Models (GGMs) or Gauss Markov random fields are widely used in many applications, and the trade-off between the modeling capacity and the efficiency of learning and inference has been an important research problem. In this paper, we study the family of GGMs with small feedback vertex sets (FVSs), whe…
In this paper, we propose a simple, versatile model for learning the structure and parameters of multivariate distributions from a data set. Learning a Markov network from a given data set is not a simple problem, because Markov networks rigorously represent Markov properties, and this rigor imposes complex constraints…
While loopy belief propagation (LBP) performs reasonably well for inference in some Gaussian graphical models with cycles, its performance is unsatisfactory for many others. In particular for some models LBP does not converge, and in general when it does converge, the computed variances are incorrect (except for cycle-…
New method estimates graph compatibility from sparse labels.
problem Estimating graph compatibility from sparse labeled data.
method Factorized graph representations and algebraic amplification.
result End-to-end classification accuracy comparable to gold standard.
Corrected graph convolutions improve node classification on graphs.
problem Oversmoothing in graph convolutions degrades performance.
method Theoretical analysis based on CSBM, spectral analysis for k rounds of corrected graph convolutions.
result Corrected graph convolutions can improve node classification performance exponentially.
Push-SAGA is a decentralized algorithm for directed graphs that converges linearly.
problem Finite-sum minimization over directed graphs with stochastic gradients.
method Combines variance reduction, gradient tracking, and consensus algorithms.
result Achieves linear convergence for smooth and strongly convex problems.
Improved neural network convergence with causal Bayesian modeling in retail performance.
problem Improving neural network convergence in retail performance models.
method Causal Bayesian neural network implementation, removal of weakest SEM path, Flipout layers, Vadam optimizer.
result Neural network convergence improved with removal of the weakest SEM path.
Proposes a new model for clustering multiplex networks with compositional data.
problem Clustering multiplex networks with multiple types of relations and compositional data.
method Multiplex Dirichlet stochastic block model for compositional networks.
result Validated through simulation and applied to international export data.
Causalfe estimates treatment effects in panel data with fixed effects.
problem Spurious heterogeneity in treatment effect estimates due to fixed effects in panel data.
method CFFE approach with node-level residualization during tree construction.
result Validates the estimator's performance through simulation studies.
Proposes a method to improve GNN predictions by finding the most predictive subgraph.
problem GNNs aggregate all nodes and edges, making predictions hard to interpret.
method Uses reinforcement learning to find a sparse subgraph that optimizes graph classification performance.
result Our method finds sparser subgraphs that improve interpretability while maintaining performance.
AB-SAGA optimizes distributed optimization over directed graphs using variance reduction and stochastic weights.
problem Optimizing distributed stochastic optimization over directed graphs with stochastic weights.
method AB-SAGA combines variance reduction and network-level gradient tracking, using both row and column stochastic weights.
result AB-SAGA converges linearly to the global optimal with a constant step-size and achieves a linear speed-up over centralized methods.
Link prediction requires predicting which new links are likely to appear in a graph. Being able to predict unseen links with good accuracy has important applications in several domains such as social media, security, transportation, and recommendation systems. A common approach is to use features based on the common ne…
RicciNets prunes neural networks by removing edges of low importance based on Ricci curvature, reducing FLOPs by 35%.
problem Pruning neural networks to reduce computational load and improve efficiency.
method RicciNets uses Ricci curvature to prune edges of low importance in a randomly wired neural network, reducing FLOPs.
result Reduction of almost 35% in FLOPs with no performance degradation.
\emph{Over-fitting} and \emph{over-smoothing} are two main obstacles of developing deep Graph Convolutional Networks (GCNs) for node classification. In particular, over-fitting weakens the generalization ability on small dataset, while over-smoothing impedes model training by isolating output representations from the i…
Study disrupts Sicilian Mafia networks using data analysis.
problem Challenges in disrupting resilient criminal networks.
method Social Network Analysis methods applied to real-world datasets.
result Neutralizing only 5% of affiliates can disrupt network connectivity by 70%.
Study allows removing data from machine learning models with strong guarantees.
problem Certifying removal of training data from machine learning models.
method Defined and developed a certified-removal mechanism for linear classifiers.
result Demonstrated that certified removal is possible and practical in certain learning settings.
Modeling financial contagion through bank networks, revealing solvency correlations.
problem Understanding how financial shocks propagate through interconnected banks.
method Simulated financial network of 100 banks, randomly generated with varying link probabilities, and shocks applied to 15 banks.
result Ranges of probability values and banks' solvency are positively correlated.
Bayesian inference for inverse problems using mean-shift interacting particles
problem Bayesian inference for inverse problems
method Amortized mean-shift interacting particles
result Improves accuracy of Bayesian inference by reducing the number of samples needed
LFGCN uses Levy Flights for graph semi-supervised learning.
problem Semi-supervised learning on graphs with improved performance.
method Lévy Flights into random walks, preferential P-DropEdge method.
result Significant improvement in classification performance, especially for heterogeneous graphs.
Spectral clustering is a fast and popular algorithm for finding clusters in networks. Recently, Chaudhuri et al. (2012) and Amini et al.(2012) proposed inspired variations on the algorithm that artificially inflate the node degrees for improved statistical performance. The current paper extends the previous statistical…