A new data-driven sampling method improves GraphSAGE's accuracy in node classification.
problem High variance in neighborhood sampling leads to sub-optimum accuracy in GraphSAGE.
method A data-driven node sampling approach using a non-linear regressor trained with reinforcement learning.
result Enhanced GraphSAGE accuracy in inductive node classification benchmarks.
Validates conformal prediction for network data under non-uniform sampling.
problem Validity of conformal prediction for network data under non-representative sampling.
method Interprets sampling mechanisms as selection rules, studies validity conditional on selection events, uses permutation invariance and joint exchangeability.
result Finite-sample validity of conformal prediction for certain selection events and asymptotic validity for random walk sampling.
New method speeds up GNNs to constant time.
problem Scaling GNNs to large graphs.
method Analyzing uniform node sampling for GNNs.
result Node sampling complexity is constant, independent of graph size.
This article explores and analyzes the unsupervised clustering of large partially observed graphs. We propose a scalable and provable randomized framework for clustering graphs generated from the stochastic block model. The clustering is first applied to a sub-matrix of the graph's adjacency matrix associated with a re…
Improves asynchronous federated learning with queuing dynamics.
problem Asynchronous federated learning with varying node computational speeds.
method Proposes a non-uniform sampling scheme for the central server.
result Significant improvement over current algorithms on image classification.
New method improves random parameter generation in neural networks.
problem Standard method of generating random weights and biases in neural networks has drawbacks.
method Proposes a new method to generate random parameters ensuring nonlinear sigmoids remain in the input hypercube and uniformly distributed slope angles for activation functions.
result Ensures the most useful nonlinear fragments of sigmoids remain in the input hypercube.
Majority bit estimation in noisy random recursive DAGs.
problem Estimating the majority bit in a noisy random recursive DAG.
method Majority rule among nodes, with bit flipping and noisy channel.
result Identification of the threshold for p at which majority rule yields errors. Implementing k-NN classification using Gromov--Wasserstein distances
problem Comparing metric measure spaces
method Gromov--Wasserstein and fused Gromov--Wasserstein distances
result Universal consistency of k-NN classifiers The goal of this paper is to describe a theoretical construction of an infinite collection of non-classical Schottky groups. We first show that there are infinitely many non-classical noded Schottky groups on the boundary of Schottky space, and we show that infinitely many of these are "sufficiently complicated". We th…
New classical algorithm outperforms quantum in neural network subnetwork selection.
problem Selecting sparse subnetworks from large neural networks efficiently.
method Quantum-inspired classical algorithm using ridgelet transform sampling.
result Runs in polynomial time, outperforming naive classical methods.
New uniformity tester ensures consistent results across different samples.
problem Non-replicable behavior of uniformity testing algorithms.
method Develops a replicable uniformity tester with improved sample complexity.
result Achieves nearly linear dependence on replicability factor ρ. Bayesian method infers network topology and dynamics from noisy, sparse measurements.
problem Learning network topology and dynamics from partial, noisy data.
method Developed method uses dynamical structure functions derived from linear stochastic differential equations.
result Method outperforms state-of-the-art methods in various network types.
A new method improves graph node embeddings by considering both nearby and distant node similarities.
problem Improving graph node embeddings by considering both nearby and distant node similarities.
method Distance-aware Negative Sampling (DNS) which maximizes cohesion at nearby node-pairs and separation at distant node-pairs.
result DNS outperforms baseline methods in downstream node classification tasks on various datasets and GRL algorithms.
AUASE embeds dynamic networks with stability guarantees for node comparison.
problem Stability in dynamic network embeddings for comparing nodes across time.
method Attributed unfolded adjacency spectral embedding (AUASE) for stable unsupervised learning.
result AUASE provides significant improvements in link prediction and node classification.
New algorithm achieves strong consistency in binary non-uniform hypergraph classification.
problem Node classification on binary non-uniform hypergraphs with varying edge probabilities.
method Proposes a refinement algorithm using power iteration on weighted adjacency matrices.
result Proves optimality of the refinement algorithm, achieving strong consistency and IT lower bound.
Improved uniform convergence bound with fat-shattering dimension reduces sample complexity gap.
problem Gap between upper and lower bounds on sample complexity for fat-shattering dimension.
method Provided an improved uniform convergence bound.
result Closed the gap between existing upper and lower bounds on sample complexity.
This paper improves spectral embedding for multipartite networks, revealing latent subspaces and providing consistent node representations.
problem Improving spectral embedding for multipartite networks to better represent node types.
method Developed a follow-on step to spectral embedding that recovers node representations in their intrinsic rather than ambient dimension, proving consistency under a specific model.
result Node representations in multipartite networks lie near type-specific subspaces, and the proposed method recovers these representations consistently.
SANS uses graph structure to find meaningful negatives for entity and relation embeddings.
problem Finding hard negatives for entity and relation embeddings in knowledge graphs.
method Structure Aware Negative Sampling (SANS) that selects negatives from a node's k-hop neighborhood.
result SANS finds semantically meaningful negatives and is competitive with state-of-the-art approaches.
New sampling methods improve node embedding efficiency.
problem Efficiency and scalability in node embedding methods.
method Sampling approaches to node embedding, modeling eigenvectors and feature vectors.
result Improved computational efficiency and scalability.
We consider the problem of reconstructing the graph underlying an Ising model from i.i.d. samples. Over the last fifteen years this problem has been of significant interest in the statistics, machine learning, and statistical physics communities, and much of the effort has been directed towards finding algorithms with …
Study bandwidth-limited training and inference of language models.
problem Training and inference of language models on scattered data with limited bandwidth.
method Analyzed two protocols: Federated Probe-Logit Distillation (FPLD) for training and Federated Conformal RAG (FC-RAG) for inference.
result Explicit high-probability KL-consistency rate and distribution-free marginal-coverage bound for Federated Conformal RAG.
A new model for graph sampling that preserves structure without explicit targeting.
problem Graphs are often not fully representative of true relationships, leading to biased machine learning models.
method Node copying model: randomly replaces each node's neighbors with those of a randomly sampled similar node.
result The model achieves higher accuracy in node classification and mitigates adversarial attacks.
This research improves graph embeddings by optimizing node sampling with centrality weights.
problem Improving the accuracy and efficiency of graph embeddings using Skip-Gram methods.
method Implemented and analyzed four graph embedding techniques with different centrality-weighted sampling distributions.
result Centrality-weighted sampling leads to improved accuracy and faster learning times.
LADIES improves GCN training efficiency and accuracy for large graphs.
problem Training large graph convolutional networks (GCNs) is computationally expensive.
method LADIES uses layer-dependent importance sampling to select nodes for training.
result LADIES outperforms previous methods in both time and memory efficiency.
Proposes a co-hub node model for multiview graph learning.
problem Identifying shared graphical structures in heterogeneous datasets.
method Enforces structured sparsity on co-hub nodes across multiple views.
result Demonstrates improved precision and interpretive insight in learning multiview graphs.
New algorithms sample convex bodies using Markov chains and restricted Gaussian oracles.
problem Sampling uniformly from convex bodies efficiently.
method Markov chain Monte Carlo with proximal sampler and restricted Gaussian oracle.
result Efficient implementation of RGO for uniform sampling on convex bodies.
We study the problem of identifying the source of a diffusion spreading over a regular tree. When the degree of each node is at least three, we show that it is possible to construct confidence sets for the diffusion source with size independent of the number of infected nodes. Our estimators are motivated by analogous …
Uniform sampling of modest size is a coreset for regularized loss minimization.
problem Designing efficient algorithms for large data with restricted access.
method Sampling-based algorithms for regularized loss minimization problems.
result Uniform sample of modest size is a coreset for certain regularized loss minimization problems.
Improves GCN by sampling neighbors and features for better node representation.
problem GCN's aggregation process treats all neighbors and features equally, leading to suboptimal node representations.
method Introduces a new convolution operation on feature maps constructed from a fixed node bandwidth, then passes to a standard GCN.
result Outperforms competing methods in semi-supervised node classification tasks.
No algorithm outperforms uniform sampling in A/B testing.
problem Identifying the best arm in A/B testing with fixed budget.
method Introducing consistent and stable algorithms, deriving lower bounds, and proving optimality of uniform sampling.
result No algorithm performs better than uniform sampling in A/B testing.
Study shows gap between uniform convergence and test error in random feature models.
problem Understanding the gap between uniform convergence and test error in random feature models.
method Analytical expressions for uniform convergence over norm balls, interpolators, and minimum norm interpolator risk derived and proved.
result Uniform convergence over interpolators still gives a non-trivial bound of test error even when classical uniform convergence is vacuous.
BLISS optimizes GNN training by adaptively sampling nodes.
problem High computational costs in training GNNs on large graphs.
method Uses Bandit Layer Importance Sampling to dynamically select nodes.
result Improves GNN performance with reduced computational cost.
New hypergraph neural network learns variable-sized hyperedges.
problem Learning representations for non-uniform hypergraphs with variable cardinalities.
method Developed a hypergraph neural network exploiting incidence structure.
result Significant improvement in accuracy on real-world hypergraph datasets.
A graph-based method for two-sample testing across connected nodes.
problem Identifying nodes where two probability distributions differ significantly.
method Collaborative non-parametric two-sample testing (CTST) framework.
result CTST outperforms independent node tests by leveraging graph structure.
New loss function equivalence reveals PER's uniform sampling can be improved.
problem Improving Prioritized Experience Replay (PER) for better learning efficiency.
method Transforming non-uniformly sampled data loss functions into uniformly sampled ones.
result Some environments can replace PER with a new loss function without performance loss.
FSD-CAP improves graph feature imputation under high missing rates.
problem Challenges in imputing missing node features in graphs, especially under high missing rates.
method Two-stage framework: subgraph expansion, fractional diffusion, class-aware propagation.
result Significantly improved imputation quality compared to existing methods, achieving high accuracy on benchmark datasets.
Random sampling has become a critical tool in solving massive matrix problems. For linear regression, a small, manageable set of data rows can be randomly selected to approximate a tall, skinny data matrix, improving processing time significantly. For theoretical performance guarantees, each row must be sampled with pr…
The paper tests properties of multiple distributions with limited samples.
problem Testing properties of multiple distributions with few samples.
method Designing testers for uniformity, identity, and closeness testing under specific conditions.
result Sample optimal testers for uniformity, identity, and closeness testing are provided.
Efficient algorithm removes redundant nodes and obsolete samples in machine learning.
problem Pruning redundant nodes and removing obsolete training samples in machine learning.
method Deduced decremented learning algorithms from incremental learning algorithms, using inverse Cholesterol factor and unitary transformation.
result Proposed decremented learning algorithms efficiently prune redundant nodes and remove obsolete training samples.
The paper tackles uniform sampling from neural networks efficiently.
problem Uniform sampling from neural network labelings given a sample.
method Polynomial-time algorithm for general neural networks, random walk for single neuron.
result Uniform sampling with high probability for general neural networks, exact uniform sampling for single neuron.
We consider the problem of estimating community memberships of nodes in a network, where every node is associated with a vector determining its degree of membership in each community. Existing provably consistent algorithms often require strong assumptions about the population, are computationally expensive, and only p…
New algorithms achieve uniform-PAC guarantees for RL with bounded eluder dimension.
problem Achieving strong performance guarantees in reinforcement learning.
method Proposes algorithms for nonlinear bandits and model-based episodic RL with a bounded eluder dimension.
result Achieves uniform-PAC sample complexity that matches state-of-the-art regret bounds or sample complexity guarantees.
Graph semi-supervised learning classifies points on manifold using variational autoencoders and GNN.
problem Classifying points on low-dimensional manifolds using limited labeled data.
method Model data as points on a manifold, approximate manifold with VAE, construct geometric graph, solve semi-supervised node classification with GNN.
result Generalization gap diminishes with graph size and training procedure, vanishing asymptotically.
We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…
GraphVite efficiently trains node embeddings for large networks.
problem Scaling node embedding algorithms to handle large networks (tens of millions of nodes).
method CPU-GPU hybrid system with parallel edge sampling and negative sampling.
result GraphVite achieves high performance (50x faster) for large networks.
We study recursive-cube-of-rings (RCR), a class of scalable graphs that can potentially provide rich inter-connection network topology for the emerging distributed and parallel computing infrastructure. Through rigorous proof and validating examples, we have corrected previous misunderstandings on the topological prope…
Improved sampling accuracy in SG-MCMC methods via non-uniform gradient subsampling.
problem Computational inefficiency and sampling error in stochastic gradient MCMC methods.
method Proposes a non-uniform subsampling scheme to reduce sampling error in EWSG, a variant of SG-MCMC.
result EWSG reduces sampling error compared to uniform subsampling, improving accuracy without sacrificing convergence speed.
The paper tackles uniform sampling from databases with duplicates.
problem Sampling uniformly from entities with duplicate records.
method Two-stage process: frequency estimation followed by rejection sampling.
result Efficient sampling algorithms under various data properties.