Graph DNA uses Bloom filters to efficiently encode deep graph neighborhoods for better collaborative filtering.
problem Collaborative filtering struggles with exploiting deeper graph neighborhoods due to high time and space complexity.
method Graph DNA employs Bloom filters to compute approximate deep neighborhood information in linear time, enabling efficient encoding and utilization in collaborative filtering.
result Graph DNA significantly improves collaborative filtering performance with minimal computational and memory overhead.
Proposes NRS to find flat minima in deep neural networks.
problem Finding optimal solutions in deep neural networks with overparameterization.
method NRS leverages the concept of flat minima and uses Kullback-Leibler divergence to regularize the neighborhood region in weight space.
result NRS drives optimizers towards flat minima, improving generalization ability across various model architectures.
NCP improves deep classifier uncertainty quantification efficiency.
problem Uncertainty quantification for deep classifiers in high-stake applications.
method Neighborhood Conformal Prediction (NCP) algorithm.
result NCP produces smaller prediction sets than traditional CP methods.
Proposes a new regularization method for deep learning models.
problem Lack of leverage from neighboring sample relationships in existing regularization techniques.
method Patch-level Neighborhood Interpolation (Pani) that constructs patch-level graphs and linearly interpolates neighborhood patch features.
result Demonstrates effectiveness of Pani in both supervised and semi-supervised settings.
Motivated by an abstract notion of low-level edge detector filters, we propose a simple method of unsupervised feature construction based on pairwise statistics of features. In the first step, we construct neighborhoods of features by regrouping features that correlate. Then we use these subsets as filters to produce n…
EHNA learns node embeddings from historical network neighborhoods.
problem Capturing temporal information in evolving networks.
method Temporal random walk and deep learning model with attention mechanism.
result EHNA outperforms existing methods in network reconstruction and link prediction tasks.
A simple geometrical proof shows that any target function can be found in a random network's neighborhood.
problem Finding any target function in a random network's neighborhood.
method Geometrical proof using a simple model of a high-dimensional sphere projected onto a low-dimensional subspace.
result High-dimensional geometry ensures that a uniform distribution over a sphere reduces to a Gaussian distribution with negligible covariances, enabling the presence of any target function in a random network's neighborhood.
Recent deep learning approaches for representation learning on graphs follow a neighborhood aggregation procedure. We analyze some important properties of these models, and propose a strategy to overcome those. In particular, the range of "neighboring" nodes that a node's representation draws from strongly depends on t…
A novel feature representation method for non-image based features.
problem Inability of Convolutional Neural Networks for non-image based features or features without spatial correlations.
method REFINED: Representation of Features as Images with Neighborhood Dependencies.
result Higher prediction accuracy compared to existing methodologies.
In this paper, we build an organization of high-dimensional datasets that cannot be cleanly embedded into a low-dimensional representation due to missing entries and a subset of the features being irrelevant to modeling functions of interest. Our algorithm begins by defining coarse neighborhoods of the points and defin…
Paper optimizes GEMM for deep learning models, improving performance.
problem Limited GEMM optimization in deep learning frameworks restricts performance on different hardware.
method Proposes two novel algorithms: Greedy Best First Search (G-BFS) and Neighborhood Actor Advantage Critic (N-A2C) based on TVM framework.
result Significant performance improvements in GEMM computation time, achieving up to 40% savings.
PGRec improves recommendation by modeling user-item preferences as a graph and embedding it for better predictions.
problem Sparse user-item data in recommender systems.
method PGRec models user-item preferences as a PrefGraph, then uses deep learning and factorization to embed and predict user preferences.
result PGRec outperforms state-of-the-art methods by up to 3.2% in NDCG@10.
Improved RL for knowledge graph reasoning with entity types.
problem Challenges in path-based relational reasoning over knowledge graphs.
method Type-enhanced RL agent using GNN for neighborhood information.
result Outperforms state-of-the-art RL methods and discovers novel paths.
Unified analysis of self-training for deep networks on unlabeled data.
problem Theoretical understanding of self-training for deep networks on unlabeled data.
method Unified theoretical analysis using expansion assumption and input-consistency regularization.
result Proves high accuracy of minimizers of population objectives based on self-training and input-consistency regularization.
Meta-Neighborhoods adapts predictions based on input neighborhoods.
problem Adaptive prediction based on input neighborhoods for AI.
method Semi-parametric method with induced neighborhoods and meta-learning.
result Meta-Neighborhoods more accurately represents predictive distributions.
The past decade has witnessed a successful application of deep learning to solving many challenging problems in machine learning and artificial intelligence. However, the loss functions of deep neural networks (especially nonlinear networks) are still far from being well understood from a theoretical aspect. In this pa…
We derive spectral sequences for the intersection homology of stratified fibrations and approximate tubular neighborhoods in manifold stratified spaces. These neighborhoods include regular neighborhoods in PL stratified spaces.
NNK algorithm improves neighborhood and graph construction for machine learning.
problem Ad hoc selection of k and ε parameters in kNN and ε-neighborhood methods.
method NNK algorithm for better sparse signal approximation.
result NNK leads to superior performance in local neighborhood and graph-based machine learning tasks.
GAP learns node representations by attending to different parts of its neighborhood.
problem Context-free learning of node representations in graph representation learning.
method Graph Neighborhood Attentive Pooling (GAP) using attentive pooling networks.
result GAP outperforms 10 state-of-the-art methods on link prediction and clustering tasks.
DELIMIT is a framework extension for deep learning in diffusion imaging, which extends the basic framework PyTorch towards spherical signals. Based on several novel layers, deep learning can be applied to spherical diffusion imaging data in a very convenient way. First, two spherical harmonic interpolation layers are a…
A neural architecture learns and refines graph correspondences.
problem Learning structural correspondences between graphs.
method Two-stage neural architecture: node embeddings followed by message passing networks.
result Message passing scheme computes well-founded consensus for corresponding neighborhoods.
New metaheuristic combines SGD and SA for hyper-parameter tuning.
problem Hyper-parameter tuning for deep neural networks.
method Simulated Annealing applied to discrete optimization of SGD.
result Improves final validation accuracy for ResNet34 and VGG16.
Deep structured models are widely used for tasks like semantic segmentation, where explicit correlations between variables provide important prior information which generally helps to reduce the data needs of deep nets. However, current deep structured models are restricted by oftentimes very local neighborhood structu…
New view: Deep GCNs learn to anti-oversmooth during training.
problem Performance drop in deep GCNs due to oversmoothing.
method Interpreted GCN as MLP + graph regularization, analyzed training process.
result Deep GCNs learn to anti-oversmooth during training, not over-smooth.
In this paper, we consider a general stochastic optimization problem which is often at the core of supervised learning, such as deep learning and linear classification. We consider a standard stochastic gradient descent (SGD) method with a fixed, large step size and propose a novel assumption on the objective function,…
Urban2Vec combines street view imagery and POIs for better urban neighborhood embeddings.
problem Lack of comprehensive representation of urban neighborhoods using heterogeneous data.
method Unsupervised multi-modal framework using CNN for visual features and bag-of-words for POI data.
result Urban2Vec achieves better performance than baseline models and comparable to fully-supervised methods.
Study geodesics entering a fixed cusp neighborhood multiple times.
problem Understanding geodesics entering a specific cusp neighborhood multiple times.
method Investigate reciprocal geodesics entering a fixed cusp neighborhood a fixed number of times.
result Characterized the class of reciprocal geodesics entering a fixed cusp neighborhood a fixed number of times.
Neural LNS improves vehicle routing performance.
problem Optimizing vehicle routes with constraints.
method Integrates deep learning with large neighborhood search.
result Significantly outperforms existing methods on CVRP.
Improved anti-cancer drug sensitivity prediction using REFINED CNN ensemble learning.
problem Challenges in predicting anti-cancer drug sensitivity for individual cell lines.
method Using REFINED CNN, which represents high-dimensional vectors as compact 2D images with spatial correlations, and building ensembles of these models.
result Ensemble approaches significantly improve drug sensitivity prediction performance compared to single models.
Skeleta and other pure subsets of manifold stratified spaces are shown to have neighborhoods which are teardrops of stratified approximate fibrations (under dimension and compactness assumptions). In general, the stratified approximate fibrations cannot be replaced by bundles, and the teardrops cannot be replaced by ma…
LEC prevents deep nets from memorizing noisy examples.
problem Deep nets overfit to noisy data.
method LEC removes noisy examples based on an ensemble of perturbed networks.
result LTEC outperforms state-of-the-art on noisy MNIST, CIFAR-10, and CIFAR-100.
New framework distinguishes knots via neighborhood invariants.
problem Distinguishing knots and knotoids.
method Study of knotoid spectra and neighborhood invariants.
result Neighborhood invariants can distinguish knots of higher Gordian distance.
This paper tackles selection bias in recommender systems by considering the neighborhood effect.
problem Selection bias in recommender systems due to filtering and user selection.
method Formalizes neighborhood effect as interference problem, introduces treatment representation, and proposes ideal loss.
result Proposed methods achieve unbiased learning when both selection bias and neighborhood effect are present.
Maximally hyperbolic solutions contain future neighborhoods of intersecting hypersurfaces.
problem Maximally globally hyperbolic solutions of higher-dimensional vacuum Einstein equations.
method Analyzing intersections of characteristic hypersurfaces.
result Contains a future neighborhood of intersecting hypersurfaces.
Many prediction problems can be phrased as inferences over local neighborhoods of graphs. The graph represents the interaction between entities, and the neighborhood of each entity contains information that allows the inferences or predictions. We present an approach for applying machine learning directly to such graph…
Proposes a new NMF method incorporating neighborhood structure for better anomaly detection.
problem NMF's inability to incorporate neighborhood structure information limits its performance in nonlinear manifold structures.
method Integrates neighborhood structure information using Minimum Spanning Tree (MST) within NMF framework.
result Empirical results show superior performance in anomaly detection using the proposed method.
Study on transverse knots and their neighborhoods, proving unique standard neighborhoods and destabilization results.
problem Understanding the structure and properties of transverse knots and their neighborhoods.
method Proves unique standard neighborhoods and structure theorems for non-loose Legendrian knots through destabilization results.
result Finds a manifold with infinite tight contact structures, up to contactomorphism, without Giroux torsion.
Revises GNN neighborhood aggregation for more accurate node classification.
problem Flaws in benchmark GNN models for node classification.
method Statistical signal processing approach to neighborhood aggregation.
result Novel insights for designing more efficient GNN models.
The study proves a neighborhood theorem for mean curvature flow in higher dimensions.
problem Proving a canonical neighborhood theorem for mean curvature flow in higher dimensions.
method Proved a canonical neighborhood theorem for mean curvature flow of compact submanifolds in RN with a pinching condition. result Proved a canonical neighborhood theorem for mean curvature flow in dimensions n≥5. A neighborhood homotopy is an equivalence relation on spatial graphs which is generated by crossing changes on the same component and neighborhood equivalence. We give a complete classification of all 2-component spatial graphs up to neighborhood homotopy by the elementary divisor of a linking matrix with respect to th…
GraphAIR improves graph representation learning by capturing non-linear interactions.
problem Challenges in capturing non-linear interactions in graph data.
method Integrates neighborhood aggregation and interaction modeling.
result Demonstrates improved performance on node classification and link prediction tasks.
NEAR improves graph classification by aggregating edge information.
problem Loss of local structure and relationships in 1-hop neighborhood GNNs.
method Proposes NEAR, a framework that aggregates edge information between nodes in the neighborhood.
result NEAR improves graph classification tasks over existing 1-hop based GNN algorithms.
Neighborhood sampling affects graph neural network training outcomes.
problem Understanding the impact of neighborhood sampling on graph neural network training.
method Theoretical analysis using neural tangent kernels and Gaussian processes.
result Posterior covariance differs for different neighborhood sampling approaches, indicating no dominant approach.
We present novel graph kernels for graphs with node and edge labels that have ordered neighborhoods, i.e. when neighbor nodes follow an order. Graphs with ordered neighborhoods are a natural data representation for evolving graphs where edges are created over time, which induces an order. Combining convolutional subgra…
We present a new construction of tubular neighborhoods in (possibly infinite dimensional) Riemannian manifolds M, which allows us to show that if G is an arbitrary group acting isometrically on M, then every G-invariant submanifold with locally trivial normal bundle has a G-invariant total tubular neighborhood. We appl…
Proposes a parametric t-SNE without perplexity tuning.
problem Non-parametric t-SNE's perplexity parameter limits DR quality.
method Multi-scale parametric t-SNE with deep neural network.
result Produces reliable embeddings with competitive neighborhood preservation.
The paper uses MRFs to improve recommendation accuracy in collaborative filtering.
problem Improving recommendation accuracy in collaborative filtering.
method Modeling dependencies via Gaussian Markov Random Fields (MRFs) with auto-normal parameterization and pseudo-likelihood.
result The proposed approach achieved competitive ranking-accuracy and a 20% gain in accuracy on the largest data-set.
This article is one of three highly influential articles on the topology of manifolds written by Robert D. Edwards in the 1970's but never published. Organizers of the Workshops in Geometric Topology (http://www.uwm.edu/~craigg/workshopgtt.htm) with the support of the National Science Foundation have facilitated the pr…