Talks about new methods in differential geometry.
problem None explicitly stated in the abstract.
method Stresses the neighbor relation as a basic notion.
result Not explicitly stated in the abstract.
Deep learning method for brain CT scan anomaly labeling using nearest neighbors.
problem Automated anatomical labeling of brain CT scan anomalies.
method Combines local and global context, uses Relation Networks (RNs) for prediction, and employs nearest neighbors for training.
result Improved performance of Relation Networks (RNs) through nearest neighbors training strategy.
Proposes MR-SNE for multimodal data visualization.
problem Visualizing data from multiple domains with relations across them.
method Extends t-SNE to compute augmented relations and jointly embed them in a low-dimensional space.
result Demonstrates promising performance in visualizing Flickr and Animal with Attributes 2 datasets.
K-Nearest neighbor classifier (k-NNC) is simple to use and has little design time like finding k values in k-nearest neighbor classifier, hence these are suitable to work with dynamically varying data-sets. There exists some fundamental improvements over the basic k-NNC, like weighted k-nearest neighbors classifier (wh…
Unsupervised matching method for relational data without alignment info.
problem Matching objects in different relational datasets without correspondence info.
method Model latent vectors, estimate by likelihood, project onto shared space.
result Preserves structural information in latent vectors across datasets.
In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It is based on fitting K-nearest neighbor regression to the unsupervised regressio…
The paper explains how nearest neighbor methods succeed in prediction.
problem Explaining the success of nearest neighbor methods in prediction.
method The paper covers both theoretical and practical aspects of nearest neighbor methods, including statistical guarantees and practical algorithms.
result The paper provides nonasymptotic statistical guarantees and practical algorithms for nearest neighbor methods.
LAGCN improves GCN performance by identifying and using valuable neighbors.
problem Existing GCN models do not identify valuable neighbors, potentially harming performance.
method LAGCN introduces a label-aware edge classifier to refine the graph and enhance learning performance.
result LAGCN significantly improves node classification performance on benchmark datasets.
Multi-Output Dependence (MOD) learning is a generalization of standard classification problems that allows for multiple outputs that are dependent on each other. A primary issue that arises in the context of MOD learning is that for any given input pattern there can be multiple correct output patterns. This changes the…
Enhances nearest neighbor classifier performance with local distance metric learning.
problem Inconsistent data distribution across feature space.
method Local Mahalanobis Distance Learning (LMDL) considers neighborhood influence and learns multiple distance metrics for prototypes.
result LMDL improves nearest neighbor classifier performance on various datasets.
Sharp bounds on diameter and eigenvalues for amply regular graphs.
problem Finding bounds for amply regular graphs' diameter and eigenvalues.
method New ideas relating discrete Ricci curvature to local matching properties, including a novel construction of a regular bipartite graph.
result Sharp diameter and eigenvalue bounds for amply regular graphs.
New topological methods for hypergraph data improve community detection and pattern recognition.
problem Community detection and pattern recognition in hypergraph data.
method Introducing a new topological space structure of hypergraph data, proposing modified nearest neighbors methods.
result Improved methods for community detection and pattern recognition in hypergraph data.
Method reconstructs missing wind farm data using graph theory and nearest neighbors.
problem Missing data in wind farm records due to sensor failures.
method Combines spectral graph theory and k-Nearest Neighbors to estimate missing data.
result Significant improvement in data reconstruction over existing methods.
The paper proposes a method to determine the geometric priors of relational data.
problem Identifying geometric structure in heterogeneous, high-dimensional data.
method Combinatorial approach analyzing nearest-neighbor structures and local neighborhood growth rates.
result The method can identify the geometric priors of suitable embedding spaces for relational data.
Proposes a model to understand urban dynamics from mega-metropolises.
problem Understanding residents mobility patterns in mega-metropolises.
method Neighbor-Regularized and context-aware Non-negative Tensor Factorization (NR-cNTF).
result NR-cNTF accurately captures city rhythms and spatial communities.
In this paper, we explore the relationship between one of the most elementary and important properties of graphs, the presence and relative frequency of triangles, and a combinatorial notion of Ricci curvature. We employ a definition of generalized Ricci curvature proposed by Ollivier in a general framework of Markov p…
LNPE enhances local connections in embeddings using extended neighbor propagation.
problem Improving local connections and interactions in nonlinear dimensionality reduction.
method Inspired by GCN, LNPE extends 1-hop neighbors to n-hop neighbors in LLE.
result LNPE produces more faithful and robust embeddings with better topological and geometrical properties.
Paper develops malware detection methods using Hamming distance.
problem Detecting and preventing spread of Android malware.
method Four detection methods using Hamming distance for similarity.
result Accuracy rates of proposed algorithms are more than 90%.
We construct a partial order relation which acts on the set of 3-cliques of a maximal planar graph G and defines a unique hierarchy. We demonstrate that G is the union of a set of special subgraphs, named `bubbles', that are themselves maximal planar graphs. The graph G is retrieved by connecting these bubbles in a tre…
NN methods perform well in anomaly detection, especially in high dimensions.
problem Improving anomaly detection methods for high-dimensional data.
method Extensive simulations and theoretical analysis of NN methods for anomaly detection.
result NN methods outperform other state-of-the-art algorithms in anomaly detection.
New entropy estimator outperforms state-of-the-art methods.
problem Estimation of entropy and mutual information in data science.
method Combines geometric and kernel approaches with local bandwidth choices.
result Asymptotic bias of the estimator is universal and pre-computable.
The method of random projections has become a standard tool for machine learning, data mining, and search with massive data at Web scale. The effective use of random projections requires efficient coding schemes for quantizing (real-valued) projected data into integers. In this paper, we focus on a simple 2-bit coding …
Heterophily affects GNN robustness; separating ego- and neighbor-embeddings improves defense.
problem The robustness of GNNs to adversarial attacks.
method Formalized relation between heterophily and GNN robustness; empirical analysis; design principles for improved robustness.
result Separating ego- and neighbor-embeddings increases GNN robustness.
Study nearest-neighbor radii under dependent sampling, finding they remain informative.
problem Analyzing nearest-neighbor radii under dependent sampling.
method Consider strong mixing dependent observations, establish distribution-free almost sure convergence and sharp non-asymptotic moment bounds.
result Nearest-neighbor geometry remains informative under dependence sampling.
Deep nearest neighbors outperform self-supervised methods in anomaly detection.
problem Anomaly detection using self-supervised deep methods.
method Simple nearest-neighbor approach on Imagenet pretrained features.
result Nearest-neighbor method outperforms self-supervised methods in accuracy, few shot generalization, training time, and noise robustness.
Characterizes Lebesgue points using nearest neighbor methods.
problem Consistency of classification algorithms based on nearest neighbors.
method Characterization of Lebesgue points via 1-Nearest Neighbor regression.
result Proves convergence of 1-Nearest Neighbor classification algorithms in metric spaces.
A new method estimates optimal treatment regimes using causal nearest neighbors.
problem Estimating optimal treatment regimes in precision medicine.
method Causal k-nearest neighbor method, with adaptive metric and variable selection.
result The causal k-nearest neighbor regime is universally consistent and converges as sample size increases.
AWNN improves matrix completion by adaptively weighting nearest neighbors.
problem Matrix completion with optimal nearest neighbor weights and radii selection.
method Adaptively weighted nearest neighbor method for matrix completion.
result Theoretical guarantees and synthetic experiments support the effectiveness of AWNN.
A new method uses nearest neighbors for importance weighting.
problem Data covariate shift problems in machine learning.
method Nearest neighbor classification scheme for determining importance weights.
result Demonstrated effectiveness through comparative experiments on various classification tasks.
Neighbor-encoder learns representations by reconstructing neighbors, outperforming autoencoders.
problem Learning effective representations for various data types.
method Reconstructs neighbors instead of inputs, incorporating domain knowledge through similarity definitions.
result Neighbor-encoder outperforms autoencoders in diverse domains and tasks.
ForestDSH hashes improve nearest neighbor search in high-dimensional data.
problem High-dimensional classification and nearest neighbor search.
method Distribution-sensitive hashing using a forest of decision trees.
result ForestDSH hashes outperform LSH and state-of-the-art methods in speed and accuracy.
Let K be a a Lie group, modeled on a locally convex space, and M a finite-dimensional paracompact manifold with corners. We show that each continuous principal K-bundle over M is continuously equivalent to a smooth one and that two smooth principal K-bundles over M which are continuously equivalent are also smoothly eq…
Adaptive algorithm speeds up k-nearest-neighbor searches.
problem Finding k nearest neighbors with varying efficiency.
method Adaptive estimation of distances to optimize search.
result The algorithm achieves significant speedups compared to naive methods.
This paper compares FAISS and FENSHSES for nearest neighbor search in Hamming space.
problem Comparing nearest neighbor search systems in Hamming space.
method Comprehensive evaluations of indexing speed, search latency, and RAM consumption.
result Better understanding of trade-offs between main memory and secondary memory systems.
Efficiently find approximate nearest neighbors in high dimensions.
problem Finding the closest point in a high-dimensional dataset.
method Develops efficient data structures for approximate nearest neighbor search.
result Efficient solutions for approximate nearest neighbor problem.
Nearest neighbor methods are a popular class of nonparametric estimators with several desirable properties, such as adaptivity to different distance scales in different regions of space. Prior work on convergence rates for nearest neighbor classification has not fully reflected these subtle properties. We analyze the b…
KGAT uses knowledge graphs to improve recommendation accuracy and explainability.
problem Accurate, diverse, and explainable recommendations require side information and collaborative signals.
method KGAT models high-order relations in a knowledge graph by propagating embeddings and using attention mechanisms.
result KGAT significantly outperforms state-of-the-art methods on public benchmarks.
BigNN classifier improves nearest neighbor classification for large datasets.
problem Classification of large datasets that cannot fit into a single machine's memory.
method Divide and conquer scheme with majority voting for final decision; pre-training acceleration technique.
result Rates of convergence for bigNN classifier under minimal assumptions, proving it as optimal.
A defense against adversarial examples using k-Nearest Neighbor and deep learning.
problem Evaluating robustness of k-Nearest Neighbor and its deep learning combination.
method Proposed heuristic attack to find adversarial examples for kNN and DkNN.
result Our attack significantly outperforms other attacks on DkNN.
Improved nearest neighbor classification for time series data.
problem High storage and computation requirements for large training sets in DTW space.
method Extends LVQ to DTW spaces using asymmetric weighted averaging.
result Asymmetric GLVQ outperforms other methods in nearest neighbor classification.
Adaptive algorithm selects optimal neighbors for manifold learning.
problem Selecting optimal neighbors in manifold learning algorithms.
method Adaptive neighboring selection algorithm based on curvature prediction.
result The proposed algorithm increases embedding quality by 45.45%.
We derive Gaussian approximations for random forest predictions using region-based stabilization.
problem Improving the accuracy of random forest predictions for Poisson process data.
method Region-based stabilization and Malliavin-Stein method for multivariate Gaussian approximation.
result Established Gaussian approximation bounds for random forest predictions under Poisson process.
DkNN combines k-NN with deep learning for robust, interpretable predictions.
problem Lack of robustness and interpretability in deep learning models.
method Hybrid classifier combining k-NN and deep learning representations.
result Confidence estimates and interpretable explanations for inputs outside the model's training manifold.
We propose a simple kernel based nearest neighbor approach for handwritten digit classification. The "distance" here is actually a kernel defining the similarity between two images. We carefully study the effects of different number of neighbors and weight schemes and report the results. With only a few nearest neighbo…
New methods use vector search and nearest-neighbor matching for policy learning in causal inference.
problem Learning optimal policies in causal inference with limited data.
method RAG-based policy learning with vector search and nearest-neighbor matching.
result The methods bound the within-candidate choice regret and evaluate the one-step method directly as a policy.
Interpolated nearest neighbor algorithms minimize bias in machine learning models.
problem Understanding and reducing overfitting in machine learning models.
method Proves the interpolated nearest neighbor algorithm achieves minimax optimal rates in regression and classification.
result Interpolated nearest neighbor algorithms are statistically optimal and perform better than traditional methods in some cases.
Meta-learning improves few-shot learning by propagating knowledge across related classes on a graph.
problem Few-shot learning suffers from insufficient training data.
method Developed a Gated Propagation Network (GPN) that learns to propagate messages between prototypes of different classes on a graph.
result GPN outperforms recent meta-learning methods on benchmark datasets.
VNNGP uses nearest neighbors to approximate GPs, improving scalability and performance.
problem Scalability issues in Gaussian process approximations.
method Sparse precision structure via nearest neighbors, variational framework.
result VNNGP outperforms low-rank methods and is less prone to overfitting.