arXiv research

Neural networks classify OOD images by their nearest neighbor in training data.

The output scores of a neural network classifier are converted to probabilities via normalizing over the scores of all competing categories. Computing this partition function, $Z$, is then linear in the number of categories, which is problematic as real-world problem sets continue to grow in categorical types, such as …

FiberNet integrates geometry into machine learning for clearer classification.

We consider the problem of learning to play first-person shooter (FPS) video games using raw screen images as observations and keyboard inputs as actions. The high-dimensionality of the observations in this type of applications leads to prohibitive needs of training data for model-free methods, such as the deep Q-netwo…

Characterizes Lebesgue points using nearest neighbor methods.

A new method uses nearest neighbors for importance weighting.

The paper explains how nearest neighbor methods succeed in prediction.

New methods use vector search and nearest-neighbor matching for policy learning in causal inference.

Nearest neighbors is a successful and long-standing technique for anomaly detection. Significant progress has been recently achieved by self-supervised deep methods (e.g. RotNet). Self-supervised features however typically under-perform Imagenet pre-trained features. In this work, we investigate whether the recent prog…

TPA-AD detects axle-box bearing anomalies using pseudo anomalies near normal boundaries.

K-Nearest neighbor classifier (k-NNC) is simple to use and has little design time like finding k values in k-nearest neighbor classifier, hence these are suitable to work with dynamically varying data-sets. There exists some fundamental improvements over the basic k-NNC, like weighted k-nearest neighbors classifier (wh…

In the panoply of pattern classification techniques, few enjoy the intuitive appeal and simplicity of the nearest neighbor rule: given a set of samples in some metric domain space whose value under some function is known, we estimate the function anywhere in the domain by giving the value of the nearest sample per the …

The nearest neighbor method together with the dynamic time warping (DTW) distance is one of the most popular approaches in time series classification. This method suffers from high storage and computation requirements for large training sets. As a solution to both drawbacks, this article extends learning vector quantiz…

Study nearest-neighbor radii under dependent sampling, finding they remain informative.

The stability of statistical analysis is an important indicator for reproducibility, which is one main principle of scientific method. It entails that similar statistical conclusions can be reached based on independent samples from the same underlying population. In this paper, we introduce a general measure of classif…

AWNN improves matrix completion by adaptively weighting nearest neighbors.

The assessment of energy expenditure in real life is of great importance for monitoring the current physical state of people, especially in work, sport, elderly care, health care, and everyday life even. This work reports about application of some machine learning methods (linear regression, linear discriminant analysi…

The estimation of optimal treatment regimes is of considerable interest to precision medicine. In this work, we propose a causal $k$-nearest neighbor method to estimate the optimal treatment regime. The method roots in the framework of causal inference, and estimates the causal treatment effects within the nearest neig…

A hybrid K-NN and SVM technique improves classification accuracy.

Exemplar VAEs link generative models with nearest neighbor retrieval and data augmentation.

The Nearest subspace classifier (NSS) finds an estimation of the underlying subspace within each class and assigns data points to the class that corresponds to its nearest subspace. This paper mainly studies how well NSS can be generalized to new samples. It is proved that NSS is strongly consistent under certain assum…

A review of nearest neighbour classifiers, focusing on similarity measures and computational efficiency.

Nearest neighbor methods are a popular class of nonparametric estimators with several desirable properties, such as adaptivity to different distance scales in different regions of space. Prior work on convergence rates for nearest neighbor classification has not fully reflected these subtle properties. We analyze the b…

The nearest neighbor rule is proven consistent in a broad setting.

IRTCI uses IRT for categorical imputation, outperforming other methods in various datasets.

A new approach to $L_2$-consistent estimation of a general density functional using $k$-nearest neighbor distances is proposed, where the functional under consideration is in the form of the expectation of some function $f$ of the densities at each point. The estimator is designed to be asymptotically unbiased, using t…

Generative model for morphisms in free categories learns from wiring diagrams.

This research examines how the error rate of nearest neighbor classifiers varies with dataset size.

Biased sampling and missing data complicates statistical problems ranging from causal inference to reinforcement learning. We often correct for biased sampling of summary statistics with matching methods and importance weighting. In this paper, we study nearest neighbor matching (NNM), which makes estimates of populati…

New algorithm learns from partial labels in general scenarios.

ASK-NN detects distribution drifts in LLM-generated text.

VNNGP uses nearest neighbors to approximate GPs, improving scalability and performance.

Unified framework evaluates different nearest neighbor classification methods.

A variety of machine learning applications expect to achieve rapid learning from a limited number of labeled data. However, the success of most current models is the result of heavy training on big data. Meta-learning addresses this problem by extracting common knowledge across different tasks that can be quickly adapt…

New topological methods for hypergraph data improve community detection and pattern recognition.

Java implementation improves nearest neighbor algorithm complexity.

The paper tackles time series data by applying conformal prediction with nearest neighbors.

Novel estimator reduces diffusion model variance.

Estimates missing distributions using nearest neighbors with kernel methods.

Multi-Output Dependence (MOD) learning is a generalization of standard classification problems that allows for multiple outputs that are dependent on each other. A primary issue that arises in the context of MOD learning is that for any given input pattern there can be multiple correct output patterns. This changes the…

The paper studies empirical processes from nearest neighbors in regression.

We generalize the notion of monetary value measures developed with category theory in [Adachi, 2014] by extending their base category from the category \c{hi} to the category of probability spaces Prob introduced in [Adachi and Ryu, 2016].

This paper proposes a new hashing-based KNN technique for faster nearest neighbor selection.

Optimizes sample reweighting to match laws under covariate shift using Wasserstein distance.

In this paper we propose and explore the k-Nearest Neighbour UCB algorithm for multi-armed bandits with covariates. We focus on a setting where the covariates are supported on a metric space of low intrinsic dimension, such as a manifold embedded within a high dimensional ambient feature space. The algorithm is concept…

Method reconstructs missing wind farm data using graph theory and nearest neighbors.

The nearest neighbor problem is defined as follows: Given a set $P$ of $n$ points in some metric space $(X,D)$, build a data structure that, given any point $q$, returns a point in $P$ that is closest to $q$ (its "nearest neighbor" in $P$). The data structure stores additional information about the set $P$, which is th…

New categories help understand knot algebra.