arXiv research

Optimizes one-class classification methods for better performance.

A review of nearest neighbour classifiers, focusing on similarity measures and computational efficiency.

Unified framework evaluates different nearest neighbor classification methods.

In the machine learning field, dimensionality reduction is an important task. It mitigates the undesired properties of high-dimensional spaces to facilitate classification, compression, and visualization of high-dimensional data. During the last decade, researchers proposed many new (non-linear) techniques for dimensio…

A hybrid K-NN and SVM technique improves classification accuracy.

ALP outperforms other data descriptors in one-class classification.

A recent proposal of data dependent similarity called Isolation Kernel/Similarity has enabled SVM to produce better classification accuracy. We identify shortcomings of using a tree method to implement Isolation Similarity; and propose a nearest neighbour method instead. We formally prove the characteristic of Isolatio…

Proposes a new k-NN algorithm to improve classification accuracy by removing noise and pseudo-neighbours.

The classification of time series data is a well-studied problem with numerous practical applications, such as medical diagnosis and speech recognition. A popular and effective approach is to classify new time series in the same way as their nearest neighbours, whereby proximity is defined using Dynamic Time Warping (D…

In this paper we propose and explore the k-Nearest Neighbour UCB algorithm for multi-armed bandits with covariates. We focus on a setting where the covariates are supported on a metric space of low intrinsic dimension, such as a manifold embedded within a high dimensional ambient feature space. The algorithm is concept…

New algorithm reduces regret in contextual bandits with many near-boundary contexts.

A new adaptive kNN classifier outperforms Random Forests.

We study the approximate nearest neighbour method for cost-sensitive classification on low-dimensional manifolds embedded within a high-dimensional feature space. We determine the minimax learning rates for distributions on a smooth manifold, in a cost-sensitive setting. This generalises a classic result of Audibert an…

The $k$-nearest neighbour ($k$-NN) classifier is one of the oldest and most important supervised learning algorithms for classifying datasets. Traditionally the Euclidean norm is used as the distance for the $k$-NN classifier. In this thesis we investigate the use of alternative distances for the $k$-NN classifier. We …

Extends Mahalanobis distance to Banach spaces for anomaly detection.

K-Nearest Neighbours (k-NN) is a popular classification and regression algorithm, yet one of its main limitations is the difficulty in choosing the number of neighbours. We present a Bayesian algorithm to compute the posterior probability distribution for k given a target point within a data-set, efficiently and withou…

Probabilistic k-nearest neighbour (PKNN) classification has been introduced to improve the performance of original k-nearest neighbour (KNN) classification algorithm by explicitly modelling uncertainty in the classification of each feature vector. However, an issue common to both KNN and PKNN is to select the optimal n…

New LSH methods for tensor data improve efficiency and space usage.

Intuitive clustering algorithm balances cluster size and cohesion.

Most exact methods for k-nearest neighbour search suffer from the curse of dimensionality; that is, their query times exhibit exponential dependence on either the ambient or the intrinsic dimensionality. Dynamic Continuous Indexing (DCI) offers a promising way of circumventing the curse and successfully reduces the dep…

Novel estimator reduces diffusion model variance.

Paper presents a method to align unpaired samples across different modalities.

A framework for flagging content with limited data.

There is an increasing body of evidence suggesting that exact nearest neighbour search in high-dimensional spaces is affected by the curse of dimensionality at a fundamental level. Does it necessarily mean that the same is true for k nearest neighbours based learning algorithms such as the k-NN classifier? We analyse t…

PAC-Bayesian bounds improve understanding of K-NN classifier performance.

Study classifies liability insurance policies using machine learning.

Develops a theoretical framework for scalable Gaussian Process regression methods.

DINOSAUR improves retrieval by accounting for embedding uncertainty in recommender systems.

A new ensemble method using random projections for kNN classification.

Naive Bayes Nearest Neighbour (NBNN) is a simple and effective framework which addresses many of the pitfalls of K-Nearest Neighbour (KNN) classification. It has yielded competitive results on several computer vision benchmarks. Its central tenet is that during NN search, a query is not compared to every example in a d…

$k$-nearest neighbour ($k$-NN) is one of the simplest and most widely-used methods for supervised classification, that predicts a query's label by taking weighted ratio of observed labels of $k$ objects nearest to the query. The weights and the parameter $k \in \mathbb{N}$ regulate its bias-variance trade-off, and the …

A fast method for LOOCV in k-NN regression reduces computation time.

A new ensemble method improves kNN performance by extending the neighborhood rule.

Adaptive, sparse graphs improve learning performance.

The classification of phase transitions is a central and challenging task in condensed matter physics. Typically, it relies on the identification of order parameters and the analysis of singularities in the free energy and its derivatives. Here, we propose an alternative framework to identify quantum phase transitions,…

A robust conformal method for set estimation using non-conformity scores.

Hierarchical clustering uses OWA operators to generalize linkage methods and avoid dendrogram inversions.

The three-state agent-based 2D model of financial markets in the version proposed by Giulia Iori in 2002 has been herein extended. We have introduced the increase of herding behaviour by modelling the altering trust of an agent in his nearest neighbours. The trust increases if the neighbour has foreseen the price chang…

A new method for sampling on manifolds reduces density estimation errors.

Density-based clustering is the task of discovering high-density regions of entities (clusters) that are separated from each other by contiguous regions of low-density. DBSCAN is, arguably, the most popular density-based clustering algorithm. However, its cluster recovery capabilities depend on the combination of the t…

Optimal prototypes found for challenging pathological geometries.

Existing methods for retrieving k-nearest neighbours suffer from the curse of dimensionality. We argue this is caused in part by inherent deficiencies of space partitioning, which is the underlying strategy used by most existing methods. We devise a new strategy that avoids partitioning the vector space and present a n…

A scalable GPVAE method using local adjacencies to approximate GP inference.

The $k$ nearest neighbour learning rule (under the uniform distance tie breaking) is universally consistent in every metric space $X$ that is sigma-finite dimensional in the sense of Nagata. This was pointed out by Cérou and Guyader (2006) as a consequence of the main result by those authors, combined with a theorem in…

New method estimates gradients accurately with sharp bounds.

Machine learning models solve inverse eigenvalue problems for symmetric potentials and refractive indices.

Validates network bootstraps for uncertainty quantification in network visualisation.

In this paper we are going to introduce a new nearest neighbours based approach to clustering, and compare it with previous solutions; the resulting algorithm, which takes inspiration from both DBscan and minimum spanning tree approaches, is deterministic but proves simpler, faster and doesnt require to set in advance …