Review of distance-based methods for time series classification.
problem Challenges in classifying time series data.
method Distance-based approaches for time series classification.
result New methods exploit distances to improve classification performance.
Paper explains distance-based classifiers using neural network structures.
problem Making distance-based classifiers explainable.
method Uncovering latent neural network structures in distance-based classifiers.
result Novel explanation approach outperforms baselines.
Improves classification of microbiome data using mixture distributions.
problem Challenges in classifying sparse and heterogeneous microbiome count data.
method Distance-based classification using mixture distributions.
result The method outperforms existing distance-based classifiers and machine learning approaches.
New algorithms detect anomalies in time-series data.
problem Detecting unusual patterns in time-series data.
method Combines feature extraction, score assessment, and conformal interpretation.
result Proposes new anomaly detection methods for time-series data.
BRDAD uses bagging and regularization to improve anomaly detection without labeled data.
problem Anomaly detection in unlabeled data with sensitivity to k-nearest neighbors. method Bagged regularized k-distances (BRDAD) for anomaly detection, converting to convex optimization. result BRDAD addresses sensitivity to hyperparameter choice and improves performance on large datasets.
Transforms distance-based outlier scores into interpretable probabilistic estimates.
problem Difficult interpretation of distance-based outlier scores.
method Generic transformation of scores into probabilistic estimates using distance probability distributions.
result Probabilistic transformation improves interpretability without impacting detection performance.
A new measure identifies clusters without assuming data distribution.
problem Identifying the correct number of clusters in data without distribution assumptions.
method Nonparametric interpoint distance-based approach.
result Superior to existing clustering measures, validated on synthetic and real data.
A new classifier for high-dimensional data with spiked eigenvalues.
problem Classifying high-dimensional data with spiked eigenvalues.
method Distance-based classifier using data transformation and noise reduction.
result The new classifier performs better than existing methods on simulated and real data.
DBLE improves confidence calibration of DNNs by learning distances in representation space.
problem Poor confidence calibration of deep neural networks (DNNs).
method DBLE trains a confidence model jointly with the classification model, using distances in the representation space.
result DBLE outperforms alternative single-model confidence calibration approaches and ensemble methods.
New metric learning approach for tree data reduces computation cost.
problem Efficiently computing distances between ordered labeled trees.
method Introduced pq-grams and a differentiable weighted pq-gram distance, combined with LMNN for optimization.
result Significantly reduces computation time for tree classification problems.
Neural networks learn distance-based representations, not just intensity.
problem Understanding how neural networks interpret and learn from internal activations.
method Manipulated ReLU and Absolute Value activations to observe sensitivity to distance and intensity perturbations.
result Neural networks are highly sensitive to small distance-based perturbations, challenging the intensity-based interpretation.
Neural networks can learn distance metrics affecting model performance.
problem Understanding how neural networks learn and represent data.
method Experiments with six MNIST architectures, constrained to learn either distance or intensity representations.
result Distance-based learning affects model performance, validating the geometric framework.
Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling these techniques to massive data sets without sacrificing accuracy is a challeng…
The paper improves uncertainty quantification for node classification using distance-based regularization.
problem Uncertainty in deep learning models, especially for node classification tasks.
method Graph posterior networks (GPNs) with UCE loss function, followed by a distance-based regularization.
result The proposed distance-based regularization outperforms state-of-the-art methods in OOD detection and misclassification detection.
Solves clustering contradictions by high-dimensional embedding with wide gaps.
problem Kleinberg's clustering axioms are contradictory.
method Embedding in high-dimensional space with wide gaps between clusters.
result Handles clustering contradictions by design.
New GP kernel handles mixed-categorical data, improving model accuracy.
problem Improving Gaussian process models for mixed-categorical data.
method Extends continuous exponential kernels to handle mixed-categorical variables.
result The proposed GP model gives higher likelihood and smaller residual error.
RAMODO learns better representations for outlier detection in ultrahigh-dimensional data.
problem Suboptimal and unstable outlier detection in ultrahigh-dimensional data.
method Unified representation learning and outlier detection using a ranking model.
result RAMODO improves AUC performance and stability of random distance-based outlier detection.
A new Wasserstein K-means method for clustering probability distributions.
problem Clustering probability distributions using the Wasserstein metric.
method Distance-based K-means with SDP relaxation for Wasserstein barycenters. result Distance-based K-means outperforms centroid-based K-means for clustering probability distributions. Bayesian distance clustering improves robustness to kernel choice.
problem Kernel sensitivity in model-based clustering.
method Modeling pairwise distances instead of original data.
result Dramatic gains in cluster inference robustness.
Paper proposes a new method to quantify uncertainty in machine learning models.
problem Quantifying uncertainty in multiclass classification models.
method Distance-based approach using Integral Probability Metrics (IPMs).
result Effective uncertainty measures for multiclass classification.
Paper identifies classes vulnerable to adversarial attacks.
problem Adversarial attacks on deep learning models.
method Distance-based measures applied on trained models to identify susceptible classes.
result Identifies k most susceptible target classes for adversarial attacks.
A method for ranking items using distance-based learning from positive and unlabeled data.
problem Learning to rank items without an analytic description of what constitutes a good ranking.
method Combining representations using an integer linear program for ranking items based on nominations.
result The method is effective in simulation and real data examples, especially when supervision is light.
New network distance based on Laplacian flow captures structure.
problem Measuring similarity between network objects.
method Introducing Laplacian flow to define a new diffusion distance.
result Demonstrated utility and advantage over existing distances.
A simple method for neural network confidence scores.
problem Measuring confidence in neural network predictions.
method Distance-based loss or Adversarial Training for data embedding.
result Significant improvement over traditional confidence scores.
Study compares clustering methods for mixed-type data.
problem Challenges in clustering mixed-type data.
method Distance-based (k-prototypes, PDQ, convex k-means), probabilistic (KAY-means, MBNs, LCM).
result KAMILA, LCM, and k-prototypes perform best.
A statistical model predicts generalization in few-shot learning.
problem Lack of validation sets in few-shot learning makes generalization estimation difficult.
method Introduced a Gaussian model of feature distribution and an unbiased estimator for class-conditional density distances.
result Our approach outperforms alternatives like leave-one-out cross-validation.
Random forest can be adapted for open-set recognition with improved performance.
problem Handling unknown classes in real-world classification tasks.
method Incorporating distance metric learning and distance-based open-set recognition into random forest.
result The proposed method outperforms state-of-the-art open-set recognition methods.
Extends RF proximities to all supervised distance-based machine learning contexts.
problem Limited utility of RF proximities in various machine learning tasks.
method Introduces generalized Proximity Forest (PF) model and variant for regression.
result Demonstrates unique advantages over RF and k-nearest neighbors models.
In this paper we formulate in general terms an approach to prove strong consistency of the Empirical Risk Minimisation inductive principle applied to the prototype or distance based clustering. This approach was motivated by the Divisive Information-Theoretic Feature Clustering model in probabilistic space with Kullbac…
Efficient method classifies locally stationary time series based on second-order characteristics.
problem Classifying locally stationary time series for various applications.
method Autoregressive approximation, ensemble aggregation, distance-based threshold.
result Zero misclassification error rate asymptotically for mildly differing second-order characteristics.
PRISM-FCP improves federated prediction robustness against Byzantine attacks.
problem Byzantine attacks in federated learning.
method Partial model sharing and distance-based maliciousness scores.
result Maintains nominal coverage guarantees under Byzantine attacks.
For time series comparisons, it has often been observed that z-score normalized Euclidean distances far outperform the unnormalized variant. In this paper we show that a z-score normalized, squared Euclidean Distance is, in fact, equal to a distance based on Pearson Correlation. This has profound impact on many distanc…
Unified score and distance-based GoF tests for model adequacy.
problem Difficulty in extending score-based GoF tests to nonparametric alternatives.
method Introducing semiparametric kernelized Stein discrepancy (SKSD) test.
result SKSD test is computationally efficient and universally consistent.
Self-supervised metric learning boosts downstream tasks in multi-view data.
problem Improving distance-based downstream tasks without labeled data.
method Developed a statistical framework to study self-supervised metric learning in multi-view data.
result Self-supervised metric learning improves target distances for various downstream tasks.
It is a key to construct a similarity graph in graph-oriented subspace learning and clustering. In a similarity graph, each vertex denotes a data point and the edge weight represents the similarity between two points. There are two popular schemes to construct a similarity graph, i.e., pairwise distance based scheme an…
GICDM corrects hubness in embedding spaces for better generative model evaluation.
problem Hubness phenomenon distorts distances in high-dimensional embedding spaces.
method Generative ICDM (GICDM) using multi-scale extension to correct neighborhood estimation.
result GICDM resolves hubness-induced failures and improves metric behavior.
Improves uncertainty estimation and OOD detection in neural networks.
problem Accurate uncertainty estimation and OOD detection in neural networks.
method Investigates one-vs-all and distance-based logit representations for probabilities.
result One-vs-all formulations improve calibration without additional complexity.
ClusTR improves clustering-based models' robustness without adversarial training.
problem Improving clustering-based models' robustness.
method Proposes ClusTR, a clustering-based training framework for robust models without adversarial training.
result ClusTR outperforms adversarially-trained models by up to 4% under strong PGD attacks.
Developed a new method to generate synthetic data while protecting privacy.
problem Protecting privacy of human participant data while making it publicly accessible.
method A multi-step framework based on Classification and Regression Trees and an original distance-based filtering.
result Satisfactory protection against attribute disclosure attacks and formal prevention of membership disclosure attacks.
The paper compares clustering methods for improving time series forecasting accuracy.
problem Improving time series forecasting accuracy using neural networks.
method Investigates feature-based and distance-based clustering methods for time series forecasting.
result Feature-based clustering outperforms distance-based clustering in terms of speed and efficiency.
In general, the clustering problem is NP-hard, and global optimality cannot be established for non-trivial instances. For high-dimensional data, distance-based methods for clustering or classification face an additional difficulty, the unreliability of distances in very high-dimensional spaces. We propose a distance-ba…
Paper analyzes classical multidimensional scaling for cluster recovery.
problem Cluster recovery from noisy data.
method Classical multidimensional scaling followed by distance-based clustering.
result Scaling conditions for high probability cluster recovery.
We present a simple, yet effective, approach to Semi-Supervised Learning. Our approach is based on estimating density-based distances (DBD) using a shortest path calculation on a graph. These Graph-DBD estimates can then be used in any distance-based supervised learning method, such as Nearest Neighbor methods and SVMs…
Paper presents a new method for clustering patient records using tensor decomposition.
problem Clustering high-dimensional binary data, especially in healthcare records.
method Tensor decomposition for an efficient and robust heuristic.
result Clinically meaningful results obtained on two healthcare datasets.
A new robust time series distance metric for k-NN classification.
problem Robustness against arbitrary data contamination in time series classification.
method Proposes a novel distance metric with worst-case O(nlogn) complexity. result Demonstrates competitive classification accuracy in k-NN time series classification.
OSil algorithm optimizes clustering quality using ASW.
problem Optimizing clustering quality using ASW.
method Distance-based objective function optimizing ASW for clustering.
result OSil algorithm outperforms other clustering methods in clustering quality.
This paper improves neural network robustness through feedback learning.
problem Vulnerability of neural networks to adversarial attacks.
method Feedback learning method to understand and improve model robustness.
result Significantly improved models' accuracy and robustness against evasion attacks.
Bayesian model explains sentence comprehension better than distance-based account.
problem Sentence comprehension latency and dependency distance.
method Bayesian hierarchical mixture process modeling.
result Direct-access model fits Chinese relative clause data better.