Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4488132176 · Jun 202019922001200920172026
48 results for novelty detection

Proposes a novel method for detecting novelty in multi-modal data.

problem Challenges in detecting novelty in high-dimensional, multi-modal data.
method Orthogonalized latent space for disentangling features and defining novelty score.
result Proposed method outperforms state-of-the-art algorithms in novelty detection.

CSI detects novelty by contrasting shifted instances, outperforming existing methods.

problem Detecting samples from outside the training distribution.
method Contrastive learning with distributionally shifted augmentations.
result CSI outperforms existing methods in various novelty detection scenarios.

In machine learning, novelty detection is the task of identifying novel unseen data. During training, only samples from the normal class are available. Test samples are classified as normal or abnormal by assignment of a novelty score. Here we propose novelty detection methods based on training variational autoencoders…

2018-06-08abs ↗pdf ↗

Flow-based deep generative models learn data distributions by transforming a simple base distribution into a complex distribution via a set of invertible transformations. Due to the invertibility, such models can score unseen data samples by computing their exact likelihood under the learned distribution. This makes fl…

2019-06-17abs ↗pdf ↗

Decentralized detection avoids sharing data, controls false discoveries.

problem Global false discovery rate control in decentralized novelty detection.
method Quantized surrogate models for low-precision sharing, preserving exchangeability.
result Quantized composite scores maintain competitive statistical power with reduced communication.

Study on robustness of learning-based novelty detection methods under adversarial attacks.

problem Understanding how learning-based novelty detection methods perform under adversarial perturbations.
method Formulated an oracle attack setup and evaluated vulnerability using black-box adversarial algorithms.
result Adversarial perturbations can significantly increase FDR while maintaining high detection power.

The paper develops methods for novelty detection on path space using signature-based statistics.

problem Novelty detection on path space as a hypothesis testing problem.
method Signature-based test statistics, transportation-cost inequalities, CVaR, one-class SVM algorithms.
result Established lower bounds on type-II\mathrm{II} error and general power bounds.

AutoSciDACT detects scientific anomalies in noisy data.

problem Detecting anomalies in large, noisy scientific datasets.
method Contrastive pre-training for low-dimensional data representations, two-sample test using NPLM.
result Strong sensitivity to small anomalies across various scientific domains.

New methods control false discoveries near the boundary in conformal novelty detection.

problem Over-optimistic assessments near the rejection threshold in conformal novelty detection.
method Support line (SL) correction and alternative procedures to control boundary false discovery rate (bFDR).
result New procedures control the boundary false discovery rate (bFDR) in the conformal setting.

DCAE learns compact latent representations for one-class novelty detection.

problem Learning compact latent representations for one-class novelty detection.
method DCAE learns compact and collapse-free latent representations through internal discriminative layers of GANs, reconstructing in-class data finely and exclusively.
result DCAE achieves state-of-the-art performance on novelty and adversarial example detection.

Conventional out-of-distribution (OOD) detection schemes based on variational autoencoder or Random Network Distillation (RND) have been observed to assign lower uncertainty to the OOD than the target distribution. In this work, we discover that such conventional novelty detection schemes are also vulnerable to the blu…

2019-11-27abs ↗pdf ↗

Machine-learning driven safety-critical autonomous systems, such as self-driving cars, must be able to detect situations where its trained model is not able to make a trustworthy prediction. Often viewed as a black-box, it is non-obvious to determine when a model will make a safe decision and when it will make an erron…

2019-06-09abs ↗pdf ↗

(ABRIDGED) In previous work, two platforms have been developed for testing computer-vision algorithms for robotic planetary exploration (McGuire et al. 2004b,2005; Bartolo et al. 2007). The wearable-computer platform has been tested at geological and astrobiological field sites in Spain (Rivas Vaciamadrid and Riba de S…

2009-10-28abs ↗pdf ↗

Generative Kernel PCA explores latent spaces for data interpretation and novelty detection.

problem Exploring latent spaces of datasets for better data interpretation.
method Generative Kernel PCA using hidden and visible units similar to Restricted Boltzmann Machines.
result Gradually moving in the latent space allows for interpretation of components and detection of novel patterns.

Extends Mahalanobis distance to Banach spaces for anomaly detection.

problem Anomaly detection in infinite-dimensional spaces.
method Generalizes Mahalanobis distance to Banach spaces via Cameron-Martin norm and variance norm.
result Kernelized nearest-neighbour Mahalanobis distance outperforms traditional methods for time series novelty detection.

This work introduces a novel method to evaluate generative model novelty.

problem Evaluating the novelty of generative models compared to a reference model.
method Spectral approach to differential clustering and Kernel-based Entropic Novelty (KEN) score.
result The KEN score effectively detects novel modes and compares generative models.

SAGE improves memory efficiency by selectively adding, merging, or ignoring new facts.

problem Efficiently managing new facts in agentic LLMs to avoid costly write-time reasoning.
method SAGE uses a von Mises-Fisher-based density estimator to score and route candidate facts.
result SAGE achieves the best average token-F1 on LoCoMo and reduces add-phase API cost by 3.4x on GPT-4o-mini.

Deep neural networks have achieved impressive success in large-scale visual object recognition tasks with a predefined set of classes. However, recognizing objects of novel classes unseen during training still remains challenging. The problem of detecting such novel classes has been addressed in the literature, but mos…

2018-04-02abs ↗pdf ↗

Many deep models have been recently proposed for anomaly detection. This paper presents comparison of selected generative deep models and classical anomaly detection methods on an extensive number of non--image benchmark datasets. We provide statistical comparison of the selected models, in many configurations, archite…

2018-07-13abs ↗pdf ↗

A new method for student-initiated action advice using novelty detection.

problem Exploration and sample inefficiency in RL, especially with teacher absence.
method Random Network Distillation (RND) to measure advice novelty, updates only for advised states.
result Significant performance improvement over state-of-the-art methods, especially in challenging scenarios.

We study sequential change-point detection procedures based on linear sketches of high-dimensional signal vectors using generalized likelihood ratio (GLR) statistics. The GLR statistics allow for an unknown post-change mean that represents an anomaly or novelty. We consider both fixed and time-varying projections, deri…

2015-05-25abs ↗pdf ↗

Detecting edge correlation between two graphs sharpens a threshold based on densest subgraph.

problem Detecting edge correlation between two Erdős-Rényi graphs.
method Formulated as a hypothesis testing problem, connecting to densest subgraph detection.
result Sharp information-theoretic threshold established for edge correlation detection.

This work bridges outlier and drift detection by comparing inputs to a part of the reference distribution.

problem Monitoring machine learning models to ensure they operate within their validated distribution.
method Comparing a set of inputs to a chosen part of the reference distribution.
result A new approach that bridges outlier detection and drift detection.

This paper introduces CENIE to quantify environment novelty for better UED.

problem Challenges in measuring environment novelty for effective UED.
method CENIE framework using state-action space coverage and Gaussian Mixture Models.
result CENIE improves UED performance across multiple benchmarks.

Automated detection of new, interesting, unusual, or anomalous images within large data sets has great value for applications from surveillance (e.g., airport security) to science (observations that don't fit a given theory can lead to new discoveries). Many image data analysis systems are turning to convolutional neur…

2018-06-21abs ↗pdf ↗

Generatability in metric spaces studied with novel novelty parameters.

problem Understanding generatability in metric spaces with asymmetric novelty parameters.
method Introducing (ε,ε)(\varepsilon,\varepsilon')-closure dimension to characterize uniform and non-uniform generatability.
result Generatability is stable across novelty scales in doubling spaces but can be highly scale-sensitive in general metric spaces.

As more and more people shift their movie watching online, competition between movie viewing websites are getting more and more intense. Therefore, it has become incredibly important to accurately predict a given user's watching list to maximize the chances of keeping the user on the platform. Recent studies have sugge…

2019-09-02abs ↗pdf ↗