Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,878 papers · 148 categories

Trend · papers per month

61122182243 · Jun 202019922001200920172026
48 results for unsupervised detection

Study proposes using auxiliary classification to improve unsupervised anomaly detection.

problem Challenging anomaly detection in high-dimensional data.
method Use of an auxiliary classification task to extract features from unlabelled data by supervised learning.
result Our feature learning approach yields best anomaly detection performance.

Ensemble unsupervised anomaly detection using IRT for hidden ground truth.

problem Challenges in constructing an ensemble from unsupervised anomaly detection methods.
method Use Item Response Theory to compute latent traits and construct an ensemble that downplays noisy methods.
result Demonstrated effectiveness of IRT ensemble on extensive data repository.

Research explores unsupervised methods for detecting vessel behavior changes in real-time data streams.

problem Detecting shifts in vessel behavior for maritime traffic monitoring.
method Investigates unsupervised and semi-supervised change detection methods.
result Identifies shifts in vessel behavior for unusual events detection.

XGBOD combines unsupervised and supervised methods for better outlier detection.

problem Enhanced outlier detection from normal observations in various datasets.
method Hybrid approach using unsupervised representation learning to improve a supervised classifier.
result XGBOD outperforms competing methods across seven datasets.

A new framework uses information theory to detect anomalies in images without labeled data.

problem Detect anomalies in images without labeled data.
method A direct objective function using information theory to maximize the distance between normal and anomalous data.
result The proposed framework significantly outperforms state-of-the-arts on multiple benchmark datasets.

We introduce a new unsupervised anomaly detection ensemble called SPI which can harness privileged information - data available only for training examples but not for (future) test examples. Our ideas build on the Learning Using Privileged Information (LUPI) paradigm pioneered by Vapnik et al. [19,17], which we extend …

2018-05-06abs ↗pdf ↗

A new method detects outliers using ensembles of Dirichlet process mixtures.

problem Challenges in unsupervised outlier detection using Dirichlet process mixtures.
method Ensembles of Dirichlet process Gaussian mixtures with random subspace and subsampling.
result Empirically outperforms existing approaches in unsupervised outlier detection.

Deep semi-supervised anomaly detection improves fraud detection in financial markets.

problem Detecting fraud in high-frequency financial data with limited labeled examples.
method Evaluation of Deep Semi-Supervised Anomaly Detection (Deep SAD) on proprietary limit order book data.
result Deep SAD significantly improves fraud detection accuracy with minimal labeled data.

New method improves fault detection by adding unsupervised learning to Monte Carlo dropout models.

problem Detecting and diagnosing incipient and unknown faults in deep neural networks.
method Augmenting Monte Carlo dropout models with unsupervised learning tasks.
result Improved fault detection and diagnosis performance, especially on out-of-distribution examples.

New method detects change points in quasi-periodic signals without supervision.

problem Detecting change points in complex, non-harmonic signals.
method Optimal transport theory, topological analysis, bootstrap procedure.
result Successfully detects abnormal cardiac cycles in various arrhythmias.

SUOD accelerates unsupervised outlier detection for large datasets.

problem Scalability issues in unsupervised outlier detection for high-dimensional datasets.
method Three-module acceleration framework: Random Projection, Balanced Parallel Scheduling, Pseudo-supervised Approximation.
result SUOD significantly improves efficiency and scalability in outlier detection.

Proposes methods to improve interpretability of Isolation Forest for anomaly detection.

problem Lack of interpretability in Isolation Forest.
method Defines feature importance scores and unsupervised feature selection methods.
result Improves interpretability of Isolation Forest for anomaly detection.

Unsupervised deep learning detects and localizes crop leaf diseases.

problem Automated detection and localization of crop diseases.
method Three types of autoencoders (CAE, CVAE, VQ-VAE) applied to an open-source dataset.
result VQ-VAE autoencoder outperforms in image reconstruction, anomaly removal, detection, and localization.

BAE uses boosting to improve autoencoder ensembles for robust outlier detection.

problem Overfitting in autoencoders limits their effectiveness in unsupervised outlier detection.
method Boosting-based Autoencoder Ensemble (BAE) trains autoencoders sequentially with weighted sampling to reduce outliers and inject diversity.
result BAE outperforms state-of-the-art approaches in various outlier detection conditions.

Generates synthetic data for benchmarking unsupervised outlier detection.

problem Difficulty in benchmarking unsupervised outlier detection due to rare and varied outliers in real data.
method Proposes a generic process to generate synthetic data with insightful characteristics.
result Demonstrates practicality of the generic process through a benchmark with state-of-the-art detection methods.

A new method combines generative and feature-based approaches for unsupervised anomaly detection.

problem Identifying subtle anomalies in test samples compared to a normative distribution.
method A generative cold-diffusion pipeline trained to restore synthetically-corrupted images, combined with a novel synthetic anomaly generation procedure and ensembling restorations.
result Surpasses prior state-of-the-art for unsupervised anomaly detection in three Brain MRI datasets.

We propose the Autoencoding Binary Classifiers (ABC), a novel supervised anomaly detector based on the Autoencoder (AE). There are two main approaches in anomaly detection: supervised and unsupervised. The supervised approach accurately detects the known anomalies included in training data, but it cannot detect the unk…

2019-03-26abs ↗pdf ↗

New unsupervised image translation method detects changes without labeled data.

problem Detecting changes in images without labeled data.
method Affinity-based change priors and weighted loss functions trained on convolutional neural networks.
result Proposed method outperforms state-of-the-art algorithms in detecting changes.

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. Therefore, in order to have performance guarantees in unsupervised anomaly detection, priors need to be assumed on what the anomalies are. By contrast, active learning provides the necessary priors through approp…

2018-05-23abs ↗pdf ↗

Study examines unsupervised and graph-based methods for anomaly detection in IoBT, outperformed by supervised stacking ensemble.

problem Anomaly detection in adversarial environments of IoBT.
method Unsupervised learning, graph-based methods, ensemble supervised learning, adversarial training.
result Supervised stacking ensemble method outperforms unsupervised and graph-based methods in detecting anomalies.

Unified benchmark for GLAD and GLOD methods across 35 datasets.

problem Gap between GLAD and GLOD research due to distinct evaluation setups.
method Comprehensive evaluation framework that unifies GLAD and GLOD.
result Multi-dimensional analyses of existing methods' strengths and limitations.

An encoder-decoder model detects anomalies in manufacturing data.

problem Detecting and predicting anomalies in sequential sensor data.
method Encoder-decoder architecture for unsupervised anomaly detection.
result The model identifies anomalies and predicts future states in manufacturing processes.

DCASE 2021 ASD task tackles domain-shifted anomalous sound detection.

problem Detecting unknown anomalous sounds under domain-shifted conditions.
method Ensemble of outlier exposure and inlier modeling detectors, feature learning from machine identification.
result Two types of remarkable approaches were adopted by top teams.

CADGMM detects anomalies by capturing complex correlations in data.

problem Detecting anomalies in complex, unstructured data.
method CADGMM uses a graph structure to encode correlations, then a dual-encoder to learn low-dimensional latent space, followed by a Gaussian Mixture Model for anomaly detection.
result CADGMM effectively detects anomalies in real-world datasets.

Paper detects abnormalities in brain activity patterns using unsupervised learning.

problem Detecting abnormalities in resting-state brain activity patterns.
method Two strategies: autoencoder approach and next frame prediction.
result Both approaches can learn useful representations of rs-fMRI data for abnormality detection.

Bayesian method estimates contamination factor for unsupervised anomaly detection.

problem No good methods for estimating contamination factor in unsupervised anomaly detection.
method Bayesian approach using mixture formulation of anomaly detector outputs.
result Estimated contamination factor distribution is well-calibrated and improves anomaly detection performance.

DRAMA detects anomalies in high dimensions via dimensionality reduction.

problem Challenges in anomaly detection for large datasets in high dimensions.
method Dimensionality reduction and unsupervised clustering.
result DRAMA is robust and competitive in high dimensions, especially for online anomaly detection.