Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4385128170 · May 202619922001200920172026
48 results for anomaly scoring

A new method optimizes anomaly scoring from score distribution to improve AD performance.

problem Vulnerability to anomaly contamination and lack of adaptability in existing AD methods.
method Optimizes anomaly scoring function from score distribution perspective, using Overlap loss.
result Overlap loss-based AD models significantly outperform state-of-the-art methods.

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new feature representations to enable downstream anomaly detection methods, perform in…

2019-11-19abs ↗pdf ↗

Proposes a method to measure similarity between anomaly scores from different methods.

problem Difficulty in directly comparing anomaly detection methods.
method A measure based on extremal similarity in scoring distributions using a novel upper quadrant modeling approach.
result Demonstrates the ability to detect clusters of anomaly detection algorithms and achieve an accurate ensemble algorithm.

Improves anomaly detection with contaminated unlabeled data.

problem Weakness in existing semi-supervised anomaly detection methods when unlabeled data contain anomalies.
method Integrates positive-unlabeled learning with deep anomaly detection models.
result Achieves better detection performance on various datasets.

This paper evaluates anomaly detection methods for multivariate time series data.

problem Lack of systematic comparison of anomaly detection methods on multivariate time series data.
method Comprehensive evaluation of 10 models and 4 scoring functions on 10 datasets.
result Dynamic scoring functions outperform static ones, and the choice of scoring functions matters more than the model choice.

Topological anomaly scores predict return curves in S&P 500 stocks

problem Detecting anomalies in financial time series
method BallMapper, decoder-conditional VAE, Function-on-Function regression
result Anomaly history carries predictive content for return curves

We propose a supervised anomaly detection method for data with inexact anomaly labels, where each label, which is assigned to a set of instances, indicates that at least one instance in the set is anomalous. Although many anomaly detection methods have been proposed, they cannot handle inexact anomaly labels. To measur…

2019-09-11abs ↗pdf ↗

A new model combines VAE and GAN for better anomaly detection in imbalanced datasets.

problem Anomaly detection in imbalanced datasets, especially in medical applications.
method β-VAEGAN model combining VAE and GAN, kernelized SVM for anomaly scores, and deviation from Gaussian prior.
result Improved F1F_1 score from 0.85 to 0.92 on MITBIH Arrhythmia Database.

MIAEAD detects anomalies in mixed data types.

problem Challenges of heterogeneity in feature subsets for anomaly detection.
method Multiple-Input Variational Auto-Encoder (MIVAE) for simultaneous feature subset anomaly scoring.
result MIVAE outperforms conventional methods and state-of-the-art unsupervised models in AUC score.

Mitigates anomaly score imbalance in long-tailed distributions.

problem Class imbalance in normal data leads to skewed anomaly detection performance.
method Proposes an importance-weighted loss function to balance anomaly scores.
result Improves anomaly detection performance by 0.043 on real-world datasets.

Improves interpretability of anomaly scores in GBRBM-based detection.

problem Difficulty in setting a proper threshold for anomaly scores.
method Proposes a measure based on cumulative distribution and uses simulated annealing for evaluation.
result Established a guideline for setting the threshold using the interpretable measure.

EHBOS enhances HBOS by capturing feature interactions, improving anomaly detection.

problem Limited ability of HBOS to detect anomalies in datasets with feature interactions.
method Incorporates two-dimensional histograms to capture feature pair dependencies.
result EHBOS outperforms HBOS on datasets with critical feature interactions, achieving notable improvements in ROC AUC.

TadGAN detects anomalies in time series data using GANs and LSTM.

problem Challenges in detecting anomalies in time series data, especially without labeled data.
method TadGAN uses Generative Adversarial Networks (GANs) with LSTM Recurrent Neural Networks to capture temporal correlations and compute anomaly scores.
result TadGAN outperforms 8 baseline methods in most cases, achieving the highest averaged F1 score.

Proposes a new model for online anomaly detection in multivariate time series.

problem Inaccurate anomaly detection in multivariate time series due to spurious correlations and lack of temporal causality.
method Clusters channels based on correlations, embeds each cluster, and integrates information through a causal mixer while maintaining temporal causality.
result Consistently superior performance across six public benchmark datasets.

Correlated anomaly detection (CAD) from streaming data is a type of group anomaly detection and an essential task in useful real-time data mining applications like botnet detection, financial event detection, industrial process monitor, etc. The primary approach for this type of detection in previous researches is base…

2018-12-19abs ↗pdf ↗

We propose a non-parametric anomaly detection algorithm for high dimensional data. We score each datapoint by its average KK-NN distance, and rank them accordingly. We then train limited complexity models to imitate these scores based on the max-margin learning-to-rank framework. A test-point is declared as an anomaly…

2015-02-06abs ↗pdf ↗

Improves relevancy of black-box anomaly detectors with user feedback.

problem Users often ignore many detected anomalies, requiring a method to identify and prioritize relevant ones.
method Uses user feedback to adjust anomaly selection process based on identified anomaly types.
result Significant improvements in precision and recall over various anomaly detectors.

We propose a non-parametric anomaly detection algorithm for high dimensional data. We first rank scores derived from nearest neighbor graphs on nn-point nominal training data. We then train limited complexity models to imitate these scores based on the max-margin learning-to-rank framework. A test-point is declared as…

2016-01-22abs ↗pdf ↗

OMASGAN generates anomalous samples on distribution boundary to improve anomaly detection.

problem Missed anomalies and low AD performance due to OoD samples in generative models.
method OMASGAN generates anomalous samples on the estimated distribution boundary using a GAN approach, refining AD models.
result OMASGAN improves AD performance by at least 0.24 and 0.07 points on average on MNIST and CIFAR-10 datasets.

Novel framework for contextual anomaly detection models uncertainty.

problem Identifying anomalies in target variables influenced by contextual variables.
method Normalcy score (NS) framework using heteroscedastic Gaussian process regression.
result NS outperforms state-of-the-art methods in detection accuracy and interpretability.

CCE improves anomaly detection metrics by measuring both confidence and consistency.

problem Existing anomaly detection metrics lack discriminative power, hyperparameter dependency, and robustness to perturbations.
method CCE uses Bayesian estimation to quantify uncertainty and constructs global and event-level confidence and consistency scores.
result CCE demonstrates strict boundedness, robustness, and linear time complexity.

We propose a novel non-parametric adaptive anomaly detection algorithm for high dimensional data based on rank-SVM. Data points are first ranked based on scores derived from nearest neighbor graphs on n-point nominal data. We then train a rank-SVM using this ranked data. A test-point is declared as an anomaly at alpha-…

2014-05-02abs ↗pdf ↗

Bayesian method estimates contamination factor for unsupervised anomaly detection.

problem No good methods for estimating contamination factor in unsupervised anomaly detection.
method Bayesian approach using mixture formulation of anomaly detector outputs.
result Estimated contamination factor distribution is well-calibrated and improves anomaly detection performance.

A new method for detecting anomalies in large, high-dimensional data streams using probabilistic forest models.

problem Challenges in detecting anomalies in large, high-dimensional data.
method Probabilistic Mondrian Pólya Forests for summarizing data and estimating underlying probability density.
result State-of-the-art performance with interpretable anomaly scores.

We tackle anomaly detection in sparse time series data.

problem Sparse time series with low signal-to-noise ratios and non-uniform performance.
method We introduce a novel generative procedure for benchmark datasets and demonstrate how anomaly score smoothing improves performance.
result Anomaly score smoothing consistently improves performance in low-count time series anomaly detection.

Trimming helps in conformal prediction when it separates anomaly scores.

problem Effectiveness of trimming in conformal prediction under contamination.
method Analyse fixed-threshold trimming as a replacement of the contaminated calibration law with a retained law.
result Trimming helps when it separates anomaly scores, reducing clean-target coverage to a one-dimensional score-CDF transfer problem.

Reconstruction error is a prevalent score used to identify anomalous samples when data are modeled by generative models, such as (variational) auto-encoders or generative adversarial networks. This score relies on the assumption that normal samples are located on a manifold and all anomalous samples are located outside…

2019-05-28abs ↗pdf ↗

We present an extension to the model-free anomaly detection algorithm, Isolation Forest. This extension, named Extended Isolation Forest (EIF), resolves issues with assignment of anomaly score to given data points. We motivate the problem using heat maps for anomaly scores. These maps suffer from artifacts generated by…

2018-11-06abs ↗pdf ↗

Proposes a method to detect anomalies in financial time series using PCA and neural networks.

problem Anomalies in financial time series lead to miscalibrated risk models.
method Extract features using PCA, define anomaly score with neural network, calibrate cutoff value.
result The proposed PCA NN approach outperforms other anomaly detection methods.

We consider the problem of finding anomalies in high-dimensional data using popular PCA based anomaly scores. The naive algorithms for computing these scores explicitly compute the PCA of the covariance matrix which uses space quadratic in the dimensionality of the data. We give the first streaming algorithms that use …

2018-04-09abs ↗pdf ↗

Anomalies in time-series data give essential and often actionable information in many applications. In this paper we consider a model-free anomaly detection method for univariate time-series which adapts to non-stationarity in the data stream and provides probabilistic abnormality scores based on the conformal predicti…

2017-06-11abs ↗pdf ↗