Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

2945898831,177 · Jun 202019922001200920172026
48 results for data anomaly detection

Improves anomaly detection with contaminated unlabeled data.

problem Weakness in existing semi-supervised anomaly detection methods when unlabeled data contain anomalies.
method Integrates positive-unlabeled learning with deep anomaly detection models.
result Achieves better detection performance on various datasets.

Paper proposes RAN for better anomaly detection in time series data.

problem Anomaly detection algorithms often fail to accurately detect anomalies due to incomplete reconstruction of anomaly data.
method RAN uses adversarial learning and latent vector-constrained Autoencoder to ensure consistent reconstruction of anomaly data.
result RAN outperforms other algorithms in detecting meaningful anomalies with higher AUC-ROC scores.

ECAD detects anomalies without data exchangeability, improving traffic flow detection.

problem Detecting anomalies in spatio-temporal data with missing values.
method ECAD uses conformal prediction to wrap around any regression algorithm, controlling Type-I error without data exchangeability.
result ECAD outperforms other methods in detecting anomalous traffic flow.

Study examines how discretization affects anomaly detection in datasets.

problem Detecting six types of anomalies in datasets using different discretization methods.
method Conducted experiments with SECODA, a general-purpose algorithm for unsupervised anomaly detection.
result Different discretization methods favor the discovery of certain anomaly types.

INCAD clusters and detects anomalies in streaming data without thresholds.

problem Clustering and anomaly detection for streaming data with unknown clusters and thresholds.
method Probabilistic clustering and anomaly detection in a streaming model.
result More reliable definition of normal vs abnormal behavior in streaming data.

MEMGAN uses memory to improve anomaly detection by isolating abnormal data.

problem Weak guarantees for detecting anomalous data in classical algorithms.
method Memory-augmented Generative Adversarial Networks (MEMGAN) with a memory module.
result MEMGAN provides strong guarantees for anomaly detection with improved reconstruction.

Paper introduces an unsupervised tensor-based anomaly detection method for spatiotemporal data.

problem Challenges in detecting anomalies in spatiotemporal data, especially in urban traffic monitoring and medical imaging.
method Formulates anomaly detection as a regularized robust low-rank + sparse tensor decomposition, incorporating spatiotemporal smoothness and local dependencies.
result Demonstrates improved anomaly detection performance on both synthetic and real data.

AEGR method improves anomaly detection in autoencoders without needing anomaly-free training data.

problem Challenges in anomaly detection, especially high dimensionality and noise in training sets.
method Gradient-reversal method for autoencoders, using reconstruction error and Local Outlier Factor.
result The proposed AEGR model outperforms other methods in detecting network anomalies.

We propose the Autoencoding Binary Classifiers (ABC), a novel supervised anomaly detector based on the Autoencoder (AE). There are two main approaches in anomaly detection: supervised and unsupervised. The supervised approach accurately detects the known anomalies included in training data, but it cannot detect the unk…

2019-03-26abs ↗pdf ↗

Survey evaluates 20 anomaly detection methods for time-series data.

problem Comparing statistical, machine learning, and deep learning methods for anomaly detection.
method Comprehensive evaluation of 20 methods from three categories on public datasets.
result Provides insights into the performance and suitability of anomaly detection methods.

Deep RL detects anomalies from few labeled examples and large unlabeled data.

problem Anomaly detection with limited labeled data and large unlabeled data.
method Deep reinforcement learning to optimize detection of labeled and unlabeled anomalies.
result Significantly outperforms state-of-the-art methods on 48 real-world datasets.

Time series data is ubiquitous in the real-world problems across various domains including healthcare, social media, and crime surveillance. Detecting anomalies, or irregular and rare events, in time series data, can enable us to find abnormal events in any natural phenomena, which may require special treatment. Moreov…

2019-06-12abs ↗pdf ↗

System states that are anomalous from the perspective of a domain expert occur frequently in some anomaly detection problems. The performance of commonly used unsupervised anomaly detection methods may suffer in that setting, because they use frequency as a proxy for anomaly. We propose a novel concept for anomaly dete…

2016-05-12abs ↗pdf ↗

Enhanced neural networks detect thin boundaries between different types of anomalies.

problem Detecting thin boundaries between different types of anomalies in outlier detection.
method Defined new types of anomalies, enhanced Multi-Layer Perceptron Neural Network with Genetic Algorithm.
result Reduced error in anomaly detection compared to baseline methods.

Paper describes anomaly detection and explainability for multivariate functional data.

problem Anomaly detection and explainability in multivariate functional data.
method Transform series into features, use Isolation Forest, compute SHAP coefficients, and use supervised decision tree.
result Method performs well on simulated and real industry data.

Study proposes using auxiliary classification to improve unsupervised anomaly detection.

problem Challenging anomaly detection in high-dimensional data.
method Use of an auxiliary classification task to extract features from unlabelled data by supervised learning.
result Our feature learning approach yields best anomaly detection performance.

InQMAD detects anomalies in streaming data using quantum measurements and density matrices.

problem Detecting anomalies in streaming data with challenges like conceptual drift and continuous learning.
method Incremental anomaly detection based on random Fourier features and quantum measurements.
result InQMAD outperforms 12 state-of-the-art methods in a systematic evaluation.

Anomaly detection is a classical problem where the aim is to detect anomalous data that do not belong to the normal data distribution. Current state-of-the-art methods for anomaly detection on complex high-dimensional data are based on the generative adversarial network (GAN). However, the traditional GAN loss is not d…

2019-04-02abs ↗pdf ↗

Survey on LSTM-based anomaly detection for technical systems.

problem Detect anomalies in technical systems due to complex dynamics.
method Use LSTM networks and other AI techniques to detect anomalies considering temporal and contextual characteristics.
result Demonstrates the potential of LSTM networks and graph-based approaches for anomaly detection.

An algorithm detects anomalies based on human perception principles.

problem Anomaly detection in data.
method Inspired by Gestalt psychology and Helmholtz principle, the algorithm models anomalies as unexpected elements in random distributions.
result The algorithm efficiently detects anomalies with minimal user intervention and promising results on multivariate data.

Anomaly detection is a significant and hence well-studied problem. However, developing effective anomaly detection methods for complex and high-dimensional data remains a challenge. As Generative Adversarial Networks (GANs) are able to model the complex high-dimensional distributions of real-world data, they offer a pr…

2018-12-06abs ↗pdf ↗

IDK improves anomaly detection for points and groups without explicit learning.

problem Anomaly detection for points and groups using kernel methods.
method Isolation Distributional Kernel (IDK) addresses data independence and intractable dimensionality issues.
result IDK outperforms existing methods for both point and group anomaly detection.

TAMA uses LMMs to detect and interpret anomalies in time series data with few labels.

problem Challenges in manual feature engineering and extensive labeled training data for TSAD.
method Leverages LMMs to convert time series into visual formats for few-shot in-context learning.
result Consistently outperforms state-of-the-art methods in TSAD tasks.

A new method for detecting anomalies in large, high-dimensional data streams using probabilistic forest models.

problem Challenges in detecting anomalies in large, high-dimensional data.
method Probabilistic Mondrian Pólya Forests for summarizing data and estimating underlying probability density.
result State-of-the-art performance with interpretable anomaly scores.

Correlated anomaly detection (CAD) from streaming data is a type of group anomaly detection and an essential task in useful real-time data mining applications like botnet detection, financial event detection, industrial process monitor, etc. The primary approach for this type of detection in previous researches is base…

2018-12-19abs ↗pdf ↗

ReRe detects anomalies in real-time for time series data.

problem Real-time anomaly detection for time series data requires human intervention or domain knowledge and high computation complexity.
method ReRe uses two lightweight LSTM models to predict and determine anomalies based on historical data and adaptive thresholds.
result ReRe detects anomalies in real-time without requiring human intervention or domain knowledge.

Paper proposes an online anomaly detection method for real-time systems.

problem Rare events endanger profitability, safety, and environmental aspects.
method Online inverse cumulative distribution-based approach with dynamic process limits.
result Eliminates common problems of offline anomaly detectors and provides low-latency detection.