Improves anomaly detection with contaminated unlabeled data.
problem Weakness in existing semi-supervised anomaly detection methods when unlabeled data contain anomalies.
method Integrates positive-unlabeled learning with deep anomaly detection models.
result Achieves better detection performance on various datasets.
End-to-end anomaly detection framework using labeled anomalies.
problem Limited deep learning for anomaly detection and inefficiency of existing methods.
method Deviation learning neural network with labeled anomalies and prior probability.
result Significantly better anomaly scoring than state-of-the-art methods.
Paper proposes RAN for better anomaly detection in time series data.
problem Anomaly detection algorithms often fail to accurately detect anomalies due to incomplete reconstruction of anomaly data.
method RAN uses adversarial learning and latent vector-constrained Autoencoder to ensure consistent reconstruction of anomaly data.
result RAN outperforms other algorithms in detecting meaningful anomalies with higher AUC-ROC scores.
Deep RL detects anomalies from few labeled examples and large unlabeled data.
problem Anomaly detection with limited labeled data and large unlabeled data.
method Deep reinforcement learning to optimize detection of labeled and unlabeled anomalies.
result Significantly outperforms state-of-the-art methods on 48 real-world datasets.
FAMDAD detects anomalies in mixed data using kurtosis-weighted Factor Analysis.
problem Detecting anomalies in high-dimensional mixed data.
method kurtosis-weighted Factor Analysis of Mixed Data (FAMDAD).
result Anomalies are highly separable in the first and last few dimensions of the FAMDAD embedding.
New anomaly estimator reduces bias in MLE for normally distributed data.
problem Bias in Maximum Likelihood Estimation of structured anomalies.
method Derive a new anomaly estimator using a mixture model.
result New estimator is asymptotically unbiased regardless of anomaly family size.
Recent semi-supervised anomaly detection methods that are trained using small labeled anomaly examples and large unlabeled data (mostly normal data) have shown largely improved performance over unsupervised methods. However, these methods often focus on fitting abnormalities illustrated by the given anomaly examples on…
Detects anomalies without training data using deep learning.
problem Detect anomalies in data without labeled training data.
method Inverse Generative Adversarial Network (GAN) for semi-supervised learning.
result Successfully detects anomalies in data without labeled training data.
We propose the Autoencoding Binary Classifiers (ABC), a novel supervised anomaly detector based on the Autoencoder (AE). There are two main approaches in anomaly detection: supervised and unsupervised. The supervised approach accurately detects the known anomalies included in training data, but it cannot detect the unk…
Study identifies high-density anomalies in normal data regions.
problem Detecting anomalies in normal data regions.
method Introduces non-parametric algorithmic frameworks for unsupervised detection.
result IPP framework yields the best detection results.
Paper introduces an unsupervised tensor-based anomaly detection method for spatiotemporal data.
problem Challenges in detecting anomalies in spatiotemporal data, especially in urban traffic monitoring and medical imaging.
method Formulates anomaly detection as a regularized robust low-rank + sparse tensor decomposition, incorporating spatiotemporal smoothness and local dependencies.
result Demonstrates improved anomaly detection performance on both synthetic and real data.
Anomaly detection for high-dimensional data using large deviations principle.
problem Challenges in anomaly detection for high-dimensional data.
method Large Deviations Anomaly Detection (LAD) algorithm.
result Outperforms state-of-the-art methods on high-dimensional data sets.
Enhances deep learning models for anomaly detection in time series data.
problem Anomalies in time series data corrupt performance of models.
method Monte Carlo EM for inferring anomaly indicators during training.
result Improves model performance on nominal data and anomalous points.
ACE explains security anomaly detection models through feature contributions.
problem Understanding which features contribute to security anomalies.
method Regression framework to locally approximate anomaly scores.
result Identifies correct contributing features in synthetic data and real data.
AEGR method improves anomaly detection in autoencoders without needing anomaly-free training data.
problem Challenges in anomaly detection, especially high dimensionality and noise in training sets.
method Gradient-reversal method for autoencoders, using reconstruction error and Local Outlier Factor.
result The proposed AEGR model outperforms other methods in detecting network anomalies.
Study examines how discretization affects anomaly detection in datasets.
problem Detecting six types of anomalies in datasets using different discretization methods.
method Conducted experiments with SECODA, a general-purpose algorithm for unsupervised anomaly detection.
result Different discretization methods favor the discovery of certain anomaly types.
Mobile networks possess information about the users as well as the network. Such information is useful for making the network end-to-end visible and intelligent. Big data analytics can efficiently analyze user and network information, unearth meaningful insights with the help of machine learning tools. Utilizing big da…
Deep Autoencoder outperforms in anomaly detection for building energy data.
problem Automated detection of faulty data in learning applications.
method Training and comparison of Simple, Deep, and Supervised Deep Autoencoders on ASHRAE building energy dataset.
result Supervised Deep Autoencoder outperforms in total anomalies detected.
An algorithm detects anomalies based on human perception principles.
problem Anomaly detection in data.
method Inspired by Gestalt psychology and Helmholtz principle, the algorithm models anomalies as unexpected elements in random distributions.
result The algorithm efficiently detects anomalies with minimal user intervention and promising results on multivariate data.
IDK improves anomaly detection for points and groups without explicit learning.
problem Anomaly detection for points and groups using kernel methods.
method Isolation Distributional Kernel (IDK) addresses data independence and intractable dimensionality issues.
result IDK outperforms existing methods for both point and group anomaly detection.
Proposes OCGNN for detecting anomalies in graph data.
problem Detecting anomalies in graph-structured data.
method One Class Graph Neural Network (OCGNN) combining Graph Neural Networks and one-class classification.
result Significant improvements in anomaly detection compared to baselines.
Time series data is ubiquitous in the real-world problems across various domains including healthcare, social media, and crime surveillance. Detecting anomalies, or irregular and rare events, in time series data, can enable us to find abnormal events in any natural phenomena, which may require special treatment. Moreov…
ECAD detects anomalies without data exchangeability, improving traffic flow detection.
problem Detecting anomalies in spatio-temporal data with missing values.
method ECAD uses conformal prediction to wrap around any regression algorithm, controlling Type-I error without data exchangeability.
result ECAD outperforms other methods in detecting anomalous traffic flow.
A new method optimizes anomaly scoring from score distribution to improve AD performance.
problem Vulnerability to anomaly contamination and lack of adaptability in existing AD methods.
method Optimizes anomaly scoring function from score distribution perspective, using Overlap loss.
result Overlap loss-based AD models significantly outperform state-of-the-art methods.
TAMA uses LMMs to detect and interpret anomalies in time series data with few labels.
problem Challenges in manual feature engineering and extensive labeled training data for TSAD.
method Leverages LMMs to convert time series into visual formats for few-shot in-context learning.
result Consistently outperforms state-of-the-art methods in TSAD tasks.
Anomaly detection is a classical problem where the aim is to detect anomalous data that do not belong to the normal data distribution. Current state-of-the-art methods for anomaly detection on complex high-dimensional data are based on the generative adversarial network (GAN). However, the traditional GAN loss is not d…
Deep autoencoder detects anomalies in wastewater sensor data.
problem Anomaly detection in in-situ wastewater sensor data.
method 1D Convolutional Neural Network (CNN) autoencoder for anomaly detection.
result Validation on in-sewer process monitoring data shows effective anomaly detection.
MEMGAN uses memory to improve anomaly detection by isolating abnormal data.
problem Weak guarantees for detecting anomalous data in classical algorithms.
method Memory-augmented Generative Adversarial Networks (MEMGAN) with a memory module.
result MEMGAN provides strong guarantees for anomaly detection with improved reconstruction.
Paper describes anomaly detection and explainability for multivariate functional data.
problem Anomaly detection and explainability in multivariate functional data.
method Transform series into features, use Isolation Forest, compute SHAP coefficients, and use supervised decision tree.
result Method performs well on simulated and real industry data.
AnomalyCD discovers anomaly causes in large systems with binary flags, reducing computational burden.
problem Learning graphical causal models from large-scale binary anomaly data is computationally expensive.
method AnomalyCD uses anomaly data-aware causality testing, sparse data compression, and edge pruning.
result AnomalyCD reduces computation overhead and improves accuracy on binary anomaly datasets.
Improved unsupervised anomaly detection using Random Forest.
problem Enhancing unsupervised anomaly detection accuracy.
method Training Random Forest to distinguish real and synthetic data, then applying transformed distances.
result Significant improvement in anomaly detection accuracy compared to other methods.
A framework combines unsupervised and semi-supervised AD using synthetic anomalies.
problem Improving anomaly detection in both unsupervised and semi-supervised settings.
method Proposes a new framework that uses both known and synthetic anomalies for training.
result Synthetic anomalies improve anomaly modeling in low-density regions and provide optimal convergence guarantees.
System states that are anomalous from the perspective of a domain expert occur frequently in some anomaly detection problems. The performance of commonly used unsupervised anomaly detection methods may suffer in that setting, because they use frequency as a proxy for anomaly. We propose a novel concept for anomaly dete…
RAD detects anomalies in unreliable data streams with up to 98% accuracy.
problem Anomaly detection in unreliable data sources.
method Two-layer on-line learning framework with data cleansing and oracle learning.
result RAD improves anomaly detection accuracy by up to 28%.
TAnoGan detects anomalies in time series data using GANs.
problem Anomaly detection in time series data.
method Generative Adversarial Networks (GAN) for unsupervised anomaly detection.
result TAnoGan outperforms traditional and neural network models in anomaly detection.
Automated anomaly detection is essential for managing information and communications technology (ICT) systems to maintain reliable services with minimum burden on operators. For detecting varying and continually emerging anomalies as differences from normal states, learning normal relationships inherent among cross-dom…
Survey evaluates 20 anomaly detection methods for time-series data.
problem Comparing statistical, machine learning, and deep learning methods for anomaly detection.
method Comprehensive evaluation of 20 methods from three categories on public datasets.
result Provides insights into the performance and suitability of anomaly detection methods.
A new method for detecting anomalies in large, high-dimensional data streams using probabilistic forest models.
problem Challenges in detecting anomalies in large, high-dimensional data.
method Probabilistic Mondrian Pólya Forests for summarizing data and estimating underlying probability density.
result State-of-the-art performance with interpretable anomaly scores.
Hashing detects anomalies in structured data efficiently.
problem Identifying non-conforming samples on low-dimensional manifolds.
method Locality Sensitive Hashing in Preference Space.
result State-of-the-art performance at lower computational cost.
Paper proposes a method to generate synthetic anomalies for robust anomaly detection.
problem Anomaly detection struggles with unbalanced data and rare anomalies.
method Two-level hierarchical latent space representation for feature distillation and synthesis.
result The method creates robust synthetic anomalies for training robust binary classifiers.
Proposes a method to detect anomalies in multi-subgroup normal data.
problem Anomaly detection with limited labeled anomalies and multi-subgroup normal data.
method Learn multi-normal prototypes with deep embedding clustering and contrastive learning. Estimate the likelihood of unlabeled samples being normal during training.
result Superior performance compared to state-of-the-art methods on various datasets.
MIAEAD detects anomalies in mixed data types.
problem Challenges of heterogeneity in feature subsets for anomaly detection.
method Multiple-Input Variational Auto-Encoder (MIVAE) for simultaneous feature subset anomaly scoring.
result MIVAE outperforms conventional methods and state-of-the-art unsupervised models in AUC score.
Most current clustering based anomaly detection methods use scoring schema and thresholds to classify anomalies. These methods are often tailored to target specific data sets with "known" number of clusters. The paper provides a streaming clustering and anomaly detection algorithm that does not require strict arbitrary…
A new model classifies surface anomalies in 3D point cloud data.
problem Accurate classification of surface anomalies in manufacturing processes.
method Deep subspace learning approach for 3D point cloud data.
result The method effectively identifies new types of anomalies.
Study proposes using auxiliary classification to improve unsupervised anomaly detection.
problem Challenging anomaly detection in high-dimensional data.
method Use of an auxiliary classification task to extract features from unlabelled data by supervised learning.
result Our feature learning approach yields best anomaly detection performance.
ARGUE combines expert networks for anomaly detection.
problem Anomaly detection without labeled data.
method Gated mixture-of-experts architecture combining expert networks.
result Prior knowledge about normal data distribution is valuable.
Generative adversarial networks have been able to generate striking results in various domains. This generation capability can be general while the networks gain deep understanding regarding the data distribution. In many domains, this data distribution consists of anomalies and normal data, with the anomalies commonly…
iMondrian forest combines isolation forest and Mondrian forest for better anomaly detection.
problem Anomaly detection in batch and online settings.
method Hybrid of isolation forest and Mondrian forest, using depth in Mondrian forest structure.
result iMondrian forest outperforms existing methods in batch and online settings.