ECAD detects anomalies without data exchangeability, improving traffic flow detection.
problem Detecting anomalies in spatio-temporal data with missing values.
method ECAD uses conformal prediction to wrap around any regression algorithm, controlling Type-I error without data exchangeability.
result ECAD outperforms other methods in detecting anomalous traffic flow.
New algorithm detects changes in high-dimensional data with mean and variance.
problem Challenges in detecting changes in high-dimensional data with mean and variance.
method Complete graph-based approach to detect changes of mean and variance from low to high-dimensional online data.
result The proposed method outperforms existing methods in terms of detection power.
Improves anomaly detection with contaminated unlabeled data.
problem Weakness in existing semi-supervised anomaly detection methods when unlabeled data contain anomalies.
method Integrates positive-unlabeled learning with deep anomaly detection models.
result Achieves better detection performance on various datasets.
Anomaly detection for high-dimensional data using large deviations principle.
problem Challenges in anomaly detection for high-dimensional data.
method Large Deviations Anomaly Detection (LAD) algorithm.
result Outperforms state-of-the-art methods on high-dimensional data sets.
This review examines techniques for detecting anomalies in time series data.
problem Detecting anomalies in time series data.
method Taxonomy based on main aspects of outlier detection techniques.
result Structured and comprehensive state-of-the-art on outlier detection techniques in time series.
Novelty detection is the unsupervised problem of identifying anomalies in test data which significantly differ from the training set. Novelty detection is one of the classic challenges in Machine Learning and a core component of several research areas such as fraud detection, intrusion detection, medical diagnosis, dat…
NN-CUSUM detects changes in high-dimensional data using neural networks.
problem Detecting abrupt changes in high-dimensional data.
method Neural network-based CUSUM for online change-point detection.
result NN-CUSUM performs well in detecting changes in high-dimensional data.
This research identifies flaws in drift detection methods and creates adversarial data streams to exploit them.
problem The challenge of detecting data distribution changes (drift) in real-time systems.
method Developed adversarial data streams to show weaknesses in existing drift detection schemes.
result Demonstrated that common drift detection methods can be fooled by adversarial data streams.
Proposes OCGNN for detecting anomalies in graph data.
problem Detecting anomalies in graph-structured data.
method One Class Graph Neural Network (OCGNN) combining Graph Neural Networks and one-class classification.
result Significant improvements in anomaly detection compared to baselines.
Real-time fuel leakage detection framework MOCPD improves accuracy.
problem Early detection of fuel leakage to prevent hazards and losses.
method Memory-based Online Change Point Detection (MOCPD) framework.
result MOCPD outperforms baseline methods in detection accuracy.
MEMGAN uses memory to improve anomaly detection by isolating abnormal data.
problem Weak guarantees for detecting anomalous data in classical algorithms.
method Memory-augmented Generative Adversarial Networks (MEMGAN) with a memory module.
result MEMGAN provides strong guarantees for anomaly detection with improved reconstruction.
Detects data drift in deep learning models using neural embeddings.
problem Detecting changes in data distribution in deep learning models.
method Formulates drift detection in a sequential decision framework and introduces a loss function to balance false alarms and quick detection.
result Demonstrates improved ability to balance false alarms and quick detection in change detection.
MSTREAM detects anomalies in multi-aspect data streams.
problem Detecting unusual group anomalies in dynamic multi-aspect data.
method Online streaming multi-aspect anomaly detection framework.
result MSTREAM outperforms state-of-the-art baselines.
LLmFPCA-detect detects anomalies in sparse longitudinal text data using LLMs and mFPCA.
problem Challenges in detecting patterns and anomalies in sparse longitudinal textual data.
method Pairs LLM-based text embeddings with mFPCA to detect clusters and anomalies.
result LLmFPCA-detect outperforms state-of-the-art baselines on Amazon and Wikipedia datasets.
Study examines how discretization affects anomaly detection in datasets.
problem Detecting six types of anomalies in datasets using different discretization methods.
method Conducted experiments with SECODA, a general-purpose algorithm for unsupervised anomaly detection.
result Different discretization methods favor the discovery of certain anomaly types.
FAMDAD detects anomalies in mixed data using kurtosis-weighted Factor Analysis.
problem Detecting anomalies in high-dimensional mixed data.
method kurtosis-weighted Factor Analysis of Mixed Data (FAMDAD).
result Anomalies are highly separable in the first and last few dimensions of the FAMDAD embedding.
Detects changes in classifier scores to identify shifts in class priors.
problem Label shift changes in classification data.
method Sequential changepoint detection of classifier scores.
result Outperforms other detection procedures in label shift settings.
Paper describes anomaly detection and explainability for multivariate functional data.
problem Anomaly detection and explainability in multivariate functional data.
method Transform series into features, use Isolation Forest, compute SHAP coefficients, and use supervised decision tree.
result Method performs well on simulated and real industry data.
Deep semi-supervised anomaly detection improves fraud detection in financial markets.
problem Detecting fraud in high-frequency financial data with limited labeled examples.
method Evaluation of Deep Semi-Supervised Anomaly Detection (Deep SAD) on proprietary limit order book data.
result Deep SAD significantly improves fraud detection accuracy with minimal labeled data.
Correlated anomaly detection (CAD) from streaming data is a type of group anomaly detection and an essential task in useful real-time data mining applications like botnet detection, financial event detection, industrial process monitor, etc. The primary approach for this type of detection in previous researches is base…
AUCRSS detects change points in partially observed multivariate autocorrelated data.
problem Detecting change points in multivariate autocorrelated data with limited sensing resources.
method Adaptive Upper Confidence Region (AUCRSS) with state space model (SSM), adaptive sampling policy, and generalized likelihood ratio test.
result The method outperforms existing approaches in detecting change points efficiently.
Unsupervised model detects healthcare fraud from patient visit data.
problem Detecting fraudulent healthcare bills from patient visit data.
method Uses LSTM and seq2seq models for anomaly detection, normalizes scores with EDF.
result Improves anomaly detection for high class imbalance problems.
Deep learning generates efficient change-point detection methods.
problem Detecting change-points in data with various types of change and data behavior.
method Train a neural network to automatically generate detection methods.
result Neural network-based methods are competitive and outperform standard methods in various noise conditions.
A contaminated mixture model detects outliers in multivariate functional data.
problem Detecting abnormal sensor measurements in multivariate functional data.
method A contaminated mixture model that clusters and detects outliers without specifying outlier proportion.
result The model outperforms competitors and correctly detects abnormal behaviors in real data.
PERCEPT detects changes in high-dimensional data streams using topological data analysis.
problem Detecting changes in high-dimensional data streams, especially when embedded in a low-dimensional space.
method Leverages topological data analysis to learn embedded topology as a point cloud via persistence diagrams, then applies non-parametric monitoring for detecting changes.
result Demonstrates efficient detection of online changes from high-dimensional data streams.
This paper combines data-driven and model-driven methods for real-time misinformation detection. Our algorithm, named QuickStop, is an optimal stopping algorithm based on a probabilistic information spreading model obtained from labeled data. The algorithm consists of an offline machine learning algorithm for learning …
HADES detects data singularities quickly and accurately.
problem Detecting singularities in data efficiently.
method Kernel goodness-of-fit test based on differential geometry and optimal transport theory.
result Correctly detects singularities with high probability.
We address the problem of detecting changes in multivariate datastreams, and we investigate the intrinsic difficulty that change-detection methods have to face when the data dimension scales. In particular, we consider a general approach where changes are detected by comparing the distribution of the log-likelihood of …
TADA detects anomalies in time series using topological data analysis.
problem Detecting global changes in dependency structure between channels in multivariate time series.
method Topological Data Analysis for detecting anomalies in multivariate time series.
result The approach is more suitable for detecting global changes of correlation structures than existing methods.
Develops a method to detect changes in linear systems with temporal correlations.
problem Detect abrupt changes in time series data with temporal correlations.
method Data-dependent threshold for online change point detection in linear dynamical systems.
result Achieves a pre-specified upper bound on the probability of false alarms and provides a finite-sample-based bound for detection probability.
Deep Autoencoder outperforms in anomaly detection for building energy data.
problem Automated detection of faulty data in learning applications.
method Training and comparison of Simple, Deep, and Supervised Deep Autoencoders on ASHRAE building energy dataset.
result Supervised Deep Autoencoder outperforms in total anomalies detected.
A framework is proposed to detect anomalies in multi-modal data. A deep neural network-based object detector is employed to extract counts of objects and sub-events from the data. A cyclostationary model is proposed to model regular patterns of behavior in the count sequences. The anomaly detection problem is formulate…
TAnoGan detects anomalies in time series data using GANs.
problem Anomaly detection in time series data.
method Generative Adversarial Networks (GAN) for unsupervised anomaly detection.
result TAnoGan outperforms traditional and neural network models in anomaly detection.
NECO detects out-of-distribution data using neural collapse properties.
problem Detecting out-of-distribution data in machine learning models.
method NECO leverages neural collapse geometric properties to identify OOD data.
result NECO achieves state-of-the-art results on OOD detection tasks.
EMODM detects abnormal patterns in complex systems.
problem Detecting abnormal patterns in complex systems.
method Probabilistic models and statistical algorithms.
result EMODM detects abnormal patterns in real-time raw data.
Generative Adversarial Networks create synthetic data for structural damage detection.
problem Data scarcity in structural damage detection.
method 1-D Wasserstein Deep Convolutional Generative Adversarial Networks (1-D WDCGAN-GP) for synthetic data generation.
result Generated synthetic data improves damage detection accuracy in 1-D Deep Convolutional Neural Networks.
Paper investigates learnability of OOD detection under various conditions.
problem Learnability of OOD detection under different scenarios.
method Investigates PAC learning theory, proves impossibility theorems, and provides necessary and sufficient conditions.
result Some conditions for learnability of OOD detection may not hold in practical scenarios.
CDSSD detects sparse changes in partially observable data streams.
problem Online change detection of sparse changes in partially observable high-dimensional data streams.
method Smooth-sparse decomposition, spike-slab variational Bayesian inference, adaptive sampling via Thompson sampling.
result CDSSD effectively detects sparse changes in partially observable data streams.
We introduce a new unsupervised anomaly detection ensemble called SPI which can harness privileged information - data available only for training examples but not for (future) test examples. Our ideas build on the Learning Using Privileged Information (LUPI) paradigm pioneered by Vapnik et al. [19,17], which we extend …
PyODDS automates outlier detection for new data sources.
problem Manual outlier detection is inefficient and domain-specific.
method Automated end-to-end system with Apache Spark and database support.
result PyODDS optimizes outlier detection pipelines automatically.
Generates synthetic data for benchmarking unsupervised outlier detection.
problem Difficulty in benchmarking unsupervised outlier detection due to rare and varied outliers in real data.
method Proposes a generic process to generate synthetic data with insightful characteristics.
result Demonstrates practicality of the generic process through a benchmark with state-of-the-art detection methods.
Study identifies high-density anomalies in normal data regions.
problem Detecting anomalies in normal data regions.
method Introduces non-parametric algorithmic frameworks for unsupervised detection.
result IPP framework yields the best detection results.
Crowdsourced data helps detect incidents faster, balancing accuracy and practicality.
problem Detecting incidents from crowdsourced data is challenging due to noise and uncertainty.
method CROME (Crowdsourced Multi-objective Event Detection) uses CNN and Pareto optimization.
result The approach outperforms existing methods in incident detection and practicality.
Enhances network intrusion detection in noisy data.
problem Robustness against contaminated and noisy data inputs in network intrusion detection.
method Probabilistic Temporal Graph Network Support Vector Data Description (TGN-SVDD) model.
result Significant improvements in detection performance with synthetic noise.
CURIE uses cellular automata to detect concept drift in data streams.
problem Detecting changes in data distribution (concept drift) in data streams.
method CURIE represents data stream distribution in a cellular automata grid and uses its neighborhood rule to detect changes.
result CURIE, when hybridized with base learners, performs competitively in detection metrics and classification accuracy.
Automatic detection of anomalies in space- and time-varying measurements is an important tool in several fields, e.g., fraud detection, climate analysis, or healthcare monitoring. We present an algorithm for detecting anomalous regions in multivariate spatio-temporal time-series, which allows for spotting the interesti…
InQMAD detects anomalies in streaming data using quantum measurements and density matrices.
problem Detecting anomalies in streaming data with challenges like conceptual drift and continuous learning.
method Incremental anomaly detection based on random Fourier features and quantum measurements.
result InQMAD outperforms 12 state-of-the-art methods in a systematic evaluation.
Paper investigates OOD detection learnability under various conditions.
problem Learnability of OOD detection under diverse and unknown test data.
method PAC learning theory applied to OOD detection, proving impossibility theorems and necessary conditions.
result Some conditions for learnability hold in practical scenarios.