Recent semi-supervised anomaly detection methods that are trained using small labeled anomaly examples and large unlabeled data (mostly normal data) have shown largely improved performance over unsupervised methods. However, these methods often focus on fitting abnormalities illustrated by the given anomaly examples on…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “anomaly prediction”
Topological anomaly scores predict return curves in S&P 500 stocks
problem Detecting anomalies in financial time series
method BallMapper, decoder-conditional VAE, Function-on-Function regression
result Anomaly history carries predictive content for return curves
We develop a supervised machine learning model that detects anomalies in systems in real time. Our model processes unbounded streams of data into time series which then form the basis of a low-latency anomaly detection model. Moreover, we extend our preliminary goal of just anomaly detection to simultaneous anomaly pre…
Call Detail Records Driven Anomaly Detection and Traffic Prediction in Mobile Cellular Networkscs.LG
Mobile networks possess information about the users as well as the network. Such information is useful for making the network end-to-end visible and intelligent. Big data analytics can efficiently analyze user and network information, unearth meaningful insights with the help of machine learning tools. Utilizing big da…
ECAD detects anomalies without data exchangeability, improving traffic flow detection.
problem Detecting anomalies in spatio-temporal data with missing values.
method ECAD uses conformal prediction to wrap around any regression algorithm, controlling Type-I error without data exchangeability.
result ECAD outperforms other methods in detecting anomalous traffic flow.
Mechanical devices such as engines, vehicles, aircrafts, etc., are typically instrumented with numerous sensors to capture the behavior and health of the machine. However, there are often external factors or variables which are not captured by sensors leading to time-series which are inherently unpredictable. For insta…
Anomalies in time-series data give essential and often actionable information in many applications. In this paper we consider a model-free anomaly detection method for univariate time-series which adapts to non-stationarity in the data stream and provides probabilistic abnormality scores based on the conformal predicti…
Study detects anomalies in robot vision data to predict hazards.
problem Detecting unexpected hazards in robot exploration data.
method Anomaly detection using autoencoders at different scales.
result Autoencoders improve anomaly detection performance on diverse robot scenarios.
Anomaly-aware forecast improves accuracy for extreme events.
problem Challenges in automatically detecting and learning from extreme events and anomalies in large-scale datasets.
method Proposes an anomaly-aware forecast framework that automatically detects and incorporates anomalies using an attention mechanism and dynamic uncertainty optimization.
result Demonstrated superior accuracy and reduced uncertainty on three datasets with different types of anomalies.
Status prediction and anomaly detection are two fundamental tasks in automatic IT systems monitoring. In this paper, a joint model Predictor & Anomaly Detector (PAD) is proposed to address these two issues under one framework. In our design, the variational auto-encoder (VAE) and long short-term memory (LSTM) are joine…
Research predicts XRP price anomalies using graph topologies.
problem Forecasting extreme price movements in XRP cryptoasset.
method Analyzed topological features of XRP transaction graphs.
result Topological features indicate extreme price surges.
AER combines auto-encoder and LSTM for better time series anomaly detection.
problem Anomaly detection in time series data with limited labeled data and ambiguous definitions.
method AER (Auto-Encoder with Regression) integrates auto-encoder and LSTM for joint predictions and reconstructions.
result AER achieves the highest F1 score across 12 datasets with comparable runtime.
Bayesian autoencoders quantify anomaly uncertainty for safer machine learning.
problem Lack of uncertainty quantification in autoencoders for anomaly detection.
method Formulated Bayesian autoencoders to quantify epistemic and aleatoric anomalies.
result Demonstrated effectiveness of BAEs on benchmark and real datasets.
New method detects anomalies in computing centers' logs.
problem Anomaly detection in continuously changing log data for predictive maintenance.
method Evolving granular classifiers using Fuzzy-set-Based evolving Modeling and evolving Granular Neural Network.
result Classification model prioritizes maintenance based on anomaly severity.
CoCAI uses copulas for accurate multivariate time-series forecasting and anomaly detection.
problem Accurate multivariate time-series forecasting and robust anomaly detection.
method Copula-based conformal prediction for multivariate time-series analysis.
result CoCAI provides statistically valid predictive regions and robust anomaly scores.
STRIC detects anomalies in time series by analyzing residual signals.
problem Anomaly detection in multivariate time series data.
method End-to-end differentiable neural network architecture with Sequential Probability Ratio Test on residuals.
result STRIC outperforms state-of-the-art methods on multiple benchmarks.
In recent years, there have been many practical applications of anomaly detection such as in predictive maintenance, detection of credit fraud, network intrusion, and system failure. The goal of anomaly detection is to identify in the test data anomalous behaviors that are either rare or unseen in the training data. Th…
Proposes BA method for unbiased time series anomaly detection evaluation.
problem Anomalies in time series data are rare, making F1-score unreliable.
method Introduces Balanced Point Adjustment (BA) to address F1-score bias.
result BA provides fairer evaluation of time series anomaly detectors.
PPC detects anomalies in high-dimensional data efficiently.
problem Scalability issues and reduced performance with high-dimensional data.
method Probabilistic Predictive Coding (PPC) learns latent representations and predicts uncertainties.
result PPC achieves linear time complexity and high adaptability.
Method explains anomaly detection by generating normal modifications.
problem Complexity of deep learning methods in anomaly detection.
method Generates multiple alternative modifications for anomalies.
result High-quality semantic explanations provided for anomaly detection.
One-class Collective Anomaly Detection based on Long Short-Term Memory Recurrent Neural Networkscs.LG
Intrusion detection for computer network systems has been becoming one of the most critical tasks for network administrators today. It has an important role for organizations, governments and our society due to the valuable resources hosted on computer networks. Traditional misuse detection strategies are unable to det…
BayPrAnoMeta tackles few-shot industrial image anomaly detection with Bayesian methods.
problem Challenges in industrial image anomaly detection, especially class imbalance and scarcity of labeled samples.
method Bayesian Proto-MAML approach with probabilistic normality models and Bayesian posterior predictive likelihood.
result Consistent and significant AUROC improvements over existing methods in few-shot anomaly detection.
C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.
problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.
Google uses continuous streams of data from industry partners in order to deliver accurate results to users. Unexpected drops in traffic can be an indication of an underlying issue and may be an early warning that remedial action may be necessary. Detecting such drops is non-trivial because streams are variable and noi…
The paper proposes an on-line monitoring framework for continuous real-time safety/security in learning-based control systems (specifically application to a unmanned ground vehicle). We monitor validity of mappings from sensor inputs to actuator commands, controller-focused anomaly detection (CFAM), and from actuator c…
In this paper we address three main objections of behavioral finance to the theory of rational finance, considered as anomalies the theory of rational finance cannot explain: Predictability of asset returns, The Equity Premium, (The Volatility Puzzle. We offer resolutions of those objections within the rational finance…
Develops probabilistic forecasting for Sea Level Anomalies using Conformal Prediction on functional time series.
problem Forecasting and uncertainty quantification for Sea Level Anomalies.
method Functional data analysis, Conformal Prediction, Functional Autoregressive Processes.
result Proposed method provides accurate probabilistic predictions and uncertainty quantification for Sea Level Anomalies.
Deep neural networks predict CVCM track circuit failures early.
problem Subtle anomalies in CVCM track circuits lead to failures, causing disruptions.
method Deep neural networks classify anomalies before they escalate.
result Deep neural networks achieve 99.31% overall accuracy in detecting CVCM failures.
New methods improve anomaly detection with reduced false positives.
problem Effective anomaly detection with controlled error rates.
method Leave-one-out-, bootstrap-, and cross-conformal anomaly detection methods.
result Improved anomaly detection with reduced false positives.
ReGEN-TAD detects anomalies in financial time series with interpretable models.
problem Detecting anomalies in complex financial time series with high-dimensional data.
method Integrates machine learning with econometric diagnostics in a refined convolutional--transformer architecture.
result Unified anomaly score without labeled data, robust to structured deviations.
CCE improves anomaly detection metrics by measuring both confidence and consistency.
problem Existing anomaly detection metrics lack discriminative power, hyperparameter dependency, and robustness to perturbations.
method CCE uses Bayesian estimation to quantify uncertainty and constructs global and event-level confidence and consistency scores.
result CCE demonstrates strict boundedness, robustness, and linear time complexity.
Machine-learned anomaly detection in new-physics searches needs calibration and look-elsewhere correction
problem Machine-learned anomaly detection in new-physics searches
method Conformal prediction layer
result Calibrated significance with distribution-free guarantees
TimeInf estimates data contribution in time series data, improving model performance and anomaly detection.
problem Estimating data contribution in time series datasets with temporal dependencies.
method Model-agnostic data contribution estimation method using influence scores.
result TimeInf effectively detects time series anomalies and outperforms existing methods.
Bayesian method estimates contamination factor for unsupervised anomaly detection.
problem No good methods for estimating contamination factor in unsupervised anomaly detection.
method Bayesian approach using mixture formulation of anomaly detector outputs.
result Estimated contamination factor distribution is well-calibrated and improves anomaly detection performance.
Paper uses ensemble learning for IoT cybersecurity anomaly detection.
problem Anomaly detection in IoT data is challenging due to heterogeneous device types.
method Bayesian hyperparameter optimisation for ensemble learning.
result Ensemble learning with Bayesian optimisation improves anomaly detection accuracy.
Advanced driver assistance systems (ADAS) can be significantly improved with effective driver action prediction (DAP). Predicting driver actions early and accurately can help mitigate the effects of potentially unsafe driving behaviors and avoid possible accidents. In this paper, we formulate driver action prediction a…
Mahalanobis distance detects anomalies well, but not for classification.
problem Detecting anomalies in neural classifier outputs.
method Analyzes Mahalanobis distance-based anomaly detection method, revealing its reliance on information not useful for classification.
result Combining Mahalanobis and ODIN methods improves anomaly detection performance and robustness.
OracleAD detects multivariate time series anomalies without labels.
problem Rare and unlabeled multivariate time series anomalies.
method OracleAD encodes past sequences into causal embeddings, projects them into a latent space, and identifies anomalies based on deviations from a stable latent structure.
result OracleAD achieves state-of-the-art results and is interpretable.
Proposes a fair deep anomaly detection method.
problem Ensuring fairness in deep anomaly detection.
method Adversarial network to de-correlate sensitive attributes and learned representations.
result Our approach largely removes unfairness with minimal anomaly detection performance loss.
Improved unsupervised anomaly detection using Random Forest.
problem Enhancing unsupervised anomaly detection accuracy.
method Training Random Forest to distinguish real and synthetic data, then applying transformed distances.
result Significant improvement in anomaly detection accuracy compared to other methods.
Midterm stock price prediction is crucial for value investments in the stock market. However, most deep learning models are essentially short-term and applying them to midterm predictions encounters large cumulative errors because they cannot avoid anomalies. In this paper, we propose a novel deep neural network Mid-LS…
We propose a novel non-parametric adaptive anomaly detection algorithm for high dimensional data based on rank-SVM. Data points are first ranked based on scores derived from nearest neighbor graphs on n-point nominal data. We then train a rank-SVM using this ranked data. A test-point is declared as an anomaly at alpha-…
ReRe detects anomalies in real-time for time series data.
problem Real-time anomaly detection for time series data requires human intervention or domain knowledge and high computation complexity.
method ReRe uses two lightweight LSTM models to predict and determine anomalies based on historical data and adaptive thresholds.
result ReRe detects anomalies in real-time without requiring human intervention or domain knowledge.
Paper proposes a hierarchical approach for early anomaly detection in time series data for critical health events.
problem Early detection of critical health events in intensive care units.
method A layered learning architecture that breaks the problem into pre-conditional and event layers.
result The proposed method outperforms state-of-the-art approaches for critical health episode prediction.
Online anomaly detection in surveillance videos with false alarm rate bounds.
problem Lack of theoretical performance analysis and online decision making in anomaly detection.
method Proposes an online anomaly detection method with asymptotic bounds on false alarm rate.
result Demonstrates effectiveness on publicly available data sets, outperforming state-of-the-art algorithms.
An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturingcs.LG
We present a novel unsupervised deep learning approach that utilizes the encoder-decoder architecture for detecting anomalies in sequential sensor data collected during industrial manufacturing. Our approach is designed not only to detect whether there exists an anomaly at a given time step, but also to predict what wi…
DoFlow models time series data for causal forecasting and anomaly detection.
problem Forecasting and causal reasoning in multivariate time series.
method Flow-based generative model over causal DAGs.
result Accurate interventional and counterfactual forecasting, anomaly detection.
RePAD detects anomalies in streaming time series data in real-time.
problem Real-time anomaly detection for time series data without human intervention.
method RePAD uses LSTM to predict anomalies based on short-term historic data.
result RePAD detects anomalies proactively and provides early warnings.