Identifying anomalous patterns in real-world data is essential for understanding where, when, and how systems deviate from their expected dynamics. Yet methods that separately consider the anomalousness of each individual data point have low detection power for subtle, emerging irregularities. Additionally, recent dete…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Anomalous Correlation Detection”
VAE improves anomaly detection for jet tagging at the LHC.
problem Anomaly detection in jet tagging at the LHC.
method Variational Autoencoder (VAE) trained on background QCD jets, with latent space learning for anomaly detection.
result Outlier Exposed VAE (OE-VAE) achieves excellent results in both sensitivity and decorrelation of jet mass.
Anomaly detection for high-dimensional data using large deviations principle.
problem Challenges in anomaly detection for high-dimensional data.
method Large Deviations Anomaly Detection (LAD) algorithm.
result Outperforms state-of-the-art methods on high-dimensional data sets.
MSTREAM detects anomalies in multi-aspect data streams.
problem Detecting unusual group anomalies in dynamic multi-aspect data.
method Online streaming multi-aspect anomaly detection framework.
result MSTREAM outperforms state-of-the-art baselines.
Paper detects anomalous edges in social networks using edge exchangeability.
problem Detecting anomalous edges in directed social networks.
method Exploits edge exchangeability and uses conformal prediction theory.
result Proposed anomaly detector has a guaranteed upper bound for false positives.
This work views neural networks as data generating systems and applies anomalous pattern detection techniques on that data in order to detect when a network is processing an anomalous input. Detecting anomalies is a critical component for multiple machine learning problems including detecting adversarial noise. More br…
Paper introduces kernel methods for detecting anomalous changes in remote sensing imagery.
problem Detecting anomalous changes in remote sensing imagery.
method Nonlinear extension of Gaussian and elliptically contoured distribution algorithms using reproducing kernel Hilbert space.
result Improved detection accuracy and reduced false-alarm rates compared to linear formulations.
We propose a nonparametric Bayesian probabilistic latent variable model for multi-view anomaly detection, which is the task of finding instances that have inconsistent views. With the proposed model, all views of a non-anomalous instance are assumed to be generated from a single latent vector. On the other hand, an ano…
Unsupervised anomaly detection aims to identify anomalous samples from highly complex and unstructured data, which is pervasive in both fundamental research and industrial applications. However, most existing methods neglect the complex correlation among data samples, which is important for capturing normal patterns fr…
DCASE 2021 ASD task tackles domain-shifted anomalous sound detection.
problem Detecting unknown anomalous sounds under domain-shifted conditions.
method Ensemble of outlier exposure and inlier modeling detectors, feature learning from machine identification.
result Two types of remarkable approaches were adopted by top teams.
We propose an algorithm for detecting patterns exhibited by anomalous clusters in high dimensional discrete data. Unlike most anomaly detection (AD) methods, which detect individual anomalies, our proposed method detects groups (clusters) of anomalies; i.e. sets of points which collectively exhibit abnormal patterns. I…
Paper introduces IAD for detecting anomalous VMMs in cloud without VMM access.
problem Anomalous VMMs in cloud-based environments without direct access.
method IAD: Indirect Anomalous VMMs Detection algorithm using VM resource utilization data.
result IAD algorithm outperforms other methods with an average F1-score of 83.7%.
We present an extension of sparse Canonical Correlation Analysis (CCA) designed for finding multiple-to-multiple linear correlations within a single set of variables. Unlike CCA, which finds correlations between two sets of data where the rows are matched exactly but the columns represent separate sets of variables, th…
In this paper, we investigate algorithms for anomaly detection. Previous anomaly detection methods focus on modeling the distribution of non-anomalous data provided during training. However, this does not necessarily ensure the correct detection of anomalous data. We propose a new Regularized Cycle Consistent Generativ…
Paper discusses ASD challenge for machine condition monitoring.
problem Detecting unknown anomalous sounds without labeled data.
method Design and evaluation of a large-scale ASD dataset, novel approaches.
result Several novel approaches developed, evaluation results analyzed.
Unsupervised Detection of Anomalous Sound based on Deep Learning and the Neyman-Pearson Lemmastat.ML
This paper proposes a novel optimization principle and its implementation for unsupervised anomaly detection in sound (ADS) using an autoencoder (AE). The goal of unsupervised-ADS is to detect unknown anomalous sound without training data of anomalous sound. Use of an AE as a normal model is a state-of-the-art techniqu…
Novel neural framework for scalable community detection and link prediction.
problem Efficiently learning graph topology and community structure in large graphs.
method Proposes a joint SBM loss function for community detection and link prediction, leveraging neural networks.
result Framework efficiently handles large graphs with a single forward pass, improving scalability and performance.
The nonparametric problem of detecting existence of an anomalous interval over a one dimensional line network is studied. Nodes corresponding to an anomalous interval (if exists) receive samples generated by a distribution q, which is different from the distribution p that generates samples for other nodes. If anomalou…
A new framework detects anomalous inputs to DNNs.
problem Detecting adversarial and out-of-distribution inputs in DNNs.
method Unsupervised meta-algorithm with configurable components based on statistical testing.
result The proposed method effectively detects adversarial and OOD inputs.
A wide variety of application domains are concerned with data consisting of entities and their relationships or connections, formally represented as graphs. Within these diverse application areas, a common problem of interest is the detection of a subset of entities whose connectivity is anomalous with respect to the r…
Extreme Learning Machine for the Characterization of Anomalous Diffusion from Single Trajectories (AnDi-ELM)physics.data-an
ELM combines machine learning and feature engineering for anomalous diffusion detection.
problem Quantitative characterization of anomalous diffusion from single trajectories.
method Extreme Learning Machine (ELM) combined with feature engineering.
result ELM achieves satisfactory performance in AnDi challenge tasks.
Paper uses DBSCAN variation to detect ship anomalies.
problem Detecting anomalous ship behavior.
method Variation of DBSCAN algorithm applied to AIS data.
result Alternative anomaly metric is more statistically informative.
Cliques, or fully connected subgraphs, are among the most important and well-studied graph motifs in network science. We consider the problem of finding a statisti- cally anomalous clique hidden in a large network. There are two parts to this problem: (1) detection, i.e., determining whether an anomalous clique is pres…
New method explains anomalies in multivariate time series data.
problem Understanding and explaining anomalies in multivariate time series data.
method Counterfactual reasoning applied to MDI-detected anomalous intervals.
result Our method accurately identifies and explains anomalies in various extreme events.
A new method detects anomalous sounds using self-supervised learning.
problem Detecting anomalous sounds in noisy data.
method Flow-based self-supervised density estimation using Normalizing Flows.
result The method improves anomaly detection performance significantly.
Study models systemic risks in BRICS banks under geopolitical shocks.
problem Systemic risks in BRICS banks under geopolitical shocks.
method Dynamic Time Warping, Temporal Graph Neural Network, Agent-Based Model.
result Geopolitical shocks cause more systemic damage than bank failures.
New index improves anomaly detection in correlated time series data.
problem Challenges in evaluating cluster quality for anomaly detection.
method Introduced Synchronized Anomaly Agreement Index (SAAI) to assess cluster quality.
result Maximizing SAAI improves anomaly detection accuracy by 0.23 compared to SSC and by 0.32 compared to X-Means.
Nonparametric detection of existence of an anomalous structure over a network is investigated. Nodes corresponding to the anomalous structure (if one exists) receive samples generated by a distribution q, which is different from a distribution p generating samples for other nodes. If an anomalous structure does not exi…
-class Classification: an Anomaly Detection Method for Highly Imbalanced or Incomplete Data Setsstat.ML
Anomaly detection is not an easy problem since distribution of anomalous samples is unknown a priori. We explore a novel method that gives a trade-off possibility between one-class and two-class approaches, and leads to a better performance on anomaly detection problems with small or non-representative anomalous sample…
Anomaly detection is a challenging task that frequently arises in practically all areas of industry and science, from fraud detection and data quality monitoring to finding rare cases of diseases and searching for new physics. Most of the conventional approaches to anomaly detection, such as one-class SVM and Robust Au…
From a sequence of similarity networks, with edges representing certain similarity measures between nodes, we are interested in detecting a change-point which changes the statistical property of the networks. After the change, a subset of anomalous nodes which compares dissimilarly with the normal nodes. We study a sim…
DORA analyzes deep neural networks' internal representations to detect spurious correlations.
problem Detecting spurious correlations in deep neural networks' internal representations.
method DORA uses Extreme-Activation (EA) distance measure to assess representation similarities.
result Identifies internal representations capable of detecting spurious correlations.
Solves dual imbalance in detecting sparse anomalies in MIL.
problem Detecting scarce and sparse anomalous samples in MIL.
method Reformulates MIL as a fine-grained PU learning problem, addressing imbalance at both macro and micro levels.
result Demonstrates effectiveness of BFGPU framework on synthetic and real-world datasets.
This paper introduces a new dataset called "ToyADMOS" designed for anomaly detection in machine operating sounds (ADMOS). To the best our knowledge, no large-scale datasets are available for ADMOS, although large-scale datasets have contributed to recent advancements in acoustic signal processing. This is because anoma…
Detecting anomalous activity in human mobility data has a number of applications including road hazard sensing, telematic based insurance, and fraud detection in taxi services and ride sharing. In this paper we address two challenges that arise in the study of anomalous human trajectories: 1) a lack of ground truth dat…
Most real-world networks exhibit community structure, a phenomenon characterized by existence of node clusters whose intra-edge connectivity is stronger than edge connectivities between nodes belonging to different clusters. In addition to facilitating a better understanding of network behavior, community detection fin…
In federated learning systems, clients are autonomous in that their behaviors are not fully governed by the server. Consequently, a client may intentionally or unintentionally deviate from the prescribed course of federated model training, resulting in abnormal behaviors, such as turning into a malicious attacker or a …
Audio processing models based on deep neural networks are susceptible to adversarial attacks even when the adversarial audio waveform is 99.9% similar to a benign sample. Given the wide application of DNN-based audio recognition systems, detecting the presence of adversarial examples is of high practical relevance. By …
Anomaly detection refers to the task of finding unusual instances that stand out from the normal data. In several applications, these outliers or anomalous instances are of greater interest compared to the normal ones. Specifically in the case of industrial optical inspection and infrastructure asset management, findin…
Paper proposes SDS for 5G security using machine learning.
problem Cybersecurity threats and expanding IoT in 5G networks.
method SDS uses machine learning, specifically a CNN with NAS, to detect anomalies.
result CNN achieved 100% accuracy in identifying benign traffic and 96.4% in detecting anomalies.
Data-driven anomaly detection methods suffer from the drawback of detecting all instances that are statistically rare, irrespective of whether the detected instances have real-world significance or not. In this paper, we are interested in the problem of specifically detecting anomalous instances that are known to have …
ResGCN detects anomalies in attributed networks by capturing sparsity and nonlinearity.
problem Detecting anomalous nodes in attributed networks.
method Attention-based deep residual modeling using Graph Convolutional Networks.
result ResGCN effectively detects anomalies in attributed networks.
A new framework uses information theory to detect anomalies in images without labeled data.
problem Detect anomalies in images without labeled data.
method A direct objective function using information theory to maximize the distance between normal and anomalous data.
result The proposed framework significantly outperforms state-of-the-arts on multiple benchmark datasets.
Physics-informed diffusion model detects anomalous trajectories in GPS data.
problem Detecting fake GPS trajectories in international waters.
method Physics-informed diffusion model integrating kinematic constraints.
result Higher prediction accuracy and lower error rate for anomaly detection.
We consider the sequential anomaly detection problem in the one-class setting when only the anomalous sequences are available and propose an adversarial sequential detector by solving a minimax problem to find an optimal detector against the worst-case sequences from a generator. The generator captures the dependence i…
Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Besides, deep generative models have the risk of overfitting training samples, which has disastrous effects on ano…
Method explains anomaly detection by generating normal modifications.
problem Complexity of deep learning methods in anomaly detection.
method Generates multiple alternative modifications for anomalies.
result High-quality semantic explanations provided for anomaly detection.
Survey examines anomaly detection methods for deep learning.
problem Out-of-distribution and adversarial examples in deep learning.
method Taxonomy of existing anomaly detection techniques.
result Discussion of strengths and weaknesses of techniques.