Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

4183124165 · Jun 202019922001200920172026
48 results for Sparse Anomalies

We tackle anomaly detection in sparse time series data.

problem Sparse time series with low signal-to-noise ratios and non-uniform performance.
method We introduce a novel generative procedure for benchmark datasets and demonstrate how anomaly score smoothing improves performance.
result Anomaly score smoothing consistently improves performance in low-count time series anomaly detection.

Online anomaly detection of time-series data is an important and challenging task in machine learning. Gaussian processes (GPs) are powerful and flexible models for modeling time-series data. However, the high time complexity of GPs limits their applications in online anomaly detection. Attributed to some internal or e…

2019-05-14abs ↗pdf ↗

Solves dual imbalance in detecting sparse anomalies in MIL.

problem Detecting scarce and sparse anomalous samples in MIL.
method Reformulates MIL as a fine-grained PU learning problem, addressing imbalance at both macro and micro levels.
result Demonstrates effectiveness of BFGPU framework on synthetic and real-world datasets.

LLmFPCA-detect detects anomalies in sparse longitudinal text data using LLMs and mFPCA.

problem Challenges in detecting patterns and anomalies in sparse longitudinal textual data.
method Pairs LLM-based text embeddings with mFPCA to detect clusters and anomalies.
result LLmFPCA-detect outperforms state-of-the-art baselines on Amazon and Wikipedia datasets.

Paper introduces an unsupervised tensor-based anomaly detection method for spatiotemporal data.

problem Challenges in detecting anomalies in spatiotemporal data, especially in urban traffic monitoring and medical imaging.
method Formulates anomaly detection as a regularized robust low-rank + sparse tensor decomposition, incorporating spatiotemporal smoothness and local dependencies.
result Demonstrates improved anomaly detection performance on both synthetic and real data.

Unified model for signed networks separates balance and anomaly effects.

problem Ignoring sign information in signed networks leads to inaccurate analysis.
method Low rank plus sparse matrix decomposition with regularized formulation.
result The model accurately detects communities and anomalies in signed networks.

Paper proposes TBSD for efficient anomaly detection in textured images.

problem Challenges in anomaly detection for textured images, especially in manufacturing systems.
method Texture basis integrated smooth decomposition (TBSD) approach.
result TBSD surpasses benchmarks with less misidentification and superior performance.

AnomalyCD discovers anomaly causes in large systems with binary flags, reducing computational burden.

problem Learning graphical causal models from large-scale binary anomaly data is computationally expensive.
method AnomalyCD uses anomaly data-aware causality testing, sparse data compression, and edge pruning.
result AnomalyCD reduces computation overhead and improves accuracy on binary anomaly datasets.

Anomalies and outliers are common in real-world data, and they can arise from many sources, such as sensor faults. Accordingly, anomaly detection is important both for analyzing the anomalies themselves and for cleaning the data for further analysis of its ambient structure. Nonetheless, a precise definition of anomali…

2018-11-10abs ↗pdf ↗

Anomaly detection in multivariate time series is improved using ensemble techniques.

problem Anomaly detection in multivariate time series data is challenging due to sparse anomalies and feature subset anomalies.
method Feature-bagging technique, nested rotation PCA, ensemble of base models, semi-supervised Logistic Regressor.
result The proposed ensemble technique outperforms basic algorithms by 2% unsupervised and at least 10% semi-supervised.

The paper proposes a method to generate diverse counterfactual explanations for anomaly detection in time series data.

problem Lack of helpful explanations for anomaly detection models in time series data.
method Model-agnostic algorithm that generates diverse counterfactual examples for anomaly detection models.
result The method produces counterfactual examples that are not considered anomalous by the detection model and satisfy validity, plausibility, and closeness criteria.

Event-based cameras are bio-inspired novel sensors that asynchronously record changes in illumination in the form of events, thus resulting in significant advantages over conventional cameras in terms of low power utilization, high dynamic range, and no motion blur. Moreover, such cameras, by design, encode only the re…

2019-11-21abs ↗pdf ↗

Gaussian graphical models (GGMs) are probabilistic tools of choice for analyzing conditional dependencies between variables in complex systems. Finding changepoints in the structural evolution of a GGM is therefore essential to detecting anomalies in the underlying system modeled by the GGM. In order to detect structur…

2016-05-02abs ↗pdf ↗

We develop a real-time anomaly detection algorithm for directed activity on large, sparse networks. We model the propensity for future activity using a dynamic logistic model with interaction terms for sender- and receiver-specific latent factors in addition to sender- and receiver-specific popularity scores; deviation…

2019-11-13abs ↗pdf ↗

In the domain of machine learning, Neural Memory Networks (NMNs) have recently achieved impressive results in a variety of application areas including visual question answering, trajectory prediction, object tracking, and language modelling. However, we observe that the attention based knowledge retrieval mechanisms us…

2019-10-12abs ↗pdf ↗

Improves anomaly detection with contaminated unlabeled data.

problem Weakness in existing semi-supervised anomaly detection methods when unlabeled data contain anomalies.
method Integrates positive-unlabeled learning with deep anomaly detection models.
result Achieves better detection performance on various datasets.

Deep RL detects anomalies from few labeled examples and large unlabeled data.

problem Anomaly detection with limited labeled data and large unlabeled data.
method Deep reinforcement learning to optimize detection of labeled and unlabeled anomalies.
result Significantly outperforms state-of-the-art methods on 48 real-world datasets.

We propose a supervised anomaly detection method for data with inexact anomaly labels, where each label, which is assigned to a set of instances, indicates that at least one instance in the set is anomalous. Although many anomaly detection methods have been proposed, they cannot handle inexact anomaly labels. To measur…

2019-09-11abs ↗pdf ↗

Recent semi-supervised anomaly detection methods that are trained using small labeled anomaly examples and large unlabeled data (mostly normal data) have shown largely improved performance over unsupervised methods. However, these methods often focus on fitting abnormalities illustrated by the given anomaly examples on…

2019-10-30abs ↗pdf ↗

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new feature representations to enable downstream anomaly detection methods, perform in…

2019-11-19abs ↗pdf ↗

Ensemble learning improves anomaly detection for milder symptoms.

problem Difficulty in detecting incipient anomalies due to similarity to normal conditions.
method Utilize uncertainty information from ensemble learning to identify misclassified incipient anomalies.
result Ensemble learning methods show improved performance on incipient anomaly detection.

T-LoHo model detects structured sparsity and smoothness on graph data.

problem Detecting structured sparsity and smoothness in graph-structured data.
method Tree-based Low-rank Horseshoe (T-LoHo) prior for multivariate parameters.
result Improves anomaly detection on road networks compared to other methods.

TPA-AD detects axle-box bearing anomalies using pseudo anomalies near normal boundaries.

problem Detecting axle-box bearing anomalies with only normal training data.
method Two-stage approach: pseudo anomalies, contrastive learning, KNN.
result Improves anomaly detection separability and sensitivity to degradation.

Paper proposes RAN for better anomaly detection in time series data.

problem Anomaly detection algorithms often fail to accurately detect anomalies due to incomplete reconstruction of anomaly data.
method RAN uses adversarial learning and latent vector-constrained Autoencoder to ensure consistent reconstruction of anomaly data.
result RAN outperforms other algorithms in detecting meaningful anomalies with higher AUC-ROC scores.

A new method combines generative and feature-based approaches for unsupervised anomaly detection.

problem Identifying subtle anomalies in test samples compared to a normative distribution.
method A generative cold-diffusion pipeline trained to restore synthetically-corrupted images, combined with a novel synthetic anomaly generation procedure and ensembling restorations.
result Surpasses prior state-of-the-art for unsupervised anomaly detection in three Brain MRI datasets.

Paper tackles anomaly detection and RCA in dynamical systems using ICODE Networks.

problem Anomalies in dynamical systems impact performance and reliability.
method Proposes ICODE Networks for anomaly detection, RCA, and type classification.
result Demonstrates the ability to accurately detect anomalies, classify types, and pinpoint origins.

We consider principal component analysis (PCA) in decomposable Gaussian graphical models. We exploit the prior information in these models in order to distribute its computation. For this purpose, we reformulate the problem in the sparse inverse covariance (concentration) domain and solve the global eigenvalue problem …

2008-08-18abs ↗pdf ↗

Improves relevancy of black-box anomaly detectors with user feedback.

problem Users often ignore many detected anomalies, requiring a method to identify and prioritize relevant ones.
method Uses user feedback to adjust anomaly selection process based on identified anomaly types.
result Significant improvements in precision and recall over various anomaly detectors.

Paper develops a deforestation detection system using optical and SAR data.

problem Detecting tree-loss in dense forests using satellite data.
method Combines optical and SAR data, uses KL expansion for anomaly detection, and Hidden Markov Model for classification.
result Hybrid method achieves high accuracy and robustness in sparse optical data.