Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

103207310413 · Jun 202019922001200920172026
48 results for real-world detection

This paper improves change-point detection for complex data streams using denoising score matching.

problem Timely identification of distributional shifts in high-dimensional, complex data streams.
method Score-based CUSUM change-point detection with denoising score matching.
result Denoising score matching enhances detection power by effectively controlling noise scale.

Evaluates change point detection algorithms on real-world data.

problem Insufficient evaluation of change point detection algorithms on real-world time series.
method Developed a data set of 37 time series from various domains, annotated by human experts, and evaluated 14 algorithms using consistency metrics.
result Demonstrates the need for better evaluation methods in change point detection.

Anomaly detection is a fundamental problem in data mining field with many real-world applications. A vast majority of existing anomaly detection methods predominately focused on data collected from a single source. In real-world applications, instances often have multiple types of features, such as images (ID photos, f…

2019-08-11abs ↗pdf ↗

ResGCN detects anomalies in attributed networks by capturing sparsity and nonlinearity.

problem Detecting anomalous nodes in attributed networks.
method Attention-based deep residual modeling using Graph Convolutional Networks.
result ResGCN effectively detects anomalies in attributed networks.

Mitigates anomaly score imbalance in long-tailed distributions.

problem Class imbalance in normal data leads to skewed anomaly detection performance.
method Proposes an importance-weighted loss function to balance anomaly scores.
result Improves anomaly detection performance by 0.043 on real-world datasets.

Advances in sensor technology have enabled the collection of large-scale datasets. Such datasets can be extremely noisy and often contain a significant amount of outliers that result from sensor malfunction or human operation faults. In order to utilize such data for real-world applications, it is critical to detect ou…

2018-08-26abs ↗pdf ↗

Proposes class-agnostic object detection to handle all objects without class labels.

problem Difficulty and cost in creating annotated datasets limit conventional object detection models to specific object types.
method Proposes class-agnostic object detection as a new problem and proposes training and evaluation protocols. Uses adversarial learning to exclude class-specific information.
result Adversarial learning improves class-agnostic detection efficacy.

ReRe detects anomalies in real-time for time series data.

problem Real-time anomaly detection for time series data requires human intervention or domain knowledge and high computation complexity.
method ReRe uses two lightweight LSTM models to predict and determine anomalies based on historical data and adaptive thresholds.
result ReRe detects anomalies in real-time without requiring human intervention or domain knowledge.

SubSearch detects graph outliers and estimates SBM parameters robustly.

problem Real-world graphs often deviate from ideal SBM assumptions.
method Subgraph search to find subgraphs that align with SBM assumptions.
result SubSearch accurately estimates SBM parameters and detects outliers.

Machine-learning driven safety-critical autonomous systems, such as self-driving cars, must be able to detect situations where its trained model is not able to make a trustworthy prediction. Often viewed as a black-box, it is non-obvious to determine when a model will make a safe decision and when it will make an erron…

2019-06-09abs ↗pdf ↗

Study benchmarks label noise detection methods, identifying best practices.

problem Label noise in real-world datasets affects model performance and evaluation reliability.
method Decomposed detection methods into label agreement, aggregation, and information gathering components; introduced a unified benchmark task and novel metric.
result In-sample probability aggregation with logit margin label agreement function achieves best results across scenarios.

Generative adversarial networks (GANs) are able to model the complex highdimensional distributions of real-world data, which suggests they could be effective for anomaly detection. However, few works have explored the use of GANs for the anomaly detection task. We leverage recently developed GAN models for anomaly dete…

2018-02-17abs ↗pdf ↗

MADOD meta-learns invariant features for OOD detection across unseen domains.

problem Simultaneous covariate and semantic shifts in real-world machine learning applications.
method Meta-learning and G-invariance to learn robust, domain-invariant features.
result Superior performance in semantic OOD detection across unseen domains.

Generates synthetic data for benchmarking unsupervised outlier detection.

problem Difficulty in benchmarking unsupervised outlier detection due to rare and varied outliers in real data.
method Proposes a generic process to generate synthetic data with insightful characteristics.
result Demonstrates practicality of the generic process through a benchmark with state-of-the-art detection methods.

New research finds uncertainty estimation techniques fail to reliably detect abnormal medical cases.

problem Uncertainty estimation does not reliably detect out-of-distribution patients in medical tabular data.
method A series of tests on various uncertainty estimation techniques on real-world medical data.
result Almost all techniques fail to identify out-of-distribution patients, contradicting earlier findings.

Non-parametric estimators improve quickest changepoint detection under irregular sequence lengths.

problem Limited and irregular sequence lengths hinder application of ARL and ADD in QCD.
method Analogies with survival analysis to model detection probabilities under truncation.
result KM-ARL and KM-ADD non-parametric estimators are asymptotically unbiased.

Improved online changepoint detection for autocorrelated data.

problem Changepoint detection in autocorrelated data with false positives or delays.
method Generalized Likelihood Ratio (GLR) statistic for AR(p) processes, online focus algorithm.
result AR(p)-focus algorithm achieves high detection power in correlated data.

C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.

problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.

Solves dual imbalance in detecting sparse anomalies in MIL.

problem Detecting scarce and sparse anomalous samples in MIL.
method Reformulates MIL as a fine-grained PU learning problem, addressing imbalance at both macro and micro levels.
result Demonstrates effectiveness of BFGPU framework on synthetic and real-world datasets.

Anomaly detection method tackles hidden adversary actions in real-world scenarios.

problem Detecting hidden adversary actions in real-world scenarios where the defender cannot perfectly observe the attacker's actions.
method Extends existing anomaly detection models to handle continuous action spaces and game-theoretic framework. Proposes two algorithms: direct extension and learning-based approach.
result Learning-based approach produces less exploitable strategies and is scalable to higher dimensions.

A new method detects communities in multi-relational networks.

problem Detect communities in heterogeneous multi-relational networks.
method Message passing based algorithm on a hierarchical structure of homogeneous networks.
result Effectiveness of the proposed method confirmed on synthetic and real-world networks.

Method detects anomalies on attributed graphs with few labeled instances.

problem Detecting anomalies on connected instances (attributed graphs) with limited labeled data.
method Embed nodes in latent space using GCNs, training to distinguish normal and anomalous nodes.
result Method outperforms existing methods on real-world attributed graph datasets.

Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task. The goal is to detect the OOD cases with limited in-domain (ID) training data, since we observe that training data is often insufficient in machine learning applications. In this work, we propose an OOD-resistant Pr…

2019-08-31abs ↗pdf ↗

Outlier detection amounts to finding data points that differ significantly from the norm. Classic outlier detection methods are largely designed for single data type such as continuous or discrete. However, real world data is increasingly heterogeneous, where a data point can have both discrete and continuous attribute…

2016-08-17abs ↗pdf ↗

New method detects anomalies in time series data, especially useful for monitoring services.

problem Detecting anomalies in time series data, especially for monitoring services and cloud resources.
method Models time series of probability distributions over real values, scales to millions of time series.
result Outperforms state-of-the-art methods in detecting anomalies on various data sets.

Enhanced Extended Isolation Forest (EIF+) improves anomaly detection and provides interpretable explanations.

problem Detecting anomalies in complex datasets and explaining model predictions.
method Extended Isolation Forest (EIF) and Extended Isolation Forest Feature Importance (ExIFFI) methods.
result EIF+ outperforms EIF in detecting unseen anomalies and provides better generalization.

Detects project management anti-patterns using code and issue data.

problem Detecting project management anti-patterns requires expert judgment and is expensive.
method Convert descriptions to detectable metrics, quantify deviations, and optimize patterns.
result Automatic calibration enhances pattern detection and severity assessment.

Many real-world networks are complex dynamical systems, where both local (e.g., changing node attributes) and global (e.g., changing network topology) processes unfold over time. Local dynamics may provoke global changes in the network, and the ability to detect such effects could have profound implications for a numbe…

2017-10-09abs ↗pdf ↗

Crowdsourced data helps detect incidents faster, balancing accuracy and practicality.

problem Detecting incidents from crowdsourced data is challenging due to noise and uncertainty.
method CROME (Crowdsourced Multi-objective Event Detection) uses CNN and Pareto optimization.
result The approach outperforms existing methods in incident detection and practicality.