Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

23466891 · May 202619922001200920172026
48 results for Systematic Outliers

CLSVAE repairs systematic errors in images with minimal labeled data.

problem Repairing systematic errors in data, especially in images.
method CLSVAE models inliers as a smaller latent space representation, separating inlier and outlier patterns.
result CLSVAE achieves superior repairs with less than 2% labeled data, outperforming other methods.

We describe a formal approach to identify 'root causes' of outliers observed in nn variables X1,,XnX_1,\dots,X_n in a scenario where the causal relation between the variables is a known directed acyclic graph (DAG). To this end, we first introduce a systematic way to define outlier scores. Further, we introduce the concep…

2019-12-05abs ↗pdf ↗

A new robust regression method handles outliers in high-dimensional data.

problem Outliers in high-dimensional data make conventional regression methods ineffective.
method Robust penalized least squares of depth trimmed residuals regression.
result The new method outperforms existing methods in estimation and prediction accuracy.

We perform an extended analysis of the distribution of drawdowns in the two leading exchange markets (US dollar against the Deutsmark and against the Yen), in the major world stock markets, in the U.S. and Japanese bond market and in the gold market, by introducing the concept of ``coarse-grained drawdowns,'' which all…

2002-10-23abs ↗pdf ↗

We propose a unified and systematic framework for performing online nonnegative matrix factorization in the presence of outliers. Our framework is particularly suited to large-scale data. We propose two solvers based on projected gradient descent and the alternating direction method of multipliers. We prove that the se…

2016-04-10abs ↗pdf ↗

Survey on reproducibility and distortion issues in text clustering and topic modeling.

problem Reproducibility and misleading cluster geometry in unsupervised learning for text categorization.
method Systematic literature review of text clustering and topic modeling from 2011-2022.
result Outliers and initialization issues are significant factors in text clustering and topic modeling.

Study improves robustness of Bayesian inference for cognitive models.

problem Outliers and contaminants affect parameter estimation in cognitive models.
method Robustness of parameter estimation using amortized Bayesian inference (ABI) with neural networks.
result Introducing contaminants from a Cauchy distribution increases robustness.

To identify and classify toxic online commentary, the modern tools of data science transform raw text into key features from which either thresholding or learning algorithms can make predictions for monitoring offensive conversations. We systematically evaluate 62 classifiers representing 19 major algorithmic families …

2018-10-03abs ↗pdf ↗

Robust statistics traditionally focuses on outliers, or perturbations in total variation distance. However, a dataset could be corrupted in many other ways, such as systematic measurement errors and missing covariates. We generalize the robust statistics approach to consider perturbations under any Wasserstein distance…

2019-09-19abs ↗pdf ↗

Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categories: outlier inclusion, outlier trimming, and post hoc outlier identification methods, with the forme…

2019-07-02abs ↗pdf ↗

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of multiple outcome variable values. In this paper, we develop and study a new conditiona…

2015-05-15abs ↗pdf ↗

Outlier detection plays an essential role in many data-driven applications to identify isolated instances that are different from the majority. While many statistical learning and data mining techniques have been used for developing more effective outlier detection algorithms, the interpretation of detected outliers do…

2017-11-28abs ↗pdf ↗

Advances in sensor technology have enabled the collection of large-scale datasets. Such datasets can be extremely noisy and often contain a significant amount of outliers that result from sensor malfunction or human operation faults. In order to utilize such data for real-world applications, it is critical to detect ou…

2018-08-26abs ↗pdf ↗

Paper tackles outlier detection in signals modeled by generative models with theoretical guarantees.

problem Recovering signals from linear measurements with sparse outliers.
method Proposes an iterative ADMM algorithm and gradient descent algorithm for outlier detection using 1\ell_1 and squared 1\ell_1 norm minimization.
result Establishes theoretical recovery guarantees for signal reconstruction under sparse outliers.

Transforms distance-based outlier scores into interpretable probabilistic estimates.

problem Difficult interpretation of distance-based outlier scores.
method Generic transformation of scores into probabilistic estimates using distance probability distributions.
result Probabilistic transformation improves interpretability without impacting detection performance.

Generates synthetic data for benchmarking unsupervised outlier detection.

problem Difficulty in benchmarking unsupervised outlier detection due to rare and varied outliers in real data.
method Proposes a generic process to generate synthetic data with insightful characteristics.
result Demonstrates practicality of the generic process through a benchmark with state-of-the-art detection methods.

A new method detects outliers using ensembles of Dirichlet process mixtures.

problem Challenges in unsupervised outlier detection using Dirichlet process mixtures.
method Ensembles of Dirichlet process Gaussian mixtures with random subspace and subsampling.
result Empirically outperforms existing approaches in unsupervised outlier detection.

Rare data in a large-scale database are called outliers that reveal significant information in the real world. The subspace-based outlier detection is regarded as a feasible approach in very high dimensional space. However, the outliers found in subspaces are only part of the true outliers in high dimensional space, in…

2014-05-05abs ↗pdf ↗

Robust PCA, the problem of PCA in the presence of outliers has been extensively investigated in the last few years. Here we focus on Robust PCA in the column sparse outlier model. The existing methods for column sparse outlier model assumes either the knowledge of the dimension of the lower dimensional subspace or the …

2018-04-13abs ↗pdf ↗

ODIM detects outliers by under-fitting generative models, outperforming other methods.

problem Identifying outliers in unlabeled data without supervision.
method Develops ODIM, a method that uses under-fitted deep generative models to detect outliers.
result ODIM outperforms other methods in detecting outliers efficiently and accurately.

Inference in the presence of outliers is an important field of research as outliers are ubiquitous and may arise across a variety of problems and domains. Bayesian optimization is method that heavily relies on probabilistic inference. This allows outstanding sample efficiency because the probabilistic machinery provide…

2017-12-12abs ↗pdf ↗

Paper tackles outlier detection in multi-armed bandits, achieving high accuracy with reduced exploration costs.

problem Detecting outlier arms in multi-armed bandit settings.
method Proposes GOLD algorithm based on upper confidence bounds to identify generic outlier arms.
result Achieves 98% accuracy with 83% reduction in exploration cost compared to state-of-the-art techniques.

This paper bridges outlier-robust estimation in robotics and computer vision with robust statistics.

problem Outlier-robust estimation for geometric perception in robotics and computer vision.
method Adapting and extending robust linear regression and list-decodable regression to non-convex domains and vector-valued measurements.
result Performance guarantees for modern estimation algorithms in the presence of outliers.

Notwithstanding the popularity of conventional clustering algorithms such as K-means and probabilistic clustering, their clustering results are sensitive to the presence of outliers in the data. Even a few outliers can compromise the ability of these algorithms to identify meaningful hidden structures rendering their o…

2011-04-22abs ↗pdf ↗

This paper investigates differentially private analysis of distance-based outliers. The problem of outlier detection is to find a small number of instances that are apparently distant from the remaining instances. On the other hand, the objective of differential privacy is to conceal presence (or absence) of any partic…

2015-07-24abs ↗pdf ↗

Integrates outlier detection into neural networks for improved performance.

problem Lack of competency awareness in machine learning systems, especially in detecting outliers.
method Null Space Analysis (NuSA) of neural networks, computing and controlling null space projection.
result NuSA-trained networks maintain classification performance and detect outliers effectively.

One-Class Boundary Peeling detects outliers efficiently and robustly.

problem Unsupervised outlier detection in diverse data distributions.
method One-Class Boundary Peeling uses flexible boundaries generated by one-class SVMs and iteratively peels them.
result One-Class Boundary Peeling outperforms state-of-the-art methods in synthetic data simulations.

Adaptive algorithm for outlier detection by balancing arm exploration and threshold estimation.

problem Identifying outliers in a set of rewards where the threshold is a function of all rewards.
method Adaptively updated confidence interval for the threshold based on previous rounds' estimates, balancing exploration of individual arms and the outlier threshold.
result Efficient algorithm with reduced sample complexity for outlier detection.