Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

121241362482 · Jun 202019922001200920172026
48 results for outlier analysis

This paper investigates differentially private analysis of distance-based outliers. The problem of outlier detection is to find a small number of instances that are apparently distant from the remaining instances. On the other hand, the objective of differential privacy is to conceal presence (or absence) of any partic…

2015-07-24abs ↗pdf ↗

Real data often contain anomalous cases, also known as outliers. These may spoil the resulting analysis but they may also contain valuable information. In either case, the ability to detect such anomalies is essential. A useful tool for this purpose is robust statistics, which aims to detect the outliers by first fitti…

2017-07-31abs ↗pdf ↗

New robust MPCA method handles casewise and cellwise outliers in tensor data.

problem Outliers, especially casewise and cellwise, affect the performance of standard MPCA.
method Uses a single loss function to reduce the influence of both types of outliers and missing values.
result The new method improves robustness and performance in tensor data analysis.

Integrates outlier detection into neural networks for improved performance.

problem Lack of competency awareness in machine learning systems, especially in detecting outliers.
method Null Space Analysis (NuSA) of neural networks, computing and controlling null space projection.
result NuSA-trained networks maintain classification performance and detect outliers effectively.

Paper proposes a new method for selective inference in robust regression.

problem Statistical inference after removing outliers identified by robust methods.
method Conditional SI using piecewise-linear homotopy continuation.
result Proposed method is applicable to a wide class of robust regression and outlier detection methods.

RieCUR improves Robust PCA by combining Riemannian optimization and CUR decompositions.

problem Robust Principal Component Analysis (PCA) to recover low-rank and sparse matrices from their sum.
method Riemannian CUR (RieCUR) algorithm that combines Riemannian optimization and robust CUR decompositions.
result RieCUR achieves state-of-the-art performance in Robust PCA with improved robustness to outliers and comparable computational complexity.

Cluster analysis and outlier detection are strongly coupled tasks in data mining area. Cluster structure can be easily destroyed by few outliers; on the contrary, outliers are defined by the concept of cluster, which are recognized as the points belonging to none of the clusters. Unfortunately, most existing studies do…

2018-01-05abs ↗pdf ↗

Outliers arise in networks due to different reasons such as fraudulent behavior of malicious users or default in measurement instruments and can significantly impair network analyses. In addition, real-life networks are likely to be incompletely observed, with missing links due to individual non-response or machine fai…

2019-11-29abs ↗pdf ↗

New framework robustifies loss functions with quantiles for outlier resistance.

problem Widespread outliers in big data affect statistical estimation and inference.
method Introduces a framework connecting to trimming, scalable algorithms, and new techniques.
result Robust estimators achieve minimax rate optimality in regression, classification, and neural networks.

We describe a formal approach to identify 'root causes' of outliers observed in nn variables X1,,XnX_1,\dots,X_n in a scenario where the causal relation between the variables is a known directed acyclic graph (DAG). To this end, we first introduce a systematic way to define outlier scores. Further, we introduce the concep…

2019-12-05abs ↗pdf ↗

One-Class Boundary Peeling detects outliers efficiently and robustly.

problem Unsupervised outlier detection in diverse data distributions.
method One-Class Boundary Peeling uses flexible boundaries generated by one-class SVMs and iteratively peels them.
result One-Class Boundary Peeling outperforms state-of-the-art methods in synthetic data simulations.

New findings suggest deep generative models can misclassify outliers, requiring new evaluation methods.

problem Deep generative models often assign higher likelihood to outliers, challenging existing outlier detection methods.
method Analyzed the typical set and high-density region of DGMs, proposing a novel outlier test.
result Existing likelihood-based outlier tests may fail due to model calibration issues, not just misclassification.

Blind Source Separation is a widely used technique to analyze multichannel data. In many real-world applications, its results can be significantly hampered by the presence of unknown outliers. In this paper, a novel algorithm coined rGMCA (robust Generalized Morphological Component Analysis) is introduced to retrieve s…

2015-07-08abs ↗pdf ↗

A new robust Wasserstein distance is proposed to handle outliers in probability distributions.

problem Outliers in probability distributions make Wasserstein distances sensitive and impractical.
method Introduces a new outlier-robust Wasserstein distance Wpε\mathsf{W}_p^\varepsilon.
result Achieves strong robust estimation guarantees under the Huber ε\varepsilon-contamination model.

PyODDS is an end-to end Python system for outlier detection with database support. PyODDS provides outlier detection algorithms which meet the demands for users in different fields, w/wo data science or machine learning background. PyODDS gives the ability to execute machine learning algorithms in-database without movi…

2019-10-07abs ↗pdf ↗

Paper uses machine learning to forecast significant currency exchange rate fluctuations.

problem Forecasting significant daily returns in foreign exchange markets.
method Applying nine modern machine learning algorithms to data on four major currency pairs over 10 years, focusing on outlier detection methods.
result Outlier detection methods significantly outperform traditional techniques, with PKDE method producing the best results.

Outlier detection is a crucial part of robust evaluation for crowdsourceable assessment of Quality of Experience (QoE) and has attracted much attention in recent years. In this paper, we propose some simple and fast algorithms for outlier detection and robust QoE evaluation based on the nonconvex optimization principle…

2017-07-18abs ↗pdf ↗

Heavy-tailed distributions are frequently used to enhance the robustness of regression and classification methods to outliers in output space. Often, however, we are confronted with "outliers" in input space, which are isolated observations in sparsely populated regions. We show that heavy-tailed stochastic processes (…

2010-06-19abs ↗pdf ↗

A novel framework IMBoost improves outlier detection by leveraging the inlier memorization effect.

problem Challenges in unsupervised outlier detection, especially when inliers and outliers are not well-separated or form dense clusters.
method IMBoost framework that incorporates active learning to selectively acquire informative labels and explicitly reinforce the inlier memorization effect.
result IMBoost significantly outperforms state-of-the-art active outlier detection methods and requires less computational cost.

Cellwise outliers challenge traditional methods in statistics and machine learning.

problem Cellwise outliers contaminate over half cases in data matrices, complicating existing methods.
method Requires techniques different from casewise methods, focusing on non-intuitive equivariance properties.
result Substantial progress in estimating location and covariance matrices, regression methods, and tensor data.