arXiv research

Theoretical guarantees for STE, a robust subspace recovery method.

New robust regression method works with fewer data points than previous methods.

Develops efficient estimators for PCA and sparse regression in the presence of oblivious outliers.

We give the first polynomial-time algorithm for robust regression in the list-decodable setting where an adversary can corrupt a greater than $1/2$ fraction of examples. For any $α< 1$, our algorithm takes as input a sample $\{(x_i,y_i)\}_{i \leq n}$ of $n$ linear equations where $αn$ of the equations satisfy $y_i = \l…

ODIM detects outliers by under-fitting generative models, outperforming other methods.

A novel framework IMBoost improves outlier detection by leveraging the inlier memorization effect.

The IM effect helps detect anomalies by memorizing inliers early.

We consider the problem of clustering datasets in the presence of arbitrary outliers. Traditional clustering algorithms such as k-means and spectral clustering are known to perform poorly for datasets contaminated with even a small number of outliers. In this paper, we develop a provably robust spectral clustering algo…

Robust PCA, the problem of PCA in the presence of outliers has been extensively investigated in the last few years. Here we focus on Robust PCA in the outlier model where each column of the data matrix is either an inlier or an outlier. Most of the existing methods for this model assumes either the knowledge of the dim…

ALTBI enhances outlier detection by maximizing the inlier-memorization effect.

Algorithm finds a subspace minimizing distances to inliers with outliers.

The paper analyzes how conformal prediction works with contaminated reference data.

We propose a neural network for unsupervised anomaly detection with a novel robust subspace recovery layer (RSR layer). This layer seeks to extract the underlying subspace from a latent representation of the given data and removes outliers that lie away from this subspace. It is used within an autoencoder. The encoder …

We propose an inlier-based outlier detection method capable of both identifying the outliers and explaining why they are outliers, by identifying the outlier-specific features. Specifically, we employ an inlier-based outlier detection criterion, which uses the ratio of inlier and test probability densities as a measure…

Improved algorithm for conditional linear regression with heterogeneous covariances.

This paper presents a remarkably simple, yet powerful, algorithm termed Coherence Pursuit (CoP) to robust Principal Component Analysis (PCA). As inliers lie in a low dimensional subspace and are mostly correlated, an inlier is likely to have strong mutual coherence with a large number of data points. By contrast, outli…

New algorithms robustly estimate mean with near-optimal error rates.

PRAE identifies outliers and reconstructs inliers in autoencoders.

New method estimates robust mean in high dimensions with minimized outliers.

Linear regression models contaminated by Gaussian noise (inlier) and possibly unbounded sparse outliers are common in many signal processing applications. Sparse recovery inspired robust regression (SRIRR) techniques are shown to deliver high quality estimation performance in such regression models. Unfortunately, most…

This work presents a fast and non-convex algorithm for robust subspace recovery. The data sets considered include inliers drawn around a low-dimensional subspace of a higher dimensional ambient space, and a possibly large portion of outliers that do not lie nearby this subspace. The proposed algorithm, which we refer t…

There is an increasingly apparent need for validating the classifications made by deep learning systems in safety-critical applications like autonomous vehicle systems. A number of recent papers have proposed methods for detecting anomalous image data that appear different from known inlier data samples, including reco…

Paper introduces RAS for robust MTL with contamination.

Consider a dataset of vector-valued observations that consists of noisy inliers, which are explained well by a low-dimensional subspace, along with some number of outliers. This work describes a convex optimization problem, called REAPER, that can reliably fit a low-dimensional model to this type of data. This approach…

This describes a statistical technique called "tonsuring" for exploratory data analysis in finance. Instead of rejecting "outlier" data that conflicts with the model, this strips out "inlier" data to get a clearer picture of how the market changes for larger moves.

The idea of Innovation Search was proposed as a data clustering method in which the directions of innovation were utilized to compute the adjacency matrix and it was shown that Innovation Pursuit can notably outperform the self representation based subspace clustering methods. In this paper, we present a new discovery …

Robust VAE detects anomalies in corrupted data.

We study a data model in which the data matrix D can be expressed as D = L + S + C, where L is a low rank matrix, S an element-wise sparse matrix and C a matrix whose non-zero columns are outlying data points. To date, robust PCA algorithms have solely considered models with either S or C, but not both. As such, existi…

New estimator tackles multi-task linear regression with outliers, avoiding eigenvalue lower bounds.

Many computer vision tasks involve processing large amounts of data contaminated by outliers, which need to be detected and rejected. While outlier detection methods based on robust statistics have existed for decades, only recently have methods based on sparse and low-rank representation been developed along with guar…

CLSVAE repairs systematic errors in images with minimal labeled data.

DCASE 2021 ASD task tackles domain-shifted anomalous sound detection.

This paper considers the problem of robust subspace recovery: given a set of $N$ points in $\mathbb{R}^D$, if many lie in a $d$-dimensional subspace, then can we recover the underlying subspace? We show that Tyler's M-estimator can be used to recover the underlying subspace, if the percentage of the inliers is larger t…

Smoothed analysis is a powerful paradigm in overcoming worst-case intractability in unsupervised learning and high-dimensional data analysis. While polynomial time smoothed analysis guarantees have been obtained for worst-case intractable problems like tensor decompositions and learning mixtures of Gaussians, such guar…

In this work we present a new approach on studying dynamical systems. Combining the two ways of expressing the uncertainty, using probabilistic theory and credibility theory, we have research the generalized fractional hybrid equations. We have introduced the concepts of generalized fractional Wiener process, generaliz…

Methods from the geometry of nonholonomic manifolds and Lagrange-Finsler spaces are applied in fractional calculus with Caputo derivatives and for elaborating models of fractional gravity and fractional Lagrange mechanics. The geometric data for such models are encoded into (fractional) bi-Hamiltonian structures and as…

Introduces fractional k-dimensional measure bridging fractional length and area.

The theory of derivative of noninteger order goes back to Leibniz, Liouville and Riemann. Derivatives of fractional order have found many applications in recent studies in mechanics, physics, economics. In this paper we define the fractional tangent bundle on a manifold, using a method of Radu Miron. The fractional Lei…

Let $S_g$ be a closed orientable surface of genus $g \geq 2$ and $C$ a simple closed nonseparating curve in $F$. Let $t_C$ denote a left handed Dehn twist about $C$. A \textit{fractional power} of $t_C$ of \textit{exponent} $\fraction{\ell}{n}$ is an $h \in \Mod(S_g)$ such that $h^n = t_C^{\ell}$. Unlike a root of a $t…

We formulate the fractional Ricci flow theory for (pseudo) Riemannian geometries enabled with nonholonomic distributions defining fractional integro-differential structures, for non-integer dimensions. There are constructed fractional analogs of Perelman's functionals and derived the corresponding fractional evolution …

Using Caputo fractional derivative of order $α$ we build the fractional jet bundle of order $α$ and its main geometrical structures. Defined on that bundle, some fractional dynamical systems with applications to economics are studied.

Volatility roughness studied using fractional noise-driven models.

Using the reviewed Riemann-Liouville fractional derivative we introduce the fractional osculator Lagrange space of k order and the main structures on it. The results are applied at the k order fractional prolongation of Lagrange, Finsler and Riemann fractional structures.

Develops fractional de Rham theory for Maxwell equations.

Modeling financial markets with memory using fractional calculus and Brownian motion.

For the degree corrected stochastic block model in the presence of arbitrary or even adversarial outliers, we develop a convex-optimization-based clustering algorithm that includes a penalization term depending on the positive deviation of a node from the expected number of edges to other inliers. We prove that under m…

Long and short memory in economic processes is usually described by the so-called discrete fractional differencing and fractional integration. We prove that the discrete fractional differencing and integration are the Grunwald-Letnikov fractional differences of non-integer order d. Equations of ARIMA(p,d,q) and ARFIMA(…

In this paper we established the condition for a curve to satisfy stochas- tic fractional HP (Hamilton-Pontryagin) equations. These equations are described using It^o integral. We have also considered the case of stochastic fractional Hamiltonian equa- tions, for a hyperregular Lagrange function. From the stochastic fr…