Proposes MPCA for robust PCA using mode estimation.
problem Outliers sensitivity in PCA.
method Modal Principal Component Analysis (MPCA) based on mode estimation.
result MPCA shows advantages over conventional methods.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Finite-Sample Breakdown Point”
New research extends optimal transport map breakdown properties to general costs.
problem Understanding robustness of optimal transport maps under contamination.
method Analyzing breakdown point of optimal transport maps for general convex costs.
result Breakdown point of optimal transport maps is independent of the cost function.
We formalize notions of robustness for composite estimators via the notion of a breakdown point. A composite estimator successively applies two (or more) estimators: on data decomposed into disjoint parts, it applies the first estimator on each part, then the second estimator on the outputs of the first estimator. And …
We analyze the performance of the Tukey median estimator under total variation (TV) distance corruptions. Previous results show that under Huber's additive corruption model, the breakdown point is 1/3 for high-dimensional halfspace-symmetric distributions. We show that under TV corruptions, the breakdown point reduces …
The support vector machine (SVM) is one of the most successful learning methods for solving classification problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The penalty on misclassification is defined by a convex loss called the hinge loss, and the unboun…
Paper analyzes robustness of MDPDE under INH setups.
problem Global reliability and breakdown behavior of MDPDE under INH.
method Asymptotic breakdown point analysis of MDPDE.
result Derives a theoretical lower bound for the asymptotic breakdown point.
Improved Robust Estimation for Erdős-Rényi Graphs: The Sparse Regime and Optimal Breakdown Pointcs.DS
New algorithm estimates edge density of random graphs robustly, achieving optimal breakdown point.
problem Estimating edge density of Erdős-Rényi graphs under adversarial edge manipulation.
method Sum-of-Squares (SoS) hierarchy, constructing constant-degree certificates for concentration.
result First polynomial-time algorithm with optimal breakdown point and matching error guarantees.
Adapting robust statistics to neural networks, researchers found neural networks can be more robust with certain loss functions.
problem The robustness of neural networks in complex learning tasks.
method Adapting the regression breakdown point from robust statistics to neural networks and comparing different configurations and contamination settings.
result Neural networks can benefit from robust loss functions, as demonstrated in extensive simulations.
Paper solves outlier robust mean estimation near breakdown point.
problem Estimating mean in presence of adversarial outliers.
method Sum-of-Squares approach to optimize error rate efficiently.
result Achieves optimal error rate for all ε ∈ [0, 1/2).
Unified framework for Byzantine robust gossip algorithms with guaranteed performance.
problem Vulnerability of decentralized machine learning to misbehaving devices.
method Introduces F-RG framework and CS+ robust aggregation rule for Byzantine resilience.
result CS+-RG has near-optimal breakdown tolerance and outperforms existing methods.
New method prevents neural network breakdown by combining trimmed loss and variation regularization.
problem Outlier contamination in neural network training.
method Integrates transformed trimmed loss and higher-order variation regularization.
result Ensures robustness to outlier contamination with a high functional breakdown point.
We consider the dimensionality-reduction problem (finding a subspace approximation of observed data) for contaminated data in the high dimensional regime, where the number of observations is of the same magnitude as the number of variables of each observation, and the data set contains some (arbitrarily) corrupted obse…
WPCA improves subspace recovery robustness to outliers.
problem Improving subspace recovery in the presence of outliers.
method Winsorized PCA (WPCA) with theoretical analysis of accuracy and robustness.
result WPCA provides consistent subspace recovery from contaminated data.
Paper shows how to use geometric median for robust SGD in high dimensions.
problem Robustifying SGD for high-dimensional optimization problems with gross corruption.
method Applying geometric median to only chosen blocks of coordinates at a time.
result Retains optimal breakdown point of 0.5 for smooth non-convex problems.
Efficient SVD algorithm robust to outliers.
problem Outliers in data matrix affect SVD accuracy and speed.
method Spherically Normalized SVD (SpherSVD) algorithm.
result Significantly faster and more robust than existing methods.
Distributed Robust Learningstat.ML
We propose a framework for distributed robust statistical learning on {\em big contaminated data}. The Distributed Robust Learning (DRL) framework can reduce the computational time of traditional robust learning methods by several orders of magnitude. We analyze the robustness property of DRL, showing that DRL not only…
Proposes a robust factor analysis for matrix data.
problem Robust factor analysis for matrix data with heavy-tailed or contaminated data.
method Bilinear factor analysis based on the matrix-variate distribution.
result Significantly higher breakdown point than traditional methods.
This work uses neural density estimation to analyze laser-induced breakdown spectroscopy data, enabling accurate predictions and uncertainty quantification.
problem Inference of probability densities in high-dimensional spectral data is often intractable.
method Normalizing flows on structured spectral latent spaces for density estimation and uncertainty quantification.
result The approach enables generation of realistic spectral samples and accurate prediction of state vectors with well-calibrated uncertainties.
New robust estimator for high-dimensional data with outliers and leverage points.
problem Robust regression in high-dimensional datasets with gross contamination.
method Adaptive τ-Lasso estimator with an adaptive ℓ1-norm penalty.
result Adaptive τ-Lasso has the oracle property and robustness to outliers and high-leverage points.
We consider principal component analysis for contaminated data-set in the high dimensional regime, where the dimensionality of each observation is comparable or even more than the number of observations. We propose a deterministic high-dimensional robust PCA algorithm which inherits all theoretical properties of its ra…
The paper analyzes GTD algorithms with finite-sample bounds.
problem Convergence rate analysis of GTD family of algorithms.
method Formulated as stochastic gradient algorithms and analyzed using saddle-point error.
result Obtained finite-sample bounds on GTD performance.
Robust estimation methods find global minima efficiently via quasi-gradients.
problem Efficiently solving robust estimation problems with non-convex optimization.
method Identifying generalized quasi-gradients to guarantee low-regret algorithms.
result Generalized quasi-gradients ensure efficient approximation of global minima.
The recent "correlation breakdown" in the modeling of credit default swaps, in which model correlations had to exceed 100% in order to reproduce market prices of supersenior tranches, is analyzed and argued to be a fundamental market inconsistency rather than an inadequacy of the specific model. As a consequence, marke…
In this paper we propose a new method to assist in labeling data arriving from fast running processes using anomaly detection. A result is the possibility to manually classify data arriving at a high rates to train machine learning models. To circumvent the problem of not having a real ground truth we propose specific …
Study improves robustness of Bayesian inference for cognitive models.
problem Outliers and contaminants affect parameter estimation in cognitive models.
method Robustness of parameter estimation using amortized Bayesian inference (ABI) with neural networks.
result Introducing contaminants from a Cauchy distribution increases robustness.
Paper introduces robust methods for consensus ranking in AI systems.
problem Developing reliable ranking systems in AI despite contaminated data.
method Introduces robustness concepts and statistical methods for consensus ranking.
result Proposes extensions of breakdown point for consensus ranking.
Residential homes constitute roughly one-fourth of the total energy usage worldwide. Providing appliance-level energy breakdown has been shown to induce positive behavioral changes that can reduce energy consumption by 15%. Existing approaches for energy breakdown either require hardware installation in every target ho…
The paper is concerned with regularity properties of boundaries of causal pasts of points in a 3+1-dimensional Einstein-vacuum spacetime. In a Lorentzian manifold such boundaries play crucial role in propagation of linear and nonlinear waves. We prove a uniform lower bound on the radius of injectivity of these null bou…
A new pseudo-metric uses data depth to compare probability distributions.
problem Designing a metric between probability distributions for machine learning applications.
method Extension of univariate quantiles to multivariate spaces, using data depth and Hausdorff distance.
result The pseudo-metric is robust, factorizes translations, and has good behavior under transformations.
Complex models are commonly used in predictive modeling. In this paper we present R packages that can be used to explain predictions from complex black box models and attribute parts of these predictions to input features. We introduce two new approaches and corresponding packages for such attribution, namely live and …
Unified AI detection framework for various artifacts.
problem Effective oversight and regulation of AI deployment.
method Unified detection framework based on Mahalanobis distance scores (MDS).
result Efficient and robust estimation of covariance matrix for positive samples.
Let $\M_*=\cup_{t\in [t_0, t_*)} Σ_t$ be a part of vacuum globally hyperbolic space-time $(\bM, \bg)$, foliated by constant mean curvature hypersurfaces with . We show that the foliation can be extended beyond if the second fundamental form and the lapse function satisfy $$ \int_{t_0}^{t_…
New robust learning framework for regression NNs using β-divergences.
problem Outliers and data contamination in regression NNs training.
method Proposes rRNet based on β-divergence for robust learning of regression NNs.
result rRNet achieves optimal 50% asymptotic breakdown point for all β ∈ (0, 1].
A new method preserves useful information in data rows with outlying cells.
problem Preserving useful information in data rows with outlying cells.
method Cellwise robust Minimum Covariance Determinant (cellMCD) method using observed likelihood and a penalty term on cellwise outliers.
result The cellMCD method performs well in simulations and on real data.
Estimator calculates surface curvature from point cloud samples.
problem Accurately estimating curvature from limited point cloud data.
method Algorithm using probability distribution and nearby points control.
result Controlled number of points ensures accurate curvature estimation.
The paper develops AMP theory for sparse and robust regression with polynomial iterations.
problem Challenges in high-dimensional statistical estimation due to asymptotic theory breakdown.
method Non-asymptotic distributional theory of AMP for sparse and robust regression.
result First finite-sample non-asymptotic distributional theory of AMP for polynomial iterations.
Statistical Facts of Artificial Stock Marketcond-mat.other
The paper reports the construction of artificial stock market that emerges the similar statistical facts with real data in Indonesian stock market. We use the individual but dominant data, i.e.: PT TELKOM in hourly interval. The artificial stock market shows standard statistical facts, e.g.: volatility clustering, the …
Develops a method to detect changes in linear systems with temporal correlations.
problem Detect abrupt changes in time series data with temporal correlations.
method Data-dependent threshold for online change point detection in linear dynamical systems.
result Achieves a pre-specified upper bound on the probability of false alarms and provides a finite-sample-based bound for detection probability.
New method for robust financial portfolio analysis.
problem Challenges in modeling financial portfolio dependence structure.
method Nonparametric Angles-based Correlation (NAbC) method.
result Valid inferences and flexible scenarios for portfolio analysis.
Target search optimization by threshold resettingcond-mat.stat-mech
Optimizes search times by resetting agents when a threshold is reached.
problem Improving search efficiency in systems with thresholds.
method Develops a framework for correlated stochastic processes with threshold resetting.
result Optimal resetting can prevent larger losses and is applicable to various stochastic systems.
Superstatistics is a widely employed tool of non-equilibrium statistical physics which plays an important role in analysis of hierarchical complex dynamical systems. Yet, its "canonical" formulation in terms of a single nuisance parameter is often too restrictive when applied to complex empirical data. Here we show tha…
A Lyapunov Theory for Finite-Sample Guarantees of Asynchronous Q-Learning and TD-Learning Variantscs.LG
Unified framework for finite-sample RL algorithms using Lyapunov theory.
problem Finite-sample convergence guarantees of asynchronous RL algorithms.
method Reformulate RL algorithms as Markovian SA, develop Lyapunov analysis.
result Mean-square error bounds and convergence for various RL algorithms.
Unified framework for solving fixed-point equations in deterministic and stochastic settings.
problem Solving fixed-point equations for seminorm-contractive operators in both deterministic and stochastic contexts.
method Fixed-point theorem and stochastic approximation analysis.
result Unified finite-sample bounds for various reinforcement learning algorithms.
New algorithm detects changes in heavy-tailed data streams.
problem Detecting changes in heavy-tailed data streams.
method Clipped Stochastic Gradient Descent (SGD) combined with union bound.
result First algorithm with finite-sample false-positive rate guarantees for heavy-tailed data.
Regularization of minimization for dealing with outliers and noise in Statistics and Signal Recoverymath.OC
We study the robustness properties of norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error analysis of the estimator for measurements errors consisting of outliers coupled with noise. We…
New winsorized mean improves robustness to up to 50% contamination.
problem Improving robustness of mean estimation in the presence of outliers.
method Outlyingness-induced winsorized mean approach.
result Achieves up to 50% contamination robustness with sub-Gaussian performance.
In reinforcement learning (RL) , one of the key components is policy evaluation, which aims to estimate the value function (i.e., expected long-term accumulated reward) of a policy. With a good policy evaluation method, the RL algorithms will estimate the value function more accurately and find a better policy. When th…
The paper introduces a frequency-domain estimator for low-order systems from noisy data.
problem Estimating frequency responses of low-order systems from noisy measurements.
method Uses a quadratic data-fitting term regularized by the nuclear norm of a Loewner matrix, subject to a convex stability constraint.
result Proves a finite-sample error bound and extends it to all frequencies through rational interpolation.