New research extends optimal transport map breakdown properties to general costs.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New method prevents neural network breakdown by combining trimmed loss and variation regularization.
Adapting robust statistics to neural networks, researchers found neural networks can be more robust with certain loss functions.
Paper analyzes robustness of MDPDE under INH setups.
Let $\M_*=\cup_{t\in [t_0, t_*)} Σ_t$ be a part of vacuum globally hyperbolic space-time $(\bM, \bg)$, foliated by constant mean curvature hypersurfaces with . We show that the foliation can be extended beyond if the second fundamental form and the lapse function satisfy $$ \int_{t_0}^{t_…
We formalize notions of robustness for composite estimators via the notion of a breakdown point. A composite estimator successively applies two (or more) estimators: on data decomposed into disjoint parts, it applies the first estimator on each part, then the second estimator on the outputs of the first estimator. And …
We analyze the performance of the Tukey median estimator under total variation (TV) distance corruptions. Previous results show that under Huber's additive corruption model, the breakdown point is 1/3 for high-dimensional halfspace-symmetric distributions. We show that under TV corruptions, the breakdown point reduces …
Unified framework for Byzantine robust gossip algorithms with guaranteed performance.
This work uses neural density estimation to analyze laser-induced breakdown spectroscopy data, enabling accurate predictions and uncertainty quantification.
The support vector machine (SVM) is one of the most successful learning methods for solving classification problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The penalty on misclassification is defined by a convex loss called the hinge loss, and the unboun…
New algorithm estimates edge density of random graphs robustly, achieving optimal breakdown point.
Optimizes search times by resetting agents when a threshold is reached.
Paper solves outlier robust mean estimation near breakdown point.
The recent "correlation breakdown" in the modeling of credit default swaps, in which model correlations had to exceed 100% in order to reproduce market prices of supersenior tranches, is analyzed and argued to be a fundamental market inconsistency rather than an inadequacy of the specific model. As a consequence, marke…
Residential homes constitute roughly one-fourth of the total energy usage worldwide. Providing appliance-level energy breakdown has been shown to induce positive behavioral changes that can reduce energy consumption by 15%. Existing approaches for energy breakdown either require hardware installation in every target ho…
Complex models are commonly used in predictive modeling. In this paper we present R packages that can be used to explain predictions from complex black box models and attribute parts of these predictions to input features. We introduce two new approaches and corresponding packages for such attribution, namely live and …
Proposes MPCA for robust PCA using mode estimation.
Study improves robustness of Bayesian inference for cognitive models.
WPCA improves subspace recovery robustness to outliers.
We consider the dimensionality-reduction problem (finding a subspace approximation of observed data) for contaminated data in the high dimensional regime, where the number of observations is of the same magnitude as the number of variables of each observation, and the data set contains some (arbitrarily) corrupted obse…
New robust learning framework for regression NNs using β-divergences.
Paper analyzes neural network distances and stability, leading to a new learning rule.
Superstatistics is a widely employed tool of non-equilibrium statistical physics which plays an important role in analysis of hierarchical complex dynamical systems. Yet, its "canonical" formulation in terms of a single nuisance parameter is often too restrictive when applied to complex empirical data. Here we show tha…
Paper shows how to use geometric median for robust SGD in high dimensions.
Efficient SVD algorithm robust to outliers.
The importance weighted autoencoder (IWAE) (Burda et al., 2016) is a popular variational-inference method which achieves a tighter evidence bound (and hence a lower bias) than standard variational autoencoders by optimising a multi-sample objective, i.e. an objective that is expressible as an integral over Mont…
We study the wealth distribution of the Bouchaud--Mézard (BM) model on complex networks. It has been known that this distribution depends on the topology of network by numerical simulations, however, no one have succeeded to explain it. Using "adiabatic" and "independent" assumptions along with the central-limit theore…
Proposes a robust factor analysis for matrix data.
New findings show Gaussian universality breaks down in high-dimensional linear factor mixtures.
In this paper we explore the functional correlation approach to operational risk. We consider networks with heterogeneous a-priori conditional and unconditional failure probability. In the limit of sparse connectivity, self-consistent expressions for the dynamical evolution of order parameters are obtained. Under equil…
In this paper we propose a new method to assist in labeling data arriving from fast running processes using anomaly detection. A result is the possibility to manually classify data arriving at a high rates to train machine learning models. To circumvent the problem of not having a real ground truth we propose specific …
We propose a framework for distributed robust statistical learning on {\em big contaminated data}. The Distributed Robust Learning (DRL) framework can reduce the computational time of traditional robust learning methods by several orders of magnitude. We analyze the robustness property of DRL, showing that DRL not only…
Instead of investigating the Willmore flow for two-dimensional, closed immersed surfaces directly we turn to its inversion. We give a lower bound on the lifespan of this inverse Willmore flow, depending on the concentration of curvature in space and the extension of the initial surface, as well as a characterization of…
Study on dropout in neural networks using percolation theory.
The main objective of this paper is to control the geometry of null cones with time foliation in Einstein vacuum spacetime under the assumptions of small curvature flux and a weaker condition on the deformation tensor for $\bT$. We establish a series of estimates on Ricci coefficients, which plays a crucial role to pro…
A new robust PCA estimator combining M-estimators and minimum divergence estimators.
We compare our results on empirical analysis of financial data with simulations of two stochastic models of the dynamics of stock market prices. The two models are (i) the truncated Lévy flight recently introduced by us and (ii) the ARCH(1) and GARCH(1,1) processes. We find that the TLF well describes the scaling and i…
Graph neural networks detect structural perturbations from time series data.
Graph auto-encoders predict stock market instability by measuring graph structure changes.
The study uncovers the breakdown of Gaussian universality in high-dimensional empirical risk minimization.
Paper introduces robust methods for consensus ranking in AI systems.
The paper is concerned with regularity properties of boundaries of causal pasts of points in a 3+1-dimensional Einstein-vacuum spacetime. In a Lorentzian manifold such boundaries play crucial role in propagation of linear and nonlinear waves. We prove a uniform lower bound on the radius of injectivity of these null bou…
Theoretical framework for M-posteriors connects Bayesian and frequentist statistics.
A theory of cellwise contamination for compositional data using log-ratios.
We investigate the macroeconomic consequences of narrow banking in the context of stock-flow consistent models. We begin with an extension of the Goodwin-Keen model incorporating time deposits, government bills, cash, and central bank reserves to the base model with loans and demand deposits and use it to describe a fr…
Unified AI detection framework for various artifacts.
The behavior of geodesic curves on even seemingly simple surfaces can be surprisingly complex. In this paper we use the Hamiltonian formulation of the geodesic equations to analyze their integrability properties. In particular, we examine the behavior of geodesics on surfaces defined by the spherical harmonics. Using t…
We consider principal component analysis for contaminated data-set in the high dimensional regime, where the dimensionality of each observation is comparable or even more than the number of observations. We propose a deterministic high-dimensional robust PCA algorithm which inherits all theoretical properties of its ra…