Proposes a new method to prevent overfitting in deep neural networks.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Sharp bounds for distortion risk metrics under uncertain distributions.
LP-FT improves personalized model training in FL by balancing generalization and personalization.
This paper presents a novel kernel-based generative classifier which is defined in a distortion subspace using polynomial series expansion, named Kernel-Distortion (KD) classifier. An iterative kernel selection algorithm is developed to steadily improve classification performance by repeatedly removing and adding kerne…
Feature Learning aims to extract relevant information contained in data sets in an automated fashion. It is driving force behind the current deep learning trend, a set of methods that have had widespread empirical success. What is lacking is a theoretical understanding of different feature learning schemes. This work p…
We formalise the widespread idea of interpreting neural network decisions as an explicit optimisation problem in a rate-distortion framework. A set of input features is deemed relevant for a classification decision if the expected classifier score remains nearly constant when randomising the remaining features. We disc…
Vertex distortion detects if a knot is unknot.
Small neural networks embed arbitrary metric spaces into Gaussian mixtures.
Recent studies have highlighted the vulnerability of deep neural networks (DNNs) to adversarial examples - a visually indistinguishable adversarial image can easily be crafted to cause a well-trained model to misclassify. Existing methods for crafting adversarial examples are based on and distortion me…
This work analyzes how frequency components affect CNN predictions and robustness.
FID misaligns with human judgment due to reliance on ImageNet classes.
Algorithm finds optimal affine transformation to minimize overall distortion.
The paper addresses risk sharing and variability measures among agents with general risk preferences.
New method learns disentangled representations using Gromov-Monge maps.
Vertex distortion measures how far lattice knots deviate from straight lines.
We consider the problem of distortion minimal morphing of -dimensional compact connected oriented smooth manifolds without boundary embedded in . Distortion involves bending and stretching. In this paper, minimal distortion (with respect to stretching) is defined as the infinitesimal relative change in vol…
This paper shows how to calculate risk measures for sums of two counter-monotonic risks.
Most distortion correction methods focus on simple forms of distortion, such as radial or linear distortions. These works undistort images either based on measurements in the presence of a calibration grid, or use multiple views to find point correspondences and predict distortion parameters. When possible distortions …
Study distortion risk measures for step-weighted distributions.
SISR improves feature attribution in complex payoff schemes.
The distortion of a curve measures the maximum arc/chord length ratio. Gromov showed any closed curve has distortion at least pi/2 and asked about the distortion of knots. Here, we prove that any nontrivial tame knot has distortion at least 5pi/3; examples show that distortion under 7.16 suffices to build a trefoil kno…
Computed distortion coefficients for the α-Grushin plane.
Study on risk measures using distorted Choquet integrals with random distortions.
QC-SPHARM detects Alzheimer's Disease early using hippocampal surface geometry.
Feature Squeezing is a recently proposed defense method which reduces the search space available to an adversary by coalescing samples that correspond to many different feature vectors in the original space into a single sample. It has been shown that feature squeezing defenses can be combined in a joint detection fram…
We study a generalized family of stochastic orders, semiparametrized by a distortion function H, namely H-distorted stochastic dominance, which may determine a continuum of dominance relations from the first- to the second-order stochastic dominance (and beyond). Such a family is especially suitable for representing a …
Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line of work and present low distortion embeddings for dot product kernels into linear…
We show that an entire branched cover of finite distortion cannot have a compact branch set if its distortion satisfies a certain asymptotic growth condition. We furthermore show that this bound is strict by constructing an entire, continuous, open and discrete mapping of finite distortion which is piecewise smooth, ha…
After being trained, classifiers must often operate on data that has been corrupted by noise. In this paper, we consider the impact of such noise on the features of binary classifiers. Inspired by tools for classifier robustness, we introduce the same classification probability (SCP) to measure the resulting distortion…
The distortion of a curve is the supremum, taken over distinct pairs of points of the curve, of the ratio of arclength to spatial distance between the points. Gromov asked in 1981 whether a curve in every knot type can be constructed with distortion less than a universal constant C. Answering Gromov's question seems to…
Graph convolutional neural networks (GCNs) embed nodes in a graph into Euclidean space, which has been shown to incur a large distortion when embedding real-world graphs with scale-free or hierarchical structure. Hyperbolic geometry offers an exciting alternative, as it enables embeddings with much smaller distortion. …
The study shows exponential distortion in virtually special groups containing free subgroups.
Estimates rate-distortion function for large datasets using neural networks.
We construct 2-dimensional CAT(-1) groups which contain free subgroups with arbitrary iterated exponential distortion, and with distortion higher than any iterated exponential.
New coding theorem shows achievable rate matches theoretical limit.
Paper proposes a new black-box attack approach to minimize visual distortion.
Study dynamic risk measures and performance indices using distortion functions.
New bounds on knot distortion and Seifert surface properties.
In this paper, we compute the subgroup distortion of all finitely generated subgroups of all finitely generated 3-manifold groups, and the subgroup distortion in this case can only be linear, quadratic, exponential and double exponential. It turns out that the subgroup distortion of a subgroup of a 3-manifold group is …
The problem behind this paper is the proper measurement of the degree of quality/acceptability/distance to arbitrage of trades. We are narrowing the class of coherent acceptability indices introduced by Cherny and Madan (2007) by imposing an additional mathematical property. For this, we introduce the notion of a conca…
New method tests risk measures for various distortions.
Lossy compression algorithms are typically designed and analyzed through the lens of Shannon's rate-distortion theory, where the goal is to achieve the lowest possible distortion (e.g., low MSE or high SSIM) at any given bit rate. However, in recent years, it has become increasingly accepted that "low distortion" is no…
We study the statistical meaning of the minimization of distortion measure and the relation between the equilibrium points of the SOM algorithm and the minima of distortion measure. If we assume that the observations and the map lie in an compact Euclidean space, we prove the strong consistency of the map which almost …
It is known that the surface of a cone over the unit disc with large height has smaller distortion than the standard embedding of the 2-sphere in . In this note we show that distortion minimisers exist among convex embedded 2-spheres and have uniformly bounded eccentricity. Moreover, we prove that is…
A new framework for robust transfer learning that avoids negative transfer in domains with unequal information.
We introduce a new notion of conditional nonlinear expectation under probability distortion. Such a distorted nonlinear expectation is not sub-additive in general, so it is beyond the scope of Peng's framework of nonlinear expectations. A more fundamental problem when extending the distorted expectation to a dynamic se…
We discuss equivalent axiomatic characterizations of distortion risk measures, and give a novel and concise proof of the characterization of elicitable distortion risk measures. Elicitability has recently been discussed as a desirable criterion for risk measures, motivated by statistical considerations of forecasting. …
FMix improves model performance by distorting learned functions without distorting data distribution.