Study shows infinite distinct outer metric Lipschitz classes for knots in S3.
problem Lipschitz classification of surface singularities in R4. method Outer metric Lipschitz equivalence and topological equivalence of knots.
result Infinitely many distinct outer metric Lipschitz classes for knots in S3. This paper examines weight initialization for 1-Lipschitz networks to improve robustness against adversarial attacks.
problem Improving the robustness of deep neural networks against adversarial attacks.
method Examined weight parametrization of AOL and SLL networks, calculated weight variance bounds, and demonstrated weight decay.
result Weight initialization causes deep 1-Lipschitz networks to decay to zero, and weight variance does not affect output variance distribution.
Classifies semi-algebraic surfaces up to bi-Lipschitz homeomorphisms.
problem Classifying semi-algebraic surfaces with isolated singularities.
method Bi-Lipschitz homeomorphisms with inner distance.
result Complete classifications for Nash surfaces and complex algebraic curves.
Study bi-Lipschitz equivalence of mixed polynomials under specific conditions.
problem Classify bi-Lipschitz equivalence of mixed polynomials with inner non-degeneracy.
method Defined metric links and introduced new data to determine bi-Lipschitz equivalence.
result Neither Newton boundary nor C-face diagram is an invariant for bi-Lipschitz equivalence.
Improved robustness of 1D CNNs for heart arrhythmia classification.
problem Improving the robustness of 1D CNNs for classification tasks.
method Parameterization using Cayley transform and controllability Gramian for Lipschitz-bounded CNNs.
result Improved robustness of trained Lipschitz-bounded 1D CNNs for heart arrhythmia classification.
Privacy affects fairness in classification models, but not drastically.
problem The impact of differential privacy on fairness in classification models.
method Theoretical analysis proving Lipschitz continuity of fairness measures and a non-asymptotic bound on fairness levels.
result Privacy impacts fairness, but not significantly as the number of samples increases.
1-Lipschitz networks are as accurate as classical networks and offer robustness.
problem Misconceptions about 1-Lipschitz neural networks and their properties.
method Analysis of 1-Lipschitz neural networks' accuracy, robustness, and generalization.
result 1-Lipschitz neural networks are as accurate as classical networks and can fit arbitrarily difficult boundaries.
The paper extends a measure preserving property to bi-Lipschitz maps between Moran sets.
problem Extending the measure preserving property to Moran sets.
method Analyzing bi-Lipschitz maps between Moran sets.
result Bi-Lipschitz maps between Moran sets preserve measure locally.
A scattering transform defines a signal representation which is invariant to translations and Lipschitz continuous relatively to deformations. It is implemented with a non-linear convolution network that iterates over wavelet and modulus operators. Lipschitz continuity locally linearizes deformations. Complex classes o…
Optimistic bounds for multi-output learning using self-bounding Lipschitz condition.
problem Learning vector-valued functions from supervised data.
method Introducing self-bounding Lipschitz condition and proving optimistic bounds using local Rademacher complexity and Srebro's inequality.
result Minimax optimal generalization bounds for multi-output learning, up to logarithmic factors.
This note is concerned with the geometric classification of connected Lie groups of dimension three or less, endowed with left-invariant Riemannian metrics. On the one hand, assembling results from the literature, we give a review of the complete classification of such groups up to quasi-isometries and we compare the q…
New framework enhances neural network robustness against adversarial attacks.
problem Vulnerability of deep neural networks to small perturbations.
method Integrates Lipschitz constraint using optimal transport and hinge regularization.
result Proposes a new loss function that certifies adversarial robustness.
New parameterization of neural networks with Lipschitz bounds for robustness.
problem Developing robust neural networks with Lipschitz bounds.
method Introducing a new parameterization that admits a Lipschitz bound during training without requiring projections or barrier functions.
result The new parameterization improves robustness to adversarial attacks in image classification.
We investigate online classification with paid stochastic experts. Here, before making their prediction, each expert must be paid. The amount that we pay each expert directly influences the accuracy of their prediction through some unknown Lipschitz "productivity" function. In each round, the learner must decide how mu…
The paper calculates upper bounds on ReLU network Lipschitz constants.
problem Determining the maximum perturbation size for robustness of neural networks.
method Analyzing ReLU, affine-ReLU, and max pooling functions; combining results; tracking zero elements; using a computational approach.
result The method produces the largest known bounds on minimum adversarial perturbations for large networks.
New approach to certifiably robust neural networks using Boolean function perspective.
problem Lack of principled understanding and certified robustness for ℓ∞ perturbations. method New perspective on Boolean functions, deriving impossibility results, and developing a unified Lipschitz network.
result Unified Lipschitz network that bypasses expressive power limitations and achieves better certified robustness.
CLIP controls neural network stability by bounding Lipschitz constants.
problem Neural networks lack mathematical guarantees of stability, especially to adversarial examples.
method Develops a variational regularization method (CLIP) to control the Lipschitz constant of neural networks.
result CLIP provides a tighter bound on the actual Lipschitz constant compared to layer-wise methods.
We provide bi-Lipschitz invariants for finitely determined map germs f:(Kn,0)→(Kp,0), where K=R or C. The aim of the paper is to provide partial answers to the following questions: Does the bi-Lipschitz type of a map germ $f: (\mathbb{R}^n, 0) \to (\mathbb{R…
Muon fails to converge on convex Lipschitz functions.
problem Understanding the convergence of Muon on convex and Lipschitz functions.
method Analyzing Muon's performance on convex and Lipschitz functions without error feedback.
result Muon does not converge on convex and Lipschitz functions, regardless of learning rate schedule.
In binary classification and regression problems, it is well understood that Lipschitz continuity and smoothness of the loss function play key roles in governing generalization error bounds for empirical risk minimization algorithms. In this paper, we show how these two properties affect generalization error bounds in …
We give a new approach to the infinitesimal structure of Lipschitz maps into L^1. As a first application, we give an alternative proof of the main theorem from an earlier paper, that the Heisenberg group does not admit a bi-Lipschitz embedding in L^1. The proof uses the metric differentiation theorem of Pauls and the c…
Paper studies geometric and combinatorial properties of circular snakes.
problem Exploring geometric and combinatorial properties of circular snakes.
method Definition and investigation of outer Lipschitz geometry, decomposition of Valette link, construction of combinatorial objects, weakly outer Lipschitz classification.
result Existence of canonical decomposition and necessary/sufficient criteria for removing segments or Hölder triangles.
Paper defines topology automaton for Barański carpets and proves Hölder equivalence conditions.
problem Tackles Hölder equivalence of Barański carpets.
method Defines topology automaton and applies method from previous studies.
result Obtains sufficient condition for Hölder equivalence of Barański carpets.
Lipschitz normalization boosts deep attention models, especially for graph neural networks.
problem Gradient explosion in deep graph attention networks leads to poor performance.
method Enforcing Lipschitz continuity by normalizing attention scores.
result Deep GAT models with LipschitzNorm achieve state-of-the-art results for tasks with long-range dependencies.
Recent advances in large-margin classification of data residing in general metric spaces (rather than Hilbert spaces) enable classification under various natural metrics, such as string edit and earthmover distance. A general framework developed for this purpose by von Luxburg and Bousquet [JMLR, 2004] left open the qu…
The study examines generalization bounds for regression and classification tasks on adaptive input domains.
problem Understanding the generalization error in adaptive input domains for regression and classification.
method The analysis considers regression and classification separately, using Lipschitz continuity and 2-norm/0/1 loss for measurement. It also highlights the polynomial relationship between generalization bounds and network parameters.
result Generalization bounds for regression and classification are inversely proportional to a polynomial of the number of parameters, emphasizing the advantages of over-parameterized networks.
Prototype rules simplify multiclass classification in metric spaces, achieving consistency and reduced complexity.
problem Multiclass classification in metric spaces, focusing on universal consistency and convergence rates.
method Novel Proto-NN and hybrid rules for multiclass classification in metric spaces, analyzing convergence rates.
result Proto-NN is universally consistent and simpler to implement, with similar computational advantages.
New framework improves robustness of implicit neural networks.
problem Ill-posedness and convergence instability in implicit neural networks.
method NEMON framework based on contraction theory for ℓ∞ norm, including well-posedness condition, average iteration, and input-output Lipschitz constant regularization. result Improved accuracy and robustness of implicit models with smaller input-output Lipschitz bounds.
We show that the log-likelihood of several probabilistic graphical models is Lipschitz continuous with respect to the lp-norm of the parameters. We discuss several implications of Lipschitz parametrization. We present an upper bound of the Kullback-Leibler divergence that allows understanding methods that penalize the …
We provide a new local class-purity theorem for Lipschitz continuous DNN classifiers. In addition, we discuss how to achieve classification margin for training samples. Finally, we describe how to compute margin p-values for test samples.
Let (M,g) be a pseudo-Riemannian manifold of signature (p,q). We construct mutually quasi-inverse equivalences between the groupoid of bundles of weakly-faithful complex Clifford modules on (M,g) and the groupoid of reduced complex Lipschitz structures on (M,g). As an application, we show that (M,g) admits a …
This thesis uses Kantorovich-Rubinstein distance for classifying points based on their measures.
problem Classifying points based on their measures in a metric space.
method Using Kantorovich-Rubinstein distance as a metric in the space of measures to capture geometry and topology.
result A large Kantorovich-Rubinstein distance indicates the existence of a 1-Lipschitz classifier that well classifies the points.
Develops high-dimensional measurement error models for non-linear loss functions.
problem Measurement errors in ultrahigh-dimensional biomedical data.
method Lipschitz loss functions, L1 norm minimization, Lasso analog.
result Improved accuracy in classification and quantile regression problems.
Study minimax rates for binary classifier estimation with margin conditions.
problem Estimating binary classifiers with geometric margin conditions.
method Derive lower bounds for worst-case learning rates over various function classes.
result Identify optimal rates close to O(n−1) for different function classes. We give a generalization of a theorem of Bôcher for the Laplace equation to a class of conformally invariant fully nonlinear degenerate elliptic equations. We also prove a Harnack inequality for locally Lipschitz viscosity solutions and a classification of continuous radially symmetric viscosity solutions.
Paper analyzes robustness of non-Lipschitz networks, proving powerful adversarial attacks but offering solutions.
problem Adversarial attacks on deep networks, especially non-Lipschitz networks.
method Developed an attack model that abstracts the challenge of adversarial robustness, proving the power of such attacks and offering solutions.
result Proves powerful adversarial attacks on non-Lipschitz networks but offers solutions with abstention.
Neural networks are dense among Lipschitz functions with fixed Lipschitz constant.
problem Characterizing neural network approximations to Lipschitz functions.
method Analyzing L-Lipschitz neural networks and their density in L-Lipschitz functions. result One layer neural networks are dense in the set of all L-Lipschitz functions. Exciting new work on the generalization bounds for neural networks (NN) given by Neyshabur et al. , Bartlett et al. closely depend on two parameter-depenedent quantities: the Lipschitz constant upper-bound and the stable rank (a softer version of the rank operator). This leads to an interesting question of whether cont…
In this paper angular curvature measures are investigated. Our first result is a complete classification of translation-invariant angular smooth curvature measures on Rn. Subsequently, we use this result to show that the class of angular curvature measures on a Riemannian manifold is preserved by both the p…
Constructs a map with prescribed local Lipschitz constants on a subset of a manifold.
problem Creating a Lipschitz map with specific local Lipschitz constants on a subset of a manifold.
method Constructs a Lipschitz map that matches a given map on a subset and has a local Lipschitz constant defined by a continuous function.
result A Lipschitz map can be constructed with a local Lipschitz constant prescribed by a continuous function.
Maps between certain Lipschitz manifolds are isometries if they preserve volume.
problem Volume preservation and isometry conditions for Lipschitz manifolds.
method Volume-preserving 1-Lipschitz maps from integral currents onto infinitesimally Euclidean Lipschitz manifolds.
result Volume-preserving maps are isometries under given conditions.
This work analyzes how deep neural networks' expressiveness increases with depth and width.
problem Understanding the expressiveness of deep neural networks (DNNs) based on their Lipschitz constants.
method Leveraging random matrix theory, the study characterizes the expressiveness of DNNs by their Lipschitz constant, showing exponential and polynomial increases with depth and width, respectively.
result The expressiveness of DNNs increases exponentially with depth and polynomially with width, consistent with function approximation benefits.
Abstract: Lipschitz homeomorphisms are deformed using Perelman's methods.
problem Deformation of Lipschitz homeomorphisms
method Lipschitz analogues of Siebenmann's and Perelman's homeomorphism theory
result Lipschitz stability theorem and gluing theorem
We compute the local Lipschitz constant of ReLU networks precisely.
problem Estimating the local Lipschitz constant of ReLU networks is hard.
method We use a novel approach involving the generalized Jacobian and backpropagation.
result We provide an algorithm to compute the exact Lipschitz constant of ReLU networks.
We give the first part of a proof of Thurston's Ending Lamination conjecture. In this part we show how to construct from the end invariants of a Kleinian surface group a ``Lipschitz model'' for the thick part of the corresponding hyperbolic manifold. This enables us to describe the topological structure of the thick pa…
The study examines the limitations of bi-Lipschitz Normalizing Flows in approximating certain distributions.
problem The expressivity of bi-Lipschitz Normalizing Flows in approximating specific target distributions.
method Characterization of expressivity through lower bounds on Total Variation distance and discussion of potential remedies.
result Several target distributions are difficult to approximate using bi-Lipschitz Normalizing Flows, and lower bounds on their approximation are provided.
Novikov conjecture reduced to Lipschitz cohomology of groups.
problem Novikov higher signature conjecture for groups.
method Introducing Lipschitz cohomology classes and reducing the conjecture.
result Reduced Novikov conjecture to Lipschitz cohomology.
We examine the impact of learning Lipschitz continuous models in the context of model-based reinforcement learning. We provide a novel bound on multi-step prediction error of Lipschitz models where we quantify the error using the Wasserstein metric. We go on to prove an error bound for the value-function estimate arisi…