Proves planar Lipschitz critical points of area functional are smooth.
problem Lawson-Osserman conjecture about smoothness of critical points.
method Outer variations to prove smoothness of critical points.
result Proves conjecture for planar case.
Bi-Lipschitz proof for 2-varifolds near critical Allard condition.
problem Proving bi-Lipschitz homeomorphism for 2-varifolds near critical Allard condition.
method Analyzing 2-varifolds with critical Allard condition and small mean curvature.
result 2-varifold is bi-Lipschitz homeomorphic to a flat disk.
We show that any smooth bi-Lipschitz h can be represented exactly as a composition hm∘...∘h1 of functions h1,...,hm that are close to the identity in the sense that each (hi−Id) is Lipschitz, and the Lipschitz constant decreases inversely with the number m of functions com…
Introduces Grassmann Distance Complexity to measure algebraic set nearest point problems.
problem Measuring complexity of finding nearest points in Grassmannian space.
method Uses Lipschitz critical point theory and o-minimal geometry.
result Establishes fundamental properties of GDC, including bounds and finiteness conditions.
Defines weak geodesics on specific subsets of manifolds.
problem Characterizing geodesics on prox-regular subsets of Riemannian manifolds.
method Defining weak geodesics as continuous curves with weak regularities, and characterizing them as viscosity critical points of the energy functional.
result Characterizes weak geodesics on prox-regular subsets of Riemannian manifolds.
Accelerated method finds critical points faster on manifolds.
problem Optimization on non-convex manifolds.
method Accelerated gradient methods on Riemannian manifolds.
result Find approximate first-order critical points faster than regular gradient descent.
Paper provides estimates for varifolds with critical mean curvature.
problem Estimating tilt-excess on varifolds with critical mean curvature.
method Generalizing Lipschitz approximation and Sobolev-Poincaré estimates to almost-integral rectifiable varifolds.
result VMO-type estimates for quadratic tilt-excess on varifolds with critical mean curvature.
The paper studies harmonic graphs in the Heisenberg group and their properties.
problem No analogous theorem exists for H-minimal surfaces in the Heisenberg group. method Introduced intrinsic Dirichlet energy and studied its critical points (contact harmonic graphs).
result Calibration condition and construction of energy-minimizing graphs with various singularities.
As our main theorem, we prove that a Lipschitz map from a compact Riemannian manifold M into a Riemannian manifold N admits a smooth approximation via immersions if the map has no singular points on M in the sense of F.H. Clarke, where dimM≤dimN. As its corollary, we have that if a bi-Lipschitz homeomo…
Adaptive LR improves neural network Lipschitz regularity without slowing convergence.
problem Training neural networks with high Lipschitz constant.
method Adaptive learning rate (decay) in gradient descent for two-layer networks.
result Decaying learning rate maintains convergence rate and Lipschitz regularity.
We generalize the notion of integral Menger curvature introduced by Gonzalez and Maddocks by decoupling the powers in the integrand. This leads to a new two-parameter family of knot energies intMp,q. We classify finite-energy curves in terms of Sobolev-Slobodeckij spaces. Moreover, restricting to the range of para…
Develops analysis of weak immersions with bounded second fundamental forms in critical Sobolev space.
problem Analyzing weak immersions with bounded second fundamental forms in a critical Sobolev space.
method Develops analysis of Lipschitz immersions with bounded second fundamental forms in W2n−1,2 space. result Proves existence of C1 differential structure from weak immersions with bounded second fundamental forms. Efficient local Lipschitz bounds improve neural network robustness.
problem Certifying robustness of neural networks is challenging and often leads to over-regularization.
method Proposes an efficient trainable local Lipschitz upper bound by considering activation functions and weight matrices.
result Consistently outperforms state-of-the-art methods in clean and certified accuracy on various datasets.
Given a solution u to a linear homogeneous second order elliptic equation with Lipschitz coefficients, we introduce techniques for giving improved estimates of the critical set $\Cr(u)\equiv \{x:|\nabla u|(x)=0\}$. The results are new even for harmonic functions on $\dR^n$. Given such a u, the standard {\it first o…
This research explores principles of Lipschitz continuity in neural networks for robustness and generalization.
problem Ensuring robustness and generalization in neural networks, especially to small input perturbations and out-of-distribution data.
method Two complementary perspectives: internal (training dynamics) and external (frequency signal propagation).
result Advances in understanding the principles of Lipschitz continuity in neural networks.
Develops new strategy for Hessian estimates in Lagrangian mean curvature equation.
problem Interior Hessian estimates for solutions with prescribed Lipschitz phases.
method Allard-type regularity theorem, geometric measure theory, geometry of Lagrangian graphs, De Giorgi-Nash-Moser iteration.
result Sharp interior Hessian estimates for solutions with critical and supercritical phases.
Generative adversarial networks (GANs) are one of the most popular approaches when it comes to training generative models, among which variants of Wasserstein GANs are considered superior to the standard GAN formulation in terms of learning stability and sample quality. However, Wasserstein GANs require the critic to b…
New Transformers maintain Lipschitz continuity for robustness.
problem Ensuring robustness in Transformers for safety-sensitive applications.
method Introducing gradient-descent-type in-context Transformers with explicit Euler steps of negative gradient flows.
result Universal approximation theorem for Lipschitz continuous Transformers.
We show, as our main theorem, that if a Lipschitz map from a compact Riemannian manifold M to a connected compact Riemannian manifold N, where dimM≥dimN, has no singular points on M in the sense of F.H. Clarke, then the map admits a smooth approximation via Ehresmann fibrations. We also show the Reeb s…
GraN-GAN normalizes gradients for better GAN performance.
problem Improving image generation in GANs with piecewise linear discriminators.
method Piecewise Gradient Normalization (GraN) for input-dependent normalization.
result Significant performance gains in image generation across various datasets.
The paper proves Lipschitz continuity of cut times in spacetimes.
problem Lipschitz continuity of cut times in globally hyperbolic spacetimes.
method Adapted Itoh-Tanaka method to Lorentzian setting.
result Lipschitz continuity of cut times with quantitative estimates.
The paper proposes a method to train NNs with a small Lipschitz constant to improve robustness.
problem Neural networks' susceptibility to adversarial perturbations in safety-critical applications.
method The paper introduces a framework to train multi-layer NNs by minimizing their Lipschitz constant, using an optimization scheme based on the Alternating Direction Method of Multipliers.
result The proposed training procedure successfully increases the robustness of neural networks.
The study shows that certain graphs are regular at boundary points.
problem Boundary regularity of anisotropic minimal Lipschitz graphs.
method Proves regularity for graphs with bounded anisotropic mean curvature and atomic energy condition.
result Regularity at boundary points with density bounded above by 1/2 + σ.
Optimally regularizes boundaries in the Heisenberg group with prescribed curvature.
problem Optimizing boundaries with prescribed sub-Finsler mean curvature in the Heisenberg group.
method Analyzes critical sets of the prescribed mean curvature functional in the Heisenberg group.
result Characteristic curves of critical sets are C2-regular, optimal in the Heisenberg group. The paper establishes a uniform Lipschitz bound on the square root of the systole function in Teichmüller space.
problem Uniform Lipschitz bounds on geometric functions in Teichmüller space.
method Injectivity radius analysis and Lipschitz bounds on systole function.
result Uniform Lipschitz constant for the square root of the systole function on Teichmüller space.
We discuss the bi-Lipschitz geometry of an isolated singular point of a complex surface which particular emphasis on when it is metrically conical.
We construct a smooth compact n-dimensional manifold Y with one point singularity such that all its Lipschitz homotopy groups are trivial, but Lipschitz mappings Lip(S^n,Y) are not dense in the Sobolev space W^{1,n}(S^n,Y). On the other hand we show that if a metric space Y is Lipschitz (n-1)-connected, then Lipschitz …
The main result of this paper is: {\bf Theorem.} Let f:Rk→R be a C1 function, so that ∇f is locally Lipschitz continuous. Assume moreover that f is C2 near its generalised saddle points. Fix real numbers δ0>0 and 0<α<1. Then there is a smooth function $h:\mathbb{R}…
Novel coordinate descent (CD) methods are proposed for minimizing nonconvex functions consisting of three terms: (i) a continuously differentiable term, (ii) a simple convex term, and (iii) a concave and continuous term. First, by extending randomized CD to nonsmooth nonconvex settings, we develop a coordinate subgradi…
This is the first paper of two ones. Here we prove that two compact Alexandrov surfaces of bounded integral curvature having no peak points are bi-Lipschitz equivalent if they are homeomorphic one to the other. Also conditions under that two ends having finite integral negative curvature are bi-Lipschitz equivalent are…
JacNet learns Jacobians to enforce structure on derivatives for invertibility and Lipschitz functions.
problem Enforcing structure on derivatives of neural network mappings.
method Proposes using a neural network to directly learn the Jacobian of the input-output function, allowing control over derivative structure.
result Demonstrates learning invertible approximations to simple and 1-Lipschitz functions.
Orthogonium offers unified, efficient layers for robust deep learning.
problem Fragmented and computationally demanding implementations of orthogonal and 1-Lipschitz layers.
method Unified, efficient PyTorch library providing orthogonal and 1-Lipschitz layers.
result Reduced overhead and standardized tools for robust experimentation.
Study shows prior Lipschitz continuity can improve adversarial robustness of Bayesian Neural Networks.
problem Improving adversarial robustness of Bayesian Neural Networks.
method Analysis of i.i.d., zero-mean Gaussian priors and posteriors approximated via mean-field variational inference.
result Adversarial robustness is sensitive to the prior variance.
The paper proves Lipschitz regularity of graph Laplacian eigenvectors on random data clouds.
problem Analyzing the regularity of solutions to graph Laplacian equations on random data points.
method Probabilistic coupling of random walks and interpolation method for point clouds to continuum.
result Graph Laplacian eigenvectors are essentially Lipschitz with constants depending on eigenvalues.
Study 2D spaces with curvature, finding a graph structure.
problem Understanding the geometry of 2D spaces with curvature constraints.
method Analyzing spaces as unions of disks, identifying singular points.
result Obtained a graph structure of topological singular points.
We provide bi-Lipschitz invariants for finitely determined map germs f:(Kn,0)→(Kp,0), where K=R or C. The aim of the paper is to provide partial answers to the following questions: Does the bi-Lipschitz type of a map germ $f: (\mathbb{R}^n, 0) \to (\mathbb{R…
New scalable Lipschitz bounds improve neural network robustness analysis.
problem Computing tight Lipschitz bounds for deep neural networks is challenging and computationally expensive.
method Derived new closed-form Lipschitz bounds using more general feasible points of LipSDP, avoiding SDP solvers.
result Improved scalability and precision of Lipschitz estimation for large neural networks.
While Standard gradient descent is one very popular optimisation method, its convergence cannot be proven beyond the class of functions whose gradient is globally Lipschitz continuous. As such, it is not actually applicable to realistic applications such as Deep Neural Networks. In this paper, we prove that its backtra…
Considering the Teichmüller space of a surface equipped with Thurston's Lipschitz metric, we study geodesic segments whose endpoints have bounded combinatorics. We show that these geodesics are cobounded, and that the closest-point projection to these geodesics is strongly contracting. Consequently, these geodesics are…
This paper reverses a construction by merging boundary critical points into an interior one.
problem Pushing interior critical points to the boundary and splitting them into two boundary points.
method Specific assumptions allow merging two boundary critical points into one interior critical point.
result Merging two boundary critical points into a single interior critical point.
BLiE optimizes hyperparameters with theoretical guarantees and superior performance.
problem Hyperparameter optimization in machine learning.
method Lipschitz bandit approach exploiting Lipschitz continuity.
result BLiE finds ε-optimal hyperparameters with theoretical complexity.
New algorithms for online learning without boundedness or Lipschitz loss assumptions.
problem Online learning with unbounded domains and non-Lipschitz losses.
method Developed an algorithm with a specific regret bound and used it for saddle-point optimization.
result First algorithm achieving non-trivial dynamic regret in an unbounded domain for non-Lipschitz losses.
The minimal number of critical points is studied for smooth functions on closed manifolds.
problem Determining the minimal number of critical points for smooth functions on closed manifolds.
method Investigates cylindrical ball neighborhoods and exotic critical points, proving the conjecture for certain types of critical points.
result The minimal number of critical points is the same for smooth functions without exotic critical points on closed manifolds of dimension at least 6.
We study the Lipschitz metric on Teichmuller space (defined by Thurston) and compare it with the Teichmuller metric. We show that in the thin part of Teichmuller space the Lipschitz metric is approximated up to bounded additive distortion by the sup metric on a product of lower-dimensional spaces (similar to the Teichm…
Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize the distance between the model and the empirical distribution in terms of a dif…
For distinct points p and q in a two-dimensional Riemannian manifold, one defines their mediatrix Lpq as the set of equidistant points to p and q. It is known that mediatrices have a cell decomposition consisting of a finite number of branch points connected by Lipschitz curves. This paper establishes addi…
Conic singular sub-manifolds are Lipschitz Normally Embedded in compact non-Euclidean manifolds.
problem Understanding the Lipschitz geometry of conic singular sub-manifolds.
method Analyzing the metric properties of conic singular sub-manifolds in compact non-Euclidean manifolds.
result Connected conic singular sub-manifolds are Lipschitz Normally Embedded.
The paper trains neural networks with robustness guarantees using semidefinite constraints.
problem Training neural networks with robustness and stability guarantees.
method Exploiting the banded structure of semidefinite constraints, an efficient and scalable training scheme based on interior point methods is set up.
result The method allows for enforcing Lipschitz constraints in large-scale deep neural networks, as demonstrated in numerical examples.