Non-Euclidean BPM extends optimization theory to non-Euclidean norms.
problem Extending BPM's convergence theory to non-Euclidean norms.
method Iteratively minimizing over norm balls in non-Euclidean geometry.
result Most BPM guarantees carry over to non-Euclidean norms.
New method turns optimization algorithms into uniformly stable learning algorithms for non-Euclidean norms.
problem Non-Euclidean norms in binary classification problems.
method Black-box reduction method using uniformly convex regularizers.
result Achieves optimal statistical risk bounds on excess risk for non-Euclidean norms.
Gradient descent near stability threshold shows sharpness oscillations.
problem Understanding sharpness and stability in non-Euclidean norms during gradient descent.
method Interpreted EoS through Directional Smoothness, defined generalized sharpness for arbitrary norms.
result Non-Euclidean GD exhibits sharpness oscillations around the stability threshold.
Gradient descent near stability threshold exhibits sharpness oscillations.
problem Understanding sharpness behavior near stability threshold in non-Euclidean norms.
method Interpreted EoS through Directional Smoothness and generalized sharpness under arbitrary norms.
result Non-Euclidean GD with generalized sharpness shows sharpness oscillations near 2/η. New algorithms optimize convex functions with high-order derivatives.
problem Optimizing convex functions with high-order derivatives under various norms.
method Developed a non-Euclidean inexact accelerated proximal point method using an inexact uniformly convex regularizer.
result Showed nearly optimal algorithms for high dimensions in the black-box oracle model for ℓp-settings and all q≥1. New optimization method combines gradient clipping and non-Euclidean smoothness.
problem Improving optimization in non-Euclidean spaces for machine learning.
method Hybrid of steepest descent and conditional gradient, incorporating weight decay.
result Achieves optimal convergence rate and demonstrates effectiveness in deep learning.
EF21-Muon optimizes deep learning with error feedback, improving efficiency and accuracy.
problem Lack of principled distributed frameworks for non-Euclidean LMO-based optimizers.
method Introduces EF21-Muon, a communication-efficient, non-Euclidean LMO-based optimizer with convergence guarantees.
result First efficient distributed implementation of non-Euclidean LMO-based optimizers, achieving up to 7x communication savings.
The paper analyzes and improves a deep learning optimization technique using matrix gradient orthogonality.
problem Improving deep learning training through more effective optimization methods.
method Develops a stochastic non-Euclidean trust-region gradient method for deep learning optimization.
result Proves state-of-the-art convergence results for the proposed algorithm in various scenarios.
The paper explores centroids and static equilibrium points in non-Euclidean geometries.
problem Investigating centroids and static equilibrium points in spherical, hyperbolic, and normed spaces.
method Extending Gal'perin's work, the paper examines convex bodies in these spaces and analyzes the minimum number of equilibrium points.
result Every plane convex body in any of these spaces has at least four equilibrium points, and there are mono-monostatic convex bodies in 3D spherical, hyperbolic, and certain normed spaces.
New Muon and Momo variants improve neural network optimization robustness.
problem Improving neural network optimization methods.
method Systematic exploration of non-Euclidean gradient descent variants.
result Momo variants of Muon are more robust to hyperparameter tuning.
The paper extends manifold learning to arbitrary norms, improving molecular motion mapping.
problem Improving manifold learning for non-Euclidean norms.
method Determines the limiting differential operator for graph Laplacians using any norm.
result A modified Laplacian eigenmaps algorithm using Earthmover's distance outperforms Euclidean methods in molecular motion mapping.
New method accelerates steepest descent for convex optimization.
problem Achieving acceleration for general ℓp smooth functions. method Primal-dual iterate sequences with differing norms, implicitly determined interpolation parameter.
result Improves iteration complexity to O(d1−p2) for ℓp norm smooth problems. New framework improves robustness of implicit neural networks.
problem Ill-posedness and convergence instability in implicit neural networks.
method NEMON framework based on contraction theory for ℓ∞ norm, including well-posedness condition, average iteration, and input-output Lipschitz constant regularization. result Improved accuracy and robustness of implicit models with smaller input-output Lipschitz bounds.
We prove a relation between the scaling hβ of the elastic energies of shrinking non-Euclidean bodies Sh of thickness h→0, and the curvature along their mid-surface S. This extends and generalizes similar results for plates [BLS16, LRR] to any dimension and co-dimension. In particular, it proves that the na…
Develops a new asymptotic efficiency theory for non-Euclidean parameter spaces.
problem Lack of a unified efficiency theory for non-Euclidean parameter spaces.
method Introduces a new theory for Riemannian manifolds with regularity conditions.
result Establishes efficiency bounds for non-Euclidean parameter spaces.
We investigate isometric immersions of disks with constant negative curvature into R3, and the minimizers for the bending energy, i.e. the L2 norm of the principal curvatures over the class of W2,2 isometric immersions. We show the existence of smooth immersions of arbitrarily large geodesic balls i…
New algorithm achieves optimal privacy and efficiency in non-Euclidean convex optimization.
problem Optimizing convex functions while maintaining privacy in non-Euclidean settings.
method Developed a linear-time algorithm for ℓp-setups, leveraging geometric properties. result Optimal excess risk achieved in linear time for 1<p≤2. Muon optimizes Transformer training with heavy-tailed data, achieving optimal sample complexity.
problem Theoretical understanding of non-Euclidean optimisation methods for heavy-tailed data in training Transformers.
method Addressing the gap in theoretical understanding, we show Muon achieves optimal sample complexity under heavy-tailed noise.
result Muon finds an ε-stationary point in nuclear norm with optimal sample complexity, absorbing heavy-tailed noise without dimension dependence.
Muons and random optimizers perform similarly, challenging geometric optimization theory.
problem Empirical success of Muon optimizer challenges geometric optimization theory.
method Introducing Freon and Kaon optimizers, demonstrating performance without precise geometric structure.
result Performance of optimizers is controlled by alignment and descent potential, not geometric structure.
New method for nonlinear SDR of complex non-Euclidean data.
problem Nonlinear SDR for complex non-Euclidean random objects.
method Fréchet Cumulative Covariance (FCCov) and neural networks.
result Robust and unbiased nonlinear SDR for complex data.
We take a Hamiltonian-based perspective to generalize Nesterov's accelerated gradient descent and Polyak's heavy ball method to a broad class of momentum methods in the setting of (possibly) constrained minimization in Euclidean and non-Euclidean normed vector spaces. Our perspective leads to a generic and unifying non…
New framework for private convex optimization in arbitrary norms.
problem Private optimization of convex functions in non-Euclidean settings.
method Regularized exponential mechanism based on localization tools from convex geometry.
result First optimal privacy-utility tradeoffs for ℓp norms and Schatten-p norms. Stochastic gradient descent based algorithms are typically used as the general optimization tools for most deep learning models. A Restricted Boltzmann Machine (RBM) is a probabilistic generative model that can be stacked to construct deep architectures. For RBM with Bernoulli inputs, non-Euclidean algorithm such as st…
New framework for PMD convergence in non-tabular environments.
problem Applying PMD to general policy classes with weak closure conditions.
method Develops a theoretical framework with a novel smoothness notion.
result Obtains upper bounds on convergence rate for non-tabular environments.
The goal of this paper is to introduce and study analogues of the Euclidean Funk and Hilbert metrics on open convex subsets Ω of hyperbolic or spherical spaces. At least at a formal level, there are striking similarities among the three cases: Euclidean, spherical and hyperbolic. We start by defining non-Euclidean an…
This work addresses the convergence of SGD's final iterate without restrictive assumptions.
problem Prove optimal convergence rate of SGD's final iterate without compact domains or bounded noise.
method Unified proof for general domains, composite objectives, non-Euclidean norms, etc.
result First unified convergence rates in expectation and high probability.
Study uses crochet to visualize non-Euclidean geometry.
problem Understanding non-Euclidean surfaces through physical models.
method Parametrization of crochet models to represent Lobachevskian surface.
result Crochet models reflect non-Euclidean geometry characteristics.
Unified framework for non-Euclidean CPD under scalable stochastic mirror descent.
problem Handling non-Euclidean losses in tensor decomposition.
method Tensor fiber sampling strategy-based stochastic mirror descent.
result Global convergence to a stationary point under reasonable conditions.
Paper uses non-Euclidean analysis to classify brain structure variations.
problem Classifying joint variations in multi-object brain structures.
method Combines non-Euclidean statistics and non-parametric integrative analysis.
result Effective, robust, and interpretable joint structure found.
Paper improves SOMs for non-Euclidean data modeling.
problem Traditional SOMs assume Euclidean data, limiting their applicability.
method Introduces topology-related extensions to traditional SOM algorithm.
result Improves SOMs for non-Euclidean data, enhancing data modeling.
This foreword discusses the contributions of Bolyai, Gauss, and Lobachevsky to non-Euclidean geometry.
problem The development of non-Euclidean geometries by Bolyai, Gauss, and Lobachevsky.
method Historical review of the contributions of these mathematicians.
result The foundational work on non-Euclidean geometries by Bolyai, Gauss, and Lobachevsky.
Neuc-MDS extends MDS for non-Euclidean data.
problem Limitations of classical MDS with non-Euclidean data.
method Generalizes inner product to symmetric bilinear forms, optimizes eigenvalues of dissimilarity Gram matrix.
result Optimizes STRESS for non-Euclidean data.
Algorithm improves SVM classification in non-Euclidean spaces.
problem Limitations of traditional SVM in non-Euclidean spaces.
method Covariance-adjusted SVM using Cholesky Decomposition.
result Cholesky-SVM outperforms traditional SVM in non-Euclidean spaces.
These lecture notes are based on [arXiv: math/0702714, 0907.4469, 0907.4470]. We introduce and study basic aspects of non-Euclidean geometries from a coordinate-free viewpoint.
Study of pulleys and gears in spherical and hyperbolic geometries.
problem Understanding mechanical systems in non-Euclidean spaces.
method Analysis of pulley and gear systems in spherical and hyperbolic geometries.
result Similar laws governing movement in non-Euclidean geometries.
We describe our initial explorations in simulating non-euclidean geometries in virtual reality. Our simulations of three-dimensional hyperbolic space are available at http://h3.hypernom.com.
This paper deals with various topics in analysis on hyperbolic spaces. It surveys some recent progress in non-Euclidean Fourier Analysis and proves some new results for the geodesic Radon transform on hyperbolic spaces.
The study extends inscription problems to non-Euclidean geometries.
problem Generalizing inscription problems to non-Euclidean geometries.
method Symplectic and Riemannian geometry techniques.
result Proved generalized inscription theorems for hyperbolic and spherical surfaces.
Piecewise flat approximations for curvature in Euclidean and non-Euclidean spaces.
problem Approximating local extrinsic curvature on discrete manifolds.
method Constructing discrete curvature forms on piecewise flat manifolds, using weighted sums of hinge angles.
result Converges to smooth curvature values as mesh refinement occurs, favorably comparing with other discrete approaches.
This paper tightens the generalization error bound for graph embedding in non-Euclidean spaces.
problem High generalization error in non-Euclidean graph embedding, preventing practical applications.
method Novel upper bound of graph embedding's generalization error using local Rademacher complexity.
result The new bound is tighter and faster, allowing better performance in non-Euclidean spaces.
Study on bending energy of surfaces with curvature concentration, deriving new lower bounds.
problem Analyzing the Willmore energy of surfaces with curvature concentration.
method Using isoperimetric inequalities and framed loops, derive new lower bounds for the bending energy.
result Optimal blowup rates of the Willmore energy when curvature is concentrated.
The author suggests using non-Euclidean geometry for psychometric models.
problem Current psychometric models lack geometric insights.
method Illustrates how non-Euclidean geometry can be applied to psychometrics.
result Geometric concepts may improve psychometric model understanding.
For each geometrically finite 2-dimensional non-Euclidean crystallographic group (NEC group), we compute the cohomology groups. In the case where the group is a Fuchsian group, we also determine the ring structure of the cohomology.
Study classifies graphs in Euclidean and non-Euclidean spaces with specific curvature conditions.
problem Classifying graphs with prescribed curvature in various spaces.
method Proves rigidity and classification results for graphs in Riemannian manifolds, focusing on R2 and R3. result Provides general splitting theorems for graphs in these settings.
In this paper we demonstrate how the geometrically motivated algorithm to determine whether a two generator real Mobius group acting on the Poincare plane is or is not discrete can be interpreted as a non-Euclidean Euclidean algorithm. That is, the algorithm can be viewed as an application of the Euclidean division alg…
We describe our initial explorations in simulating non-euclidean geometries in virtual reality. Our simulation of the product of two-dimensional hyperbolic space with one-dimensional euclidean space is available at http://h2xe.hypernom.com.
Extends illumination bodies to non-Euclidean spaces and proves their volume derivative defines surface area.
problem Defining surface area in non-Euclidean geometries.
method Generalizes illumination bodies to Riemannian spaces of constant curvature and projective Finsler geometries, proving their volume derivative defines surface area.
result Derivative of volume of illumination bodies defines surface area in non-Euclidean geometries.
New samplers minimize KL divergence for constrained and non-Euclidean geometries.
problem Efficient sampling from constrained and non-Euclidean distributions.
method Stein Variational Mirror Descent and Mirrored Stein Variational Gradient Descent.
result New samplers converge more rapidly and accurately than prior methods.