We prove an equivariant implicit function theorem for variational problems that are invariant under a varying symmetry group (corresponding to a bundle of Lie groups). Motivated by applications to families of geometric variational problems lacking regularity, several non-smooth extensions of the result are discussed. A…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,341 papers · 148 categories
Trend · papers per month
48 results for “non-smooth deformations”
New method aligns brain regions across subjects better than existing approaches.
problem Inaccurate mapping of functional brain regions across different subjects in fMRI studies.
method Locally optimized registration method that maximizes functional correlation and allows for non-smooth deformations.
result Method outperforms existing alternatives in overlap and consistency of predicted regions.
Perturbed Proximal Descent to Escape Saddle Points for Non-convex and Non-smooth Objective Functionscs.LG
New algorithm finds local minima in non-convex, non-smooth problems.
problem Finding local minimizers in non-convex and non-smooth optimization.
method Perturbed Proximal Descent, tailored for non-smooth cases.
result First known results for non-smooth optimization.
MARINA-P improves non-smooth federated optimization with adaptive stepsizes.
problem Non-smooth federated optimization in machine learning applications.
method Extends EF21-P and MARINA-P to non-smooth convex setting, proving optimal convergence rate and communication complexity bounds.
result MARINA-P achieves convergence rate and communication complexity matching classical subgradient methods.
Extends curve theory to non-smooth data with finite curvature and torsion.
problem Applying classical curve theory to non-smooth data.
method Using distributional derivative measures of functions of bounded variation.
result Essentially unique non-smooth curve solution with finite total curvature and torsion.
AsylADMM improves gossip-based learning for non-smooth objectives.
problem Efficient and robust decentralized learning on edge devices.
method Asynchronous gossip algorithm for non-smooth optimization.
result AsylADMM converges faster on non-smooth problems.
Survey on preserving curvature bounds for non-smooth Ricci flow.
problem Preserving curvature bounds for non-smooth initial data in Ricci flow.
method Survey of various weak initial data and preservation of curvature bounds.
result Various curvature lower bounds preserved up to a constant for non-smooth initial data.
We introduce non-smooth symplectic forms on manifolds and describe corresponding Poisson structures on the algebra of Colombeau generalized functions. This is achieved by establishing an extension of the classical map of smooth functions to Hamiltonian vector fields to the setting of non-smooth geometry. For mildly sin…
Develops HOPS for non-smooth problems with improved complexity.
problem Solving non-smooth optimization problems with explicit max-structure.
method Combines Nesterov's smoothing and accelerated gradient methods.
result Achieved lower iteration complexity of .
New bounds explain deterministic non-smooth deep nets without large Lipschitz constants.
problem Challenges in explaining generalization of deterministic non-smooth deep nets.
method De-randomized PAC-Bayes margin bounds for deterministic non-convex and non-smooth predictors.
result New bounds avoid large Lipschitz constants, providing generalization guarantees.
The paper explores various stationarity concepts in non-smooth optimization.
problem Understanding stationarity in non-smooth optimization problems.
method Introduction and discussion of different stationarity concepts for non-convex non-smooth functions.
result Clarification of the relationship among different stationarity concepts and their relevance in iterative methods.
Smoothness analysis of adversarial training reveals constraints cause more non-smoothness.
problem Non-smoothness of adversarial training loss function.
method Analyzed the smoothness of adversarial training loss function using optimal attacks for model parameters.
result The constraint causes more non-smoothness than constraint.
In the framework of Lorentzian warped products, we study the Friedmann-Robertson-Walker cosmological model to investigate non-smooth curvatures associated with multiple discontinuities involved in the evolution of the universe. In particular we analyze non-smooth features of the spatially flat Friedmann-Robertson-Walke…
Improved non-smooth optimization methods achieve faster convergence rates.
problem Non-smooth optimization problems, especially in and -SVM.
method Higher-order accelerated methods, leveraging recent advances in smooth convex optimization.
result Achieved iteration complexity for regression, breaking previous barriers.
This work speeds up hyperparameter selection for non-smooth convex models using implicit differentiation.
problem Optimizing hyperparameters of non-smooth convex models.
method Implicit differentiation of proximal gradient and coordinate descent methods.
result Implicit differentiation can speed up hyperparameter optimization, especially for non-smooth problems.
Deep neural networks excel at learning non-smooth functions.
problem Understanding why deep neural networks perform better for non-smooth functions.
method Theoretical analysis of statistical properties of deep neural networks for non-smooth functions.
result Deep neural networks achieve almost optimal generalization error for non-smooth functions.
New algorithms optimize non-smooth, non-convex objectives with improved complexity.
problem Optimizing non-smooth, non-convex stochastic objectives.
method Reduction to online learning, applying optimistic online learning techniques.
result Improved complexity for finding -stationary points.
Positive mass theorem for non-smooth metrics on flat manifolds with corners.
problem Proving a positive mass theorem for non-smooth metrics on asymptotically flat manifolds with non-compact boundary.
method Proves a positive mass theorem for metrics that are only continuous across a compact hypersurface.
result Obtains a positive mass theorem on manifolds with non-compact corners.
Paper tackles private optimization for non-smooth objectives efficiently.
problem Private stochastic convex optimization for non-smooth objectives.
method Noisy mirror descent algorithm.
result Achieves optimal rates in statistical complexity and number of queries.
We investigate a generalization of the so-called metric splitting of globally hyperbolic space-times to non-smooth Lorentzian manifolds and show the existence of this metric splitting for a class of wave-type space-times. Our approach is based on smooth approximations of non-smooth space-times by families (or sequences…
Advances smooth over-parameterization for solving non-smooth optimization problems.
problem Non-smooth optimization with structural constraints in imaging and machine learning.
method Smooth over-parameterization of non-smooth problems, using gradient descent and mirror descent.
result Gradient descent on the reformulated smooth problem converges efficiently without parameter tuning.
Extends variable projection to non-smooth problems.
problem Structured optimization problems with non-smooth terms.
method Inexact adaptive algorithm for non-smooth problems.
result Theoretical analysis of computational complexity.
The study analyzes methods for solving non-convex, non-smooth optimization problems.
problem Finding critical points of non-convex and non-smooth functions.
method Gradient descent, proximal update, Frank-Wolfe update methods for general and continuous sub-analytic functions.
result Established rates of convergence and faster rates for specific function classes.
New methods improve convergence in non-convex non-smooth learning problems.
problem Sparse learning from high-dimensional data with non-convex, non-smooth regularizers.
method Stochastic proximal gradient methods with arbitrary sampling.
result Independent sampling improves performance over uniform sampling.
The study analyzes convergence rates for sparse pivotal estimators in high-dimensional regression.
problem Sparse pivotal estimation in high-dimensional regression problems.
method Theoretical analysis and comparison of non-smooth + non-smooth optimization problems, including smoothing techniques.
result Minimax sup-norm convergence rates for square-root Lasso-type estimators are derived.
Adaptive data fusion boosts efficiency in multi-task optimization.
problem Multi-task non-smooth optimization in various fields.
method Adaptive data fusion approach leveraging commonalities among objectives.
result Significant improvements in sample efficiency with sharp statistical guarantees.
Algebras of generalized functions offer possibilities beyond the purely distributional approach in modelling singular quantities in non-smooth differential geometry. This article presents an introductory survey of recent developments in this field and highlights some applications in mathematical physics.
Extends diffuse interface methods to graphs and hypergraphs with non-smooth potentials.
problem Semi-supervised learning on graphs and hypergraphs.
method Generalizes diffuse interface methods using non-smooth potential functions and hypergraph Laplacians.
result The diffuse interface method can be applied to both graph and hypergraph data.
Abstracts a theorem for non-smooth maps in infinite dimensions.
problem Generalizing inverse mapping theorem for non-smooth maps.
method Introduces property A and applies it to non-smooth maps.
result Generalized inverse mapping theorems for non-smooth maps.
New SPS variant improves non-smooth optimization without small gradients.
problem Improving non-smooth optimization without small gradients.
method Safeguarded Stochastic Polyak Step Size (SPS) for non-smooth optimization.
result Rigorous convergence guarantees for non-smooth convex optimization without strong assumptions.
Theoretical Limits of Pipeline Parallel Optimization and Application to Distributed Deep Learningstat.ML
Optimizes deep learning pipelines with novel algorithms for smooth and non-smooth functions.
problem Optimizing deep learning pipelines for smooth and non-smooth functions.
method Provided matching lower and upper bounds for smooth convex and non-convex functions, and developed PPRS for non-smooth convex functions.
result PPRS achieves near-linear speed-up and convergence time for non-smooth non-convex problems.
New algorithm samples efficiently from complex composite potentials.
problem Sampling from densities with smooth and non-smooth components.
method Metropolis-Hastings framework with proximal-based proposal.
result Mixes to target density in iterations.
Stochastic approximation proves asymptotic normality for non-smooth problems.
problem Solving non-smooth stochastic approximation problems.
method Stochastic approximation algorithms for solving smooth equations, extended to non-smooth problems.
result Asymptotic normality and optimality in non-smooth stochastic approximation is proven.
Bayesian optimization tackles non-smooth tuning problems.
problem Optimizing black-box functions with non-smoothness and limited samples.
method Proposed a clustered Gaussian process (cGP) model for non-smooth optimization.
result Improvement of up to 90% in performance for repetitive experiments.
Study of spectral gaps in non-smooth spaces with bounded Ricci curvature.
problem Analyzing spectral gaps in non-smooth metric measure spaces.
method Establishing a Polya-Szego type inequality and applying it to show spectral gaps for the p-Laplace operator.
result Sharp spectral gap results for the p-Laplace operator on various non-smooth spaces.
Study weak Frenet frame for non-smooth curves with finite curvature and torsion.
problem Defining weak binormal and normal for non-smooth curves with finite total curvature and torsion.
method Piecewise linear methods and density argument applied to polygonal curves.
result Weak binormal and normal are rectifiable curves agreeing with total absolute torsion and vector product of tangent indicatrix and weak binormal.
Gradient-based Regularization Parameter Selection for Problems with Non-smooth Penalty Functionsstat.ML
Gradient descent can optimize penalty parameters for non-smooth penalties.
problem Optimizing penalty parameters for non-smooth penalties in regression problems.
method Modified gradient descent algorithm for non-smooth penalty functions.
result Decreased generalization error with tuned penalty parameters.
Safe-EF improves federated learning for non-smooth, constrained optimization.
problem Federated learning's communication bottlenecks with high-dimensional model updates.
method Error feedback (EF) for non-smooth convex optimization with safety constraints.
result Safe-EF matches lower complexity bounds and ensures safety constraints.
New algorithm minimizes convex functions with smooth and non-smooth parts.
problem Minimizing convex functions with smooth and non-smooth components.
method Proximal stochastic quasi-Newton method incorporating Hessian and multistage variance reduction.
result Achieves linear rate of convergence.
Inertial methods solve non-convex non-smooth optimization problems efficiently.
problem Non-convex non-smooth optimization problems.
method Inertial block proximal methods for solving these problems.
result The methods converge globally under certain conditions and perform well in applications like NMF.
Modified perturbation method removes non-smoothness in solving Black-Scholes equations.
problem Non-smoothness in solving Black-Scholes equations.
method Variable transformations and homotopy perturbation method.
result Excellent agreement with exact solutions for Black-Scholes and multi-asset options.
New proof of Kondo-Tanaka theorem using geometric measure theory.
problem Existence of special systems of Whitney flat 1-forms on homology manifolds.
method Geometric measure theory and tools from non-smooth analysis.
result Simple new proof of Kondo-Tanaka theorem and its converse.
The study extends curvature bounds to non-smooth spaces and proves stability of mean curvature.
problem Proving curvature bounds in non-smooth spaces.
method Extending results from smooth Riemannian manifolds to non-smooth RCD spaces.
result Stability of mean curvature bounds under uniform convergence.
Study measures non-smooth spaces using Ricci curvature, proving volume properties.
problem Volume measure in non-smooth spaces with Ricci curvature bounded below.
method Covering spaces with measurable subsets and using absolute continuity of measures.
result Proves measurable subsets with absolute continuity to Hausdorff measure.
Paper proposes ADMM algorithms for non-smooth optimization under RDP.
problem Optimizing composite functions with non-smooth penalties under privacy constraints.
method Developed ssADMM and mpADMM algorithms for non-smooth optimization problems with RDP guarantees.
result Both ssADMM and mpADMM outperform baseline methods in high privacy settings.
Expanding FCCO to non-smooth weakly-convex problems, improving deep learning performance.
problem Addressing the limitations of current FCCO methods by tackling non-smooth weakly-convex problems.
method Developed a single-loop algorithm for non-smooth weakly-convex FCCO and extended it to tri-level problems.
result Established the complexity for finding ε-stationary points in the Moreau envelop of the objective function.
Novel method for shape optimization of non-smooth PDEs.
problem Optimizing shapes governed by non-smooth PDEs.
method Functional variational approach and sensitivity analysis.
result Necessary conditions for locally optimal shapes.
Algorithms for solving optimization problems arising from deep neural net models: nonsmooth problemsmath.OC
Paper tackles optimization challenges in deep neural nets with nonconvex and non-smooth objectives.
problem Optimization of deep neural net models with nonconvex and non-smooth objectives.
method Summarizes challenges, state of the art, and presents numerical results on a specific class of problems.
result Numerical results on non-convex and non-smooth optimization problems.