Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

113226339452 · Jun 202019922001200920172026
48 results for geometric gradients

GeoAdaLer enhances geometric understanding of Adam for stochastic optimization.

problem Understanding geometric principles behind Adam's success in stochastic optimization.
method Introduces GeoAdaLer, an adaptive learning method based on geometric properties.
result Extends interpretability and effectiveness in complex optimization scenarios.

Extends gradient estimates for heat equation under Finsler geometric flows.

problem Global gradient estimates for positive solutions to heat equation.
method General compact Finsler CD(K,N)CD(-K,N) geometric flow.
result Derives Harnack inequality for positive solutions.

The paper estimates gradients for a weighted parabolic equation under geometric flow.

problem Estimating gradients for a specific parabolic equation on a weighted manifold.
method Obtained space-time gradient estimates through integrating the equation.
result Found corresponding Harnack inequalities through gradient estimates.

In general, gradient estimates are very important and necessary for deriving convergence results in different geometric flows, and most of them are obtained by analytic methods. In this paper, we will apply a stochastic approach to systematically give gradient estimates for some important geometric quantities under the…

2013-12-23abs ↗pdf ↗

SGD and stochastic gradient descent converge at optimal rates for certain non-convex functions.

problem Optimal convergence rates for non-convex functions under gradient noise.
method Geometric interpretation of the PL-condition to analyze convergence rates.
result Convergence rates of SGD and stochastic gradient descent match those of strongly convex quadratics.

The paper provides a geometric framework for understanding non-equilibrium thermodynamics.

problem Unclear geometric structure of GENERIC in non-equilibrium thermodynamics.
method Cotangent lifts of dynamics, splitting into holonomic and vertical representatives, and formulation within contact geometry.
result Physical meaning and explicit formulation of the second law of thermodynamics within evolution equations.

The paper provides gradient estimates for a parabolic equation under Finsler geometric flows.

problem Gradient estimates for a general parabolic equation under compact Finsler CD(K,N)CD(-K,N) geometric flows.
method Presented Shi-type and Hamilton-type gradient estimates.
result Demonstrates the possibility of removing stricter derivative bounds imposed by Finsler curvature conditions.

The study examines gradient almost Yamabe solitons in warped product manifolds and their geometric properties.

problem Investigating the geometry of gradient almost Yamabe solitons in warped product manifolds.
method Presenting geometric rigidity results, investigating existence conditions, and classifying specific solitons.
result Classification of rotational gradient almost Yamabe solitons in RimesfRn\mathbb{R} imes_{f}\mathbb{R}^{n}.

The paper proves various inequalities on gradient shrinking Ricci solitons.

problem Understanding geometric inequalities on gradient shrinking Ricci solitons.
method Proving multiple inequalities equivalent on complete gradient shrinking Ricci solitons.
result Various inequalities (Sobolev, logarithmic Sobolev, Schrödinger, etc.) are equivalent on gradient shrinking Ricci solitons.

GeoPhy uses geometric gradients to efficiently infer phylogenetic trees from molecular data.

problem Challenges in accurately inferring species relationships from molecular data due to combinatorially vast tree topologies.
method Introduces a novel, fully differentiable formulation of phylogenetic inference using geometric spaces and variational Bayesian methods.
result Significantly outperforms other approximate Bayesian methods in inferring phylogenetic trees.

This paper explores geometric and analytic aspects of Lojasiewicz inequalities on vector bundles.

problem Understanding growth and stability conditions for real-analytic functions over vector bundles.
method Outline theory of functionals and variational problems over vector bundles, explore applications to real-analytic functionals.
result Describes the energy functional on $S^{n-1$ as a functional over a vector bundle.

GGA improves untrustworthy prediction detection in neural networks without retraining.

problem Susceptibility of neural networks to untrustworthy predictions, especially adversarial attacks and out-of-distribution data.
method Geometric Gradient Analysis (GGA) analyzes the geometry of neural network loss landscapes based on saliency maps.
result GGA outperforms existing methods in detecting untrustworthy predictions, including adversarial and out-of-distribution data.

Geometric tempering improves sampling from distributions, with exponential convergence rates.

problem Sampling from probability distributions using gradient flow dynamics.
method Geometric tempering of the target distribution in Wasserstein and Fisher-Rao gradient flows.
result Exponential convergence in continuous and discrete time for geometric tempering.

Geometric Occam's Razor shapes deep learning solutions.

problem Understanding the regularization in over-parameterized neural networks.
method Analyzing the geometric model complexity and Dirichlet energy in neural networks.
result Over-parameterized neural networks are implicitly regularized by geometric model complexity.

SGD converges with perturbed forward-backward passes, explained by geometric amplification.

problem Analyzing convergence of SGD with perturbed forward-backward passes in composite optimization.
method Characterized propagation and amplification of perturbations, derived convergence guarantees for non-convex and PL objectives.
result Perturbations cascade through the computational graph, affecting convergence order under specific conditions.

SGLD proves geometric ergodicity via reflection coupling for nonconvex log-concave distributions.

problem Proving geometric ergodicity of SGLD in nonconvex, log-concave settings.
method Reflection coupling technique to handle SGLD's time discretization and minibatch issues.
result SGLD has an invariant distribution and geometric ergodicity in W1W_1 distance.

In this paper, we extend the geometric descent method recently proposed by Bubeck, Lee and Singh to tackle nonsmooth and strongly convex composite problems. We prove that our proposed algorithm, dubbed geometric proximal gradient method (GeoPG), converges with a linear rate (11/κ)(1-1/\sqrtκ) and thus achieves the optimal …

2016-12-29abs ↗pdf ↗

Study on Einstein solitons with bounds and asymptotic behavior.

problem Understanding the properties of Einstein solitons.
method Computed lower bounds for scalar curvature, established asymptotic behavior, proved finiteness of fundamental group and weighted volume.
result Established finiteness of fundamental group and weighted volume for gradient shrinking Einstein solitons.

Study on gradient h-almost Yamabe solitons with scalar curvature estimation.

problem Exploring triviality and scalar curvature estimation of gradient h-almost Yamabe solitons.
method Established sufficient conditions for triviality and scalar curvature estimation under integral inequalities involving the scalar curvature and soliton function.
result Extended and refined former works on almost and h-almost Yamabe solitons, characterizing their geometric structures.

Families of hypersurfaces that are level-set families of harmonic functions free of critical points are characterized by a local differential-geometric condition. Harmonic functions with a specified level-set family are constructed from geometric data. As a by-product, it is shown that the evolution of the gradient of …

2018-12-05abs ↗pdf ↗

The paper introduces a geometric flow for Lagrangian submanifolds that preserves Hamiltonian isotopy.

problem Finding stationary solutions for Hamiltonian stationary Lagrangian submanifolds.
method Introducing a geometric flow that is a gradient flow for volume and corresponds to a fourth order strictly parabolic scalar equation.
result Established short-time existence, uniqueness, and higher order estimates for compact initial Lagrangian immersions with uniformly bounded second fundamental forms.

BBVI with STL converges geometrically under perfect specification, with quadratic variance bound.

problem Convergence rate of BBVI with STL estimator.
method Proved geometric convergence rate with quadratic variance bound for BBVI with STL estimator.
result BBVI with STL converges geometrically under perfect variational family specification.

New geometric analysis shows L2L^2 score error is flawed for diffusion models.

problem Score matching errors in diffusion models do not fully capture distributional quality.
method Decomposed score errors into gradient and solenoidal components, focusing on gradient's role in Fokker-Planck dynamics.
result Only gradient component affects marginal distributional quality; solenoidal component is structurally invisible.

The paper studies geometric properties of hydrodynamical density manifolds.

problem Understanding the geometry of hydrodynamical density manifolds.
method Formulating connections, gradients, Hessians, parallel transports, and curvatures on these manifolds.
result Closed-form formulas for sectional curvatures in one-dimensional density manifolds.

This paper addresses anisotropy in Transformer models, providing geometric insights and empirical support.

problem Anisotropy phenomenon in Transformer models, challenging their geometric interpretation.
method Derive geometric arguments and use concept-based mechanistic interpretability during training.
result Activation-derived directions capture large gradient energy and a larger share of gradient anisotropy than normal controls.

Byrd-SAGA reduces variance to robustify SGD against Byzantine attacks.

problem Learning over networks with malicious Byzantine attacks.
method Byrd-SAGA uses geometric median for robust aggregation of corrected stochastic gradients.
result Byrd-SAGA achieves provably linear convergence to optimal solution in the presence of Byzantine workers.

Researchers study solitons on homogeneous manifolds, proving properties of specific types of solitons.

problem Examining solitons on homogeneous manifolds to understand their properties and constraints.
method Analyzing ambient obstruction flow and specific solitons in homogeneous spaces, proving properties and constructing examples.
result Proved that any compact ambient obstruction soliton with constant scalar curvature is trivial, and characterized specific types of solitons in 4-dimensional homogeneous spaces.

Gradient descent converges to perfect classification in neural nets for non-separable data.

problem Classifying linearly non-separable data using neural networks.
method Analysis of gradient descent dynamics in neural networks with sufficient but not large number of neurons.
result Gradient descent converges to global minima with perfect classification in the landscape of minimization problems.

Paper shows how to use geometric median for robust SGD in high dimensions.

problem Robustifying SGD for high-dimensional optimization problems with gross corruption.
method Applying geometric median to only chosen blocks of coordinates at a time.
result Retains optimal breakdown point of 0.5 for smooth non-convex problems.

We prove uniform gradient and diameter estimates for a family of geometric complex Monge-Ampere equations. Such estimates can be applied to study geometric regularity of singular solutions of complex Monge-Ampere equations. We also prove a uniform diameter estimate for collapsing families of twisted Kahler-Einstein met…

2017-06-05abs ↗pdf ↗

Study on slow convergence in geometric variational problems.

problem Slow convergence of solutions in geometric variational problems.
method Identifying necessary conditions for slowly converging solutions and characterizing their convergence rate and direction.
result Characterization of the rate and direction of convergence for slowly converging solutions.

Found first example of homogeneous gradient solitons for G2_2-Laplacian flow.

problem Existence of homogeneous gradient solitons for G2_2-Laplacian flow.
method Provided the first known example of homogeneous gradient solitons.
result G2_2-Laplacian flow admits homogeneous gradient solitons on one-dimensional extensions.