Study on how reparametrization affects neural nets' parameter spaces from a geometric perspective.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Monge SAM improves deep learning by making sharpness-aware minimization invariant to reparametrizations.
We consider pairs of a non-empty compact connected and locally connected Hausdorff space and a real-valued continuous function. Our aim is to measure the difference between this kind of the pairs. In this notes we introduce new pseudodistances between pairs associated with reparametrization invariant seminorms. We fini…
Completeness of surface metrics established for Sobolev spaces.
Motivated by Demailly's strategy towards the Kobayashi hyperbolicity conjecture, we study the action on the k-jets of germs of holomorphic discs in a complex manifold X of the reparametrization group of k-jets of germs of biholomorphisms of the source. This reparametrization group is a subgroup of the general linear gr…
In this article we investigate a first order reparametrization-invariant Sobolev metric on the space of immersed curves. Motivated by applications in shape analysis where discretizations of this infinite-dimensional space are needed, we extend this metric to the space of Lipschitz curves, establish the wellposedness of…
Unified approach to conformal and modular invariants on surfaces.
Study disproves conjecture about metric completion of curve spaces.
Signatures provide a succinct description of certain features of paths in a reparametrization invariant way. We propose a method for classifying shapes based on signatures, and compare it to current approaches based on the SRV transform and dynamic programming.
In this paper we study the shape space of curves with values in a homogeneous space , where is a Lie group and is a compact Lie subgroup. We generalize the square root velocity framework to obtain a reparametrization invariant metric on the space of curves in . By identifying curves in with thei…
The Square Root Normal Field (SRNF), introduced by Jermyn et al. in [3], provides a way of representing immersed surfaces in , and equipping the set of these immersions with a "distance function" (to be precise, a pseudometric) that is easy to compute. Importantly, this distance function is invariant under…
A new numerical framework simplifies elastic surface matching and comparison.
A new method for 3D surface registration using dynamic programming.
We study reparametrization invariant Sobolev metrics on spaces of regular curves. We discuss their completeness properties and the resulting usability for applications in shape analysis. In particular, we will argue, that the development of efficient numerical methods for higher order Sobolev type metrics is an extreme…
Study on completeness of Sobolev metrics on manifold-valued curves.
DualVDT improves time-series forecasting with a novel dual reparametrized structure.
Consider the equal mass planar -body problem with a potential corresponding to an inverse \textit{cube} force. The Jacobi-Maupertuis principle reparametrizes the dynamics as geodesics of a certain metric. We examine the curvature of this geodesic flow in the reduced space on the collinear and parallelogram invariant…
We introduce a new algorithm for approximate inference that combines reparametrization, Markov chain Monte Carlo and variational methods. We construct a very flexible implicit variational distribution synthesized by an arbitrary Markov chain Monte Carlo operation and a deterministic transformation that can be optimized…
Spray-invariant sets maintain geodesics on infinite-dimensional manifolds.
Paper proves geodesics and focal points unchanged by conformal changes in pseudo-Finsler manifolds.
Proposes spred for solving penalty with SGD.
New findings show a balance between data fit and complexity in kernel hyperparameters.
We prove an optimal control on the time-dependent measure of a measurable set under a reparametrized Lagrangian mean curvature flow of almost calibrated submanifolds in a Calabi-Yau manifold. Moreover we give a classification of those Lagrangian translating solitons in that evolve by this reparametrized …
Study finds a method to discover causal relationships that are invariant to marginal distributions.
Paper proves trajectories of Chaplygin systems are reparametrized geodesics.
Let H be the n-dimensional hyperbolic space of constant sectional curvature -1 and let G be the identity component of the isometry group of H. We find all the G-invariant pseudo-Riemannian metrics on the space OG_n of oriented geodesics of H (modulo orientation preserving reparametrizations). We characterize the null, …
The paper addresses the invariance issue in Bayesian neural networks using linearized Laplace approximation.
Efficiently infers latent SDEs with scalable memory and time costs.
We simplify SVI volatility smile constraints for three sub-SVIs without numerical methods.
We classify compact Kähler surfaces with nonconstant Killing potentials such that all integral curves of their gradients are reparametrized geodesics.
We analyze a notion of multiple valued sections of a vector bundle over an abstract smooth Riemannian manifold, which was suggested by W. Allard in the unpublished note "Some useful techniques for dealing with multiple valued functions" and generalizes Almgren's -valued functions. We study some relevant properties o…
The structure of a diffeomorphism invariant Lagrangians for an extended object W embedded in a bulk space M is discussed by following a close analogy with the relativistic particle in electromagnetic field as a system that is reparametrization-invariant. The current construction naturally contains, relativistic point p…
A new variational method improves deep neural network inference.
While statistics focusses on hypothesis testing and on estimating (properties of) the true sampling distribution, in machine learning the performance of learning algorithms on future data is the primary issue. In this paper we bridge the gap with a general principle (PHI) that identifies hypotheses with best predictive…
Quantized Variational Inference improves ELBO optimization with fast convergence.
New metrics on curve spaces improve shape analysis.
Self dual symmetric R-spaces have special curves, called circles, introduced by Burstall, Donaldson, Pedit and Pinkall in 2011, whose definition does not involve the choice of any Riemannian metric. We characterize the elements of the big transformation group G of a self dual symmetric R-space M as those diffeomorphism…
Motivated by applications in the field of shape analysis, we study reparametrization invariant, fractional order Sobolev-type metrics on the space of smooth regular curves and on its Sobolev completions . We prove local well-posedness of the ge…
Hierarchical neural networks are exponentially more efficient than their corresponding "shallow" counterpart with the same expressive power, but involve huge number of parameters and require tedious amounts of training. Our main idea is to mathematically understand and describe the hierarchical structure of feedforward…
This study compares two methods for sampling with transport maps, finding flow-based proposals work better for multimodal distributions.
This paper puts forth a new formulation and algorithm for the elastic matching problem on unparametrized curves and surfaces. Our approach combines the frameworks of square root normal fields and varifold fidelity metrics into a novel framework, which has several potential advantages over previous works. First, our var…
We introduce Natural Neural Networks, a novel family of algorithms that speed up convergence by adapting their internal representation during training to improve conditioning of the Fisher matrix. In particular, we show a specific example that employs a simple and efficient reparametrization of the neural network weigh…
The space of all immersed closed curves of rotation degree 0 in the plane modulo reparametrizations has the same homotopy groups as the circle times the 2-sphere.
In this article we introduce a family of elastic metrics on the space of parametrized surfaces in 3D space using a corresponding family of metrics on the space of vector valued one-forms. We provide a numerical framework for the computation of geodesics with respect to these metrics. The family of metrics is invariant …
Improved VI with Price's gradient estimator for target log-density.
Research shows deep generative models' likelihoods are unreliable for anomaly detection.
The chapter reviews metrics for comparing curves, focusing on quotient elastic and square root velocity metrics.
Projective geodesic extensions for nonholonomic systems are derived under conformal transformations.