Study on geometry of Dirichlet distributions using Fisher-Rao metric.
problem Understanding the geometry of Dirichlet distributions.
method Analysis of Fisher-Rao metric on Dirichlet distribution parameter space.
result Geodesic completeness and negative sectional curvature of the space.
Proofs Fisher-Rao distance on Gaussian covariance manifold.
problem Proving Fisher-Rao distance on Gaussian covariance manifold.
method Basic Riemannian geometry.
result Proof of Fisher-Rao distance on covariance cone.
Cosine schedule is optimal for discrete diffusion models.
problem Choosing the best discretization schedule for diffusion models.
method Optimized using Fisher-Rao geometry.
result Cosine schedule is Fisher-Rao optimal.
The Fisher-Rao geometry is applied to elliptical distributions for optimization and classification.
problem Optimizing and classifying covariance matrices using geometric tools.
method Riemannian optimization and intrinsic Cramér-Rao bounds.
result Geometric tools enhance covariance matrix estimation and classification.
This study describes the Fisher-Rao metric on Gaussian measures in infinite-dimensional spaces.
problem Understanding the Fisher-Rao metric in infinite-dimensional Gaussian settings.
method Explicit description and generalization of finite-dimensional quantities to infinite-dimensional Hilbert spaces.
result The Fisher-Rao metric and related geometric quantities generalize from finite to infinite dimensions.
This paper studies the Fisher-Rao geometry on the parameter space of beta distributions. We derive the geodesic equations and the sectional curvature, and prove that it is negative. This leads to uniqueness for the Riemannian centroid in that space. We use this Riemannian structure to study canonical moments, an intrin…
New method uses Fisher-Rao metric for non-Gaussian decoders.
problem Existing latent space geometry theory only works for Gaussian decoders.
method Pull back Fisher-Rao metric to latent space for non-Gaussian decoders.
result Achieves meaningful latent geometries for various non-Gaussian decoders.
Introduces new geometric framework for probability densities on manifolds.
problem Developing a new geometric framework for probability densities on manifolds.
method Introduces ℓp-information geometry and defines ℓ2-probability simplex with q-root transform. result Explicit solution of gradient flow and geodesic completeness of e-connection. New algorithm for fitting Gaussian mixtures using Wasserstein-Fisher-Rao geometry.
problem Hard problem of fitting Gaussian mixture models to data computationally.
method Gradient descent over Wasserstein-Fisher-Rao geometry for probability measures.
result Established convergence guarantees for the proposed algorithm.
SQFA learns features maximizing Fisher-Rao distance for better classification.
problem Improving classification accuracy through feature learning.
method SQFA learns linear features maximizing Fisher-Rao distance between class-conditional distributions.
result SQFA-H features achieve the best classification accuracy.
The paper proposes a new method to approximate Wasserstein-Fisher-Rao flows using Monte Carlo techniques.
problem Sampling from probability distributions and minimizing Kullback-Leibler divergence.
method Sequential Monte Carlo approximations of Wasserstein-Fisher-Rao gradient flows.
result The proposed method outperforms other Monte Carlo algorithms in certain conditions.
Paper explores Fisher-Rao gradient flows and their kernel approximations.
problem Understanding and analyzing approximations of Fisher-Rao gradient flows.
method Rigorous investigation of Fisher-Rao and Wasserstein type gradient flows, focusing on kernel approximations.
result Proves evolutionary Γ-convergence for kernel-approximated Fisher-Rao flows, providing theoretical guarantees.
New method for natural policy gradients converges linearly.
problem Improving natural policy gradient methods for better convergence.
method Fisher-Rao gradient flow applied to state-action distributions.
result Linear convergence rate with geometry-dependent factor.
This study provides an explicit expansion of KL divergence's gradient flow in Fisher-Rao geometry.
problem Sampling techniques struggle to traverse between modes in non-convex potential functions.
method Explicit expansion of KL divergence's gradient flow in Fisher-Rao geometry.
result The convergence rate to π is independent of the potential function.
We study the relationship between geometry and capacity measures for deep neural networks from an invariance viewpoint. We introduce a new notion of capacity --- the Fisher-Rao norm --- that possesses desirable invariance properties and is motivated by Information Geometry. We discover an analytical characterization of…
The space of probability densities is an infinite-dimensional Riemannian manifold, with Riemannian metrics in two flavors: Wasserstein and Fisher--Rao. The former is pivotal in optimal mass transport (OMT), whereas the latter occurs in information geometry---the differential geometric approach to statistics. The Rieman…
Introduces new Finsler metrics and connects them to information geometry.
problem Generalizing Fisher-Rao metrics and studying their geometric properties.
method Introduces Lp-Fisher-Rao metrics and studies their relations to Amari-Cencov α-connections. result Geodesics of Fp and ∇(α) coincide on Dens+(M) for p=2/(1−α). New method optimizes multiple objectives using particle dynamics and gradient flow.
problem Optimizing multiple conflicting objectives in complex scenarios.
method Interacting particle method combining Langevin and birth-death dynamics with a dominance potential.
result Method effectively relocates dominated particles, improving Pareto optimality.
Develops a real-analytic embedding for diffeomorphisms of the line, linking to Fisher-Rao geometry.
problem Embedding diffeomorphisms of the line in a geometric framework.
method Real-analytic embedding, Lp Fisher-Rao geometry, Schwarzian curvature. result Establishes a connection between diffeomorphisms and Fisher-Rao geometry, providing explicit geodesics and connections.
Researchers study the conformal geometry of bivariate Gaussian manifolds.
problem Exploring the conformal structure of Fisher-Rao metric on statistical manifolds.
method Determined invariants of the conformal structure of the Fisher-Rao metric on the bivariate Gaussian manifold.
result The conformal holonomy group is SO0(1,6) for generic random variables, but SO0(1,4) for independent ones. The paper connects tempering and entropic mirror descent for sampling.
problem Sampling from a target distribution with known unnormalized density.
method Establishes the connection between tempering SMC and entropic mirror descent, deriving convergence rates and geometric insights.
result Tempering SMC iterates correspond to entropic mirror descent on the reverse KL divergence, providing new optimization perspectives.
Introduces a new geometric framework for probability distributions.
problem Developing a geometric framework for probability distributions.
method Introduces ℓp-information geometry and defines the ℓ2-probability simplex via the q-root transform. result Defines a noncanonical differentiable structure and q-root map as an isometry. Adaptive sampling improves graph diffusion models by maintaining uniform information speed.
problem Standard diffusion models overlook non-homogeneous dynamics on complex manifolds.
method Information-geometric framework using Fisher-Rao metric and Drift Variation Score (DVS).
result DVS solver ensures uniform rate of distributional change, improving structural fidelity and efficiency.
New method uses weighted SDEs to improve sampling from complex distributions.
problem Sampling from highly non-log-concave distributions.
method Introduces weighted stochastic differential equations to augment diffusion-based samplers.
result Demonstrates improved exploration of nonconvex or multimodal landscapes.
In optimization, the natural gradient method is well-known for likelihood maximization. The method uses the Kullback-Leibler divergence, corresponding infinitesimally to the Fisher-Rao metric, which is pulled back to the parameter space of a family of probability distributions. This way, gradients with respect to the p…
This paper solves the intractability barrier in non-parametric information geometry by introducing a novel framework.
problem The intractability barrier in non-parametric information geometry due to the Fisher-Rao metric being a functional.
method Introducing an Orthogonal Decomposition of the Tangent Space and deriving the Covariate Fisher Information Matrix (cFIM).
result Established a rigorous foundation for the G-entropy and provided fundamental limits of variance for semi-parametric estimators.
Paper formulates particle flow using variational inference and Fisher-Rao gradient flow.
problem Estimating posterior densities in probabilistic models.
method Variational formulation of particle flow, Fisher-Rao gradient flow, Gaussian and Gaussian mixture approximations.
result Gaussian and Gaussian mixture approximations of Fisher-Rao particle flow reduce to Exact Daum and Huang particle flow under linear Gaussian assumptions.
Survey on closed-form Fisher-Rao distance expressions.
problem Finding closed-form expressions for Fisher-Rao distance.
method Collect and present examples of closed-form expressions for Fisher-Rao distance of discrete and continuous distributions.
result Presentation of closed-form expressions for Fisher-Rao distance of various distributions.
Study the Hessian geometry of an ideal gas in a centrifuge.
problem Understanding the Hessian geometry of an ideal gas in a centrifuge.
method Investigate the Hessian geometry associated with an ideal gas in a spherical centrifuge, using the action of the Euclidean rotation group.
result The Hessian geometry of a spherical rigid body is isometric to a hyperbolic space in the high angular velocity limit.
Paper estimates GMMs with unknown covariances using sparse regularization.
problem Estimating GMMs with unknown diagonal covariances from samples.
method Employed Beurling-LASSO (BLASSO) for sparse estimation of component means, covariances, and weights.
result Established non-asymptotic recovery guarantees with nearly parametric convergence rates.
On a closed manifold of dimension greater than one, every smooth weak Riemannian metric on the space of smooth positive probability densities, that is invariant under the action of the diffeomorphism group, is a multiple of the Fisher--Rao metric.
The paper refines classical covariance asymptotics using geometric information geometry.
problem Deviation of finite-sample behavior from classical predictions in curved models.
method Develops a curvature-aware refinement by viewing parametric families as Riemannian manifolds with Fisher-Rao metric.
result Derives an \(n^{-2}\) correction to the leading \(n^{-1}I(θ)^{-1}\) covariance term for score-root estimators.
SRNF framework extends surface distance to Lipschitz surfaces.
problem Defining a distance metric for unparametrized surfaces.
method Square Root Normal Fields (SRNF) and Wasserstein Fisher Rao (WFR) metric.
result SRNF distance on Lipschitz surfaces is equivalent to WFR metric.
New distances for comparing multivariate normal distributions.
problem Comparing multivariate normal distributions efficiently and accurately.
method Approximated Fisher-Rao distance and pullback SPD cone distances.
result Efficient computation of distances between normal distributions.
This work develops a particle system to approximate Fisher-Rao gradient flows in mean-field optimization.
problem Optimizing probability measures in neural network contexts.
method Constructing an interacting particle system approximating Fisher-Rao gradient flows.
result Propagation of chaos for the Fisher-Rao gradient flow in entropic mean-field optimization.
Study shows splitting schemes can approximate WFR flows faster than the exact flow.
problem Improving sampling efficiency in Wasserstein-Fisher-Rao gradient flows.
method Investigates operator splitting techniques to numerically approximate WFR flows.
result A judicious choice of step size and operator ordering can lead to faster convergence of split schemes to the target distribution.
Igeood detects out-of-distribution samples using information geometry.
problem Out-of-distribution (OOD) detection in machine learning systems.
method Igeood uses the Fisher-Rao geodesic distance to detect OOD samples from any pre-trained neural network.
result Igeood outperforms state-of-the-art methods on various network architectures and datasets.
The paper studies eigenvalues of graph Laplacians on data clouds and proves central limit theorems.
problem Asymptotic fluctuations of eigenvalues of graph Laplacians on data clouds.
method Analysis of graph Laplacian operator, asymptotic fluctuations, central limit theorems.
result Central limit theorems for eigenvalues of graph Laplacians are proven.
New geometric interpretation of Amari-Cencov α-connections on probability densities.
problem Geometric interpretation of Amari-Cencov α-connections on probability densities.
method Riemannian metrics and Levi-Civita connections.
result Geodesics of α-connections are energy-minimizing curves.
Stein transport improves Bayesian inference with faster convergence and reduced variance.
problem Efficiently approximating posterior distributions in Bayesian inference.
method A novel Bayesian inference method using Stein transport, which pushes particles along a curve of tempered distributions.
result Stein transport reaches posterior approximations faster and more accurately than Stein variational gradient descent (SVGD).
It is known that on a closed manifold of dimension greater than one, every smooth weak Riemannian metric on the space of smooth positive densities that is invariant under the action of the diffeomorphism group, is of the form Gμ(α,β)=C1(μ(M))∫Mμαμβμ+C2(μ(M))∫Mα⋅∫Mβ for some smoo…
Geometric tempering improves sampling from distributions, with exponential convergence rates.
problem Sampling from probability distributions using gradient flow dynamics.
method Geometric tempering of the target distribution in Wasserstein and Fisher-Rao gradient flows.
result Exponential convergence in continuous and discrete time for geometric tempering.
Proposes a new algorithm for robust learning in Schrödinger bridge problems.
problem Uncertainty in estimated learning signals in Schrödinger bridge problems.
method Variational Online Mirror Descent (OMD) framework for Schrödinger bridge problems.
result Formally proves convergence and a regret bound for the OMD formulation of Schrödinger bridge acquisition.
This note improves correlation stress tests using geodesic distance.
problem Improving financial risk management through better covariance stress tests.
method Proposes a new geometrically invariant definition of correlation stress tests.
result Demonstrates a submanifold approach to stress testing covariance matrices.
Geometric analysis on diffeomorphism groups for fluid dynamics and information geometry.
problem Geometric analysis of fluid flows and optimal mass transport.
method Review of metrics and topology on diffeomorphism groups.
result Introduction of new metrics and topology for diffeomorphism groups.
This paper shows any Kähler metric can be a Fisher information metric.
problem Establishing a new characterization of Kähler and coKähler manifolds.
method Statistical approach using Fisher information and exponential families.
result Any Kähler metric is a Fisher information metric.
The Madelung transform connects quantum mechanics and hydrodynamics.
problem Quantum mechanics and hydrodynamics equivalence for generic wave functions.
method Poisson geometry and coadjoint orbits of semidirect extensions of diffeomorphism groups.
result The Madelung transform provides a natural infinite-dimensional version of convexity results.
The paper explores the geometric structure of cost functions in multiple dimensions.
problem Understanding the geometric properties of cost functions in multidimensional settings.
method Analyzes the Hessian metric and geodesics in logarithmic and original coordinates.
result The geometry is one-dimensional in logarithmic coordinates but effectively (n−1)-dimensional in original coordinates.