Proofs Fisher-Rao distance on Gaussian covariance manifold.
problem Proving Fisher-Rao distance on Gaussian covariance manifold.
method Basic Riemannian geometry.
result Proof of Fisher-Rao distance on covariance cone.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Fisher-Rao”
Study on geometry of Dirichlet distributions using Fisher-Rao metric.
problem Understanding the geometry of Dirichlet distributions.
method Analysis of Fisher-Rao metric on Dirichlet distribution parameter space.
result Geodesic completeness and negative sectional curvature of the space.
Paper formulates particle flow using variational inference and Fisher-Rao gradient flow.
problem Estimating posterior densities in probabilistic models.
method Variational formulation of particle flow, Fisher-Rao gradient flow, Gaussian and Gaussian mixture approximations.
result Gaussian and Gaussian mixture approximations of Fisher-Rao particle flow reduce to Exact Daum and Huang particle flow under linear Gaussian assumptions.
Survey on closed-form Fisher-Rao distance expressions.
problem Finding closed-form expressions for Fisher-Rao distance.
method Collect and present examples of closed-form expressions for Fisher-Rao distance of discrete and continuous distributions.
result Presentation of closed-form expressions for Fisher-Rao distance of various distributions.
Paper explores Fisher-Rao gradient flows and their kernel approximations.
problem Understanding and analyzing approximations of Fisher-Rao gradient flows.
method Rigorous investigation of Fisher-Rao and Wasserstein type gradient flows, focusing on kernel approximations.
result Proves evolutionary Γ-convergence for kernel-approximated Fisher-Rao flows, providing theoretical guarantees.
Cosine schedule is optimal for discrete diffusion models.
problem Choosing the best discretization schedule for diffusion models.
method Optimized using Fisher-Rao geometry.
result Cosine schedule is Fisher-Rao optimal.
The paper proposes a new method to approximate Wasserstein-Fisher-Rao flows using Monte Carlo techniques.
problem Sampling from probability distributions and minimizing Kullback-Leibler divergence.
method Sequential Monte Carlo approximations of Wasserstein-Fisher-Rao gradient flows.
result The proposed method outperforms other Monte Carlo algorithms in certain conditions.
This study describes the Fisher-Rao metric on Gaussian measures in infinite-dimensional spaces.
problem Understanding the Fisher-Rao metric in infinite-dimensional Gaussian settings.
method Explicit description and generalization of finite-dimensional quantities to infinite-dimensional Hilbert spaces.
result The Fisher-Rao metric and related geometric quantities generalize from finite to infinite dimensions.
New method for natural policy gradients converges linearly.
problem Improving natural policy gradient methods for better convergence.
method Fisher-Rao gradient flow applied to state-action distributions.
result Linear convergence rate with geometry-dependent factor.
The Fisher-Rao geometry is applied to elliptical distributions for optimization and classification.
problem Optimizing and classifying covariance matrices using geometric tools.
method Riemannian optimization and intrinsic Cramér-Rao bounds.
result Geometric tools enhance covariance matrix estimation and classification.
On a closed manifold of dimension greater than one, every smooth weak Riemannian metric on the space of smooth positive probability densities, that is invariant under the action of the diffeomorphism group, is a multiple of the Fisher--Rao metric.
This paper studies the Fisher-Rao geometry on the parameter space of beta distributions. We derive the geodesic equations and the sectional curvature, and prove that it is negative. This leads to uniqueness for the Riemannian centroid in that space. We use this Riemannian structure to study canonical moments, an intrin…
SRNF framework extends surface distance to Lipschitz surfaces.
problem Defining a distance metric for unparametrized surfaces.
method Square Root Normal Fields (SRNF) and Wasserstein Fisher Rao (WFR) metric.
result SRNF distance on Lipschitz surfaces is equivalent to WFR metric.
New distances for comparing multivariate normal distributions.
problem Comparing multivariate normal distributions efficiently and accurately.
method Approximated Fisher-Rao distance and pullback SPD cone distances.
result Efficient computation of distances between normal distributions.
New method optimizes multiple objectives using particle dynamics and gradient flow.
problem Optimizing multiple conflicting objectives in complex scenarios.
method Interacting particle method combining Langevin and birth-death dynamics with a dominance potential.
result Method effectively relocates dominated particles, improving Pareto optimality.
New algorithm for fitting Gaussian mixtures using Wasserstein-Fisher-Rao geometry.
problem Hard problem of fitting Gaussian mixture models to data computationally.
method Gradient descent over Wasserstein-Fisher-Rao geometry for probability measures.
result Established convergence guarantees for the proposed algorithm.
This work develops a particle system to approximate Fisher-Rao gradient flows in mean-field optimization.
problem Optimizing probability measures in neural network contexts.
method Constructing an interacting particle system approximating Fisher-Rao gradient flows.
result Propagation of chaos for the Fisher-Rao gradient flow in entropic mean-field optimization.
This study provides an explicit expansion of KL divergence's gradient flow in Fisher-Rao geometry.
problem Sampling techniques struggle to traverse between modes in non-convex potential functions.
method Explicit expansion of KL divergence's gradient flow in Fisher-Rao geometry.
result The convergence rate to π is independent of the potential function.
Study shows splitting schemes can approximate WFR flows faster than the exact flow.
problem Improving sampling efficiency in Wasserstein-Fisher-Rao gradient flows.
method Investigates operator splitting techniques to numerically approximate WFR flows.
result A judicious choice of step size and operator ordering can lead to faster convergence of split schemes to the target distribution.
Develops a real-analytic embedding for diffeomorphisms of the line, linking to Fisher-Rao geometry.
problem Embedding diffeomorphisms of the line in a geometric framework.
method Real-analytic embedding, Fisher-Rao geometry, Schwarzian curvature.
result Establishes a connection between diffeomorphisms and Fisher-Rao geometry, providing explicit geodesics and connections.
New method uses Fisher-Rao metric for non-Gaussian decoders.
problem Existing latent space geometry theory only works for Gaussian decoders.
method Pull back Fisher-Rao metric to latent space for non-Gaussian decoders.
result Achieves meaningful latent geometries for various non-Gaussian decoders.
Geometric tempering improves sampling from distributions, with exponential convergence rates.
problem Sampling from probability distributions using gradient flow dynamics.
method Geometric tempering of the target distribution in Wasserstein and Fisher-Rao gradient flows.
result Exponential convergence in continuous and discrete time for geometric tempering.
This note improves correlation stress tests using geodesic distance.
problem Improving financial risk management through better covariance stress tests.
method Proposes a new geometrically invariant definition of correlation stress tests.
result Demonstrates a submanifold approach to stress testing covariance matrices.
Supervised Quadratic Feature Analysis: Information Geometry Approach for Dimensionality Reductionstat.ML
SQFA learns features maximizing Fisher-Rao distance for better classification.
problem Improving classification accuracy through feature learning.
method SQFA learns linear features maximizing Fisher-Rao distance between class-conditional distributions.
result SQFA-H features achieve the best classification accuracy.
Introduces new Finsler metrics and connects them to information geometry.
problem Generalizing Fisher-Rao metrics and studying their geometric properties.
method Introduces -Fisher-Rao metrics and studies their relations to Amari-Cencov -connections.
result Geodesics of and coincide on Dens for .
Introduces new geometric framework for probability densities on manifolds.
problem Developing a new geometric framework for probability densities on manifolds.
method Introduces -information geometry and defines -probability simplex with -root transform.
result Explicit solution of gradient flow and geodesic completeness of -connection.
We study the relationship between geometry and capacity measures for deep neural networks from an invariance viewpoint. We introduce a new notion of capacity --- the Fisher-Rao norm --- that possesses desirable invariance properties and is motivated by Information Geometry. We discover an analytical characterization of…
Optimal Transport vs. Fisher-Rao distance between Copulas for Clustering Multivariate Time Seriesstat.ML
We present a methodology for clustering N objects which are described by multivariate time series, i.e. several sequences of real-valued random variables. This clustering methodology leverages copulas which are distributions encoding the dependence structure between several random variables. To take fully into account …
New sampling method uses gradient-free IPS with RKHS velocity field.
problem Efficient sampling from unnormalized target densities.
method Gradient-free interacting particle systems (IPS) with RKHS velocity field.
result IPS produce high-quality samples from various target distributions.
Adaptive sampling improves graph diffusion models by maintaining uniform information speed.
problem Standard diffusion models overlook non-homogeneous dynamics on complex manifolds.
method Information-geometric framework using Fisher-Rao metric and Drift Variation Score (DVS).
result DVS solver ensures uniform rate of distributional change, improving structural fidelity and efficiency.
New budget quantifies drift in closed-loop learning, improving reproducibility.
problem Characterizing statistical learning under distributional drift in closed-loop settings.
method Introduces an intrinsic drift budget quantifying cumulative information-geometric motion of the data distribution.
result Proves a drift-feedback bound of order for prequential reproducibility, up to controlled second-order remainder terms.
Paper connects surface shape analysis and unbalanced optimal transport.
problem Computing the SRNF shape distance on piecewise linear surfaces.
method Characterizes SRNF shape distance as WFR distance pullback, proposes new algorithm for WFR distance computation.
result Direct computation of SRNF shape distance on piecewise linear surfaces.
Proves FR-NGD optimally approximates evolutionary dynamics and continuous Bayesian inference.
problem Optimizing continuous time replicator equations and continuous Bayesian inference.
method Fisher-Rao natural gradient descent (FR-NGD) and its correspondence with evolutionary dynamics.
result FR-NGD optimally approximates continuous time replicator equations and continuous Bayesian inference.
We present a framework for Nesterov's accelerated gradient flows in probability space to design efficient mean-field Markov chain Monte Carlo (MCMC) algorithms for Bayesian inverse problems. Here four examples of information metrics are considered, including Fisher-Rao metric, Wasserstein-2 metric, Kalman-Wasserstein m…
The natural gradient of ELBO vanishes in unconstrained optimization, simplifying learning.
problem The gap between evidence and ELBO has a vanishing natural gradient.
method Analyzes the Fisher-Rao gradient of ELBO and its implications for learning.
result Maximizing ELBO is equivalent to minimizing KL divergence, simplifying learning.
The space of probability densities is an infinite-dimensional Riemannian manifold, with Riemannian metrics in two flavors: Wasserstein and Fisher--Rao. The former is pivotal in optimal mass transport (OMT), whereas the latter occurs in information geometry---the differential geometric approach to statistics. The Rieman…
New method uses weighted SDEs to improve sampling from complex distributions.
problem Sampling from highly non-log-concave distributions.
method Introduces weighted stochastic differential equations to augment diffusion-based samplers.
result Demonstrates improved exploration of nonconvex or multimodal landscapes.
In optimization, the natural gradient method is well-known for likelihood maximization. The method uses the Kullback-Leibler divergence, corresponding infinitesimally to the Fisher-Rao metric, which is pulled back to the parameter space of a family of probability distributions. This way, gradients with respect to the p…
As a fundamental problem of natural language processing, it is important to measure the distance between different documents. Among the existing methods, the Word Mover's Distance (WMD) has shown remarkable success in document semantic matching for its clear physical insight as a parameter-free model. However, WMD is e…
Researchers study the conformal geometry of bivariate Gaussian manifolds.
problem Exploring the conformal structure of Fisher-Rao metric on statistical manifolds.
method Determined invariants of the conformal structure of the Fisher-Rao metric on the bivariate Gaussian manifold.
result The conformal holonomy group is for generic random variables, but for independent ones.
The paper connects tempering and entropic mirror descent for sampling.
problem Sampling from a target distribution with known unnormalized density.
method Establishes the connection between tempering SMC and entropic mirror descent, deriving convergence rates and geometric insights.
result Tempering SMC iterates correspond to entropic mirror descent on the reverse KL divergence, providing new optimization perspectives.
Splat Regression Modelsstat.ML
Splat Regression Models use mixtures of bump functions to approximate complex data.
problem Approximating complex data with high interpretability and accuracy.
method Model outputs are mixtures of heterogeneous and anisotropic bump functions (splats) weighted by output vectors. Fitting splat models reduces to optimization over mixing measures using Wasserstein-Fisher-Rao gradient flows.
result Unified theoretical framework for Gaussian Splatting and flexible approach for diverse problems.
Paper analyzes inclusive KL inference using Wasserstein gradient flows.
problem Analyzing inclusive KL inference with mathematical tools.
method Gradient flows derived from PDE analysis.
result Unified view of existing sampling algorithms as inclusive-KL inference.
Introduces a new geometric framework for probability distributions.
problem Developing a geometric framework for probability distributions.
method Introduces -information geometry and defines the -probability simplex via the -root transform.
result Defines a noncanonical differentiable structure and -root map as an isometry.
LDReg addresses local dimensional collapse in self-supervised learning.
problem Local dimensional collapse in self-supervised learning representations.
method Local dimensionality regularization based on Fisher-Rao metric.
result LDReg improves representation quality and regularizes local and global dimensions.
Method identifies mixed Nash equilibria in high dimensions for training mixtures of GANs.
problem Finding Nash equilibria in two-player zero-sum continuous games, especially in high dimensions.
method Parametrizing mixed strategies as mixtures of particles, updating their positions and weights using gradient descent-ascent.
result Global convergence to an approximate equilibrium for the related Langevin gradient-ascent dynamic.
Paper introduces a new distance measure for Gaussian Mixture Models.
problem Developing a new distance measure for Gaussian Mixture Models.
method Embedding K-component Gaussian Mixture Models into the manifold of symmetric positive definite matrices and calculating a lower bound for the Fisher-Rao metric.
result Demonstrated effectiveness through experiments on standard datasets.
An approach to Fisher-Rao metric for infinite dimensional non-parametric information geometrystat.ML
This paper solves the intractability barrier in non-parametric information geometry by introducing a novel framework.
problem The intractability barrier in non-parametric information geometry due to the Fisher-Rao metric being a functional.
method Introducing an Orthogonal Decomposition of the Tangent Space and deriving the Covariate Fisher Information Matrix (cFIM).
result Established a rigorous foundation for the G-entropy and provided fundamental limits of variance for semi-parametric estimators.